Fatal error with playback when hardware accelleration is enabled.

[rob bindels]

This is the situation:
Data is on a Qnap nas.
Jellyfin is installed on a N150 device, with Windows 11.
Jellyfin version is 10.10.6.

As the CPU is at 100% for playback, I thought to activate Transcoding.
I did select QSV. And then under Hardwarecoding I selected all, I could. And that works.
It even seems, that the GPU is now being used a bit (10/25%)  and the CPU is still at 100%.
But it works.

As soon as I select under Options for hardwaredecoding: Hardwarecoding switch on, I get a fatal error.

This is for instance the Media info from one of the movies I tried:

SOUND
Titel: Surround 5.1 - Engels - Dolby Digital - Default
Taal: eng
Codec: AC3
AVC: No
Opmaak: 5.1
Kanalen: 6 ch
Bitsnelheid: 448 kbps
Bemonsteringsfrequentie: 48000 Hz
Standaard: Yes
Gedwongen: No
Extern: No

Undertitleling
Titel: Dut - Default - DVDSUB
Taal: dut
Codec: DVDSUB
AVC: No
Resolutie: 720x576
Standaard: Yes
Gedwongen: No
Extern: No

VIEW
Titel: 576i MPEG2VIDEO SDR
Codec: MPEG2VIDEO
AVC: No
Profiel: Main
Niveau: 8
Resolutie: 720x576
Beeldverhouding: 16:9
Anamorf: No
Geïnterlinieerd: Yes
Verversingssnelheid: 25
Bitsnelheid: 5559 kbps
Bitdiepte: 8 bit
Beeldbereik: SDR
Bereiktype beeld: SDR
Pixelformaat: yuv420p
Ref-frames: 1

Thanks ahead for any help. 
As I am the only viewer of the system, Hardware accelleration is maybe not a needing thing, but if I read that others have 10 streams 1080, or 2 streams 4k, I wonder how to do that, if I am instantly on 100% cpu.

RobBee

[Efficient_Good_5784]

Can you share the ffmpeg logs of the failed playback attempt?

[rob bindels]

This is from the last movie, I tried.

{"Protocol":0,"Id":"2eb0a3d3e4474c78312b8c882d7e281b","Path":"M:\\Actie-Drama\\Troy\\Troy.mkv","EncoderPath":null,"EncoderProtocol":null,"Type":0,"Container":"mkv","Size":6298811713,"Name":"Troy","IsRemote":false,"ETag":"d5eb1af24e16711279c23d52be6e7288","RunTimeTicks":93660000000,"ReadAtNativeFramerate":false,"IgnoreDts":false,"IgnoreIndex":false,"GenPtsInput":false,"SupportsTranscoding":true,"SupportsDirectStream":true,"SupportsDirectPlay":true,"IsInfiniteStream":false,"UseMostCompatibleTranscodingProfile":false,"RequiresOpening":false,"OpenToken":null,"RequiresClosing":false,"LiveStreamId":null,"BufferMs":null,"RequiresLooping":false,"SupportsProbing":true,"VideoType":0,"IsoType":null,"Video3DFormat":null,"MediaStreams":[{"Codec":"mpeg2video","CodecTag":null,"Language":"eng","ColorRange":null,"ColorSpace":null,"ColorTransfer":null,"ColorPrimaries":null,"DvVersionMajor":null,"DvVersionMinor":null,"DvProfile":null,"DvLevel":null,"RpuPresentFlag":null,"ElPresentFlag":null,"BlPresentFlag":null,"DvBlSignalCompatibilityId":null,"Rotation":null,"Comment":null,"TimeBase":"1/1000","CodecTimeBase":null,"Title":null,"VideoRange":1,"VideoRangeType":1,"VideoDoViTitle":null,"AudioSpatialFormat":0,"LocalizedUndefined":null,"LocalizedDefault":null,"LocalizedForced":null,"LocalizedExternal":null,"LocalizedHearingImpaired":null,"DisplayTitle":"576p MPEG2VIDEO SDR","NalLengthSize":null,"IsInterlaced":false,"IsAVC":false,"ChannelLayout":null,"BitRate":5380150,"BitDepth":8,"RefFrames":1,"PacketLength":null,"Channels":null,"SampleRate":null,"IsDefault":false,"IsForced":false,"IsHearingImpaired":false,"Height":576,"Width":720,"AverageFrameRate":25,"RealFrameRate":25,"ReferenceFrameRate":25,"Profile":"Main","Type":1,"AspectRatio":"16:9","Index":0,"Score":null,"IsExternal":false,"DeliveryMethod":null,"DeliveryUrl":null,"IsExternalUrl":null,"IsTextSubtitleStream":false,"SupportsExternalStream":false,"Path":null,"PixelFormat":"yuv420p","Level":8,"IsAnamorphic":false},{"Codec":"ac3","CodecTag":null,"Language":"eng","ColorRange":null,"ColorSpace":null,"ColorTransfer":null,"ColorPrimaries":null,"DvVersionMajor":null,"DvVersionMinor":null,"DvProfile":null,"DvLevel":null,"RpuPresentFlag":null,"ElPresentFlag":null,"BlPresentFlag":null,"DvBlSignalCompatibilityId":null,"Rotation":null,"Comment":null,"TimeBase":"1/1000","CodecTimeBase":null,"Title":"Surround 5.1","VideoRange":0,"VideoRangeType":0,"VideoDoViTitle":null,"AudioSpatialFormat":0,"LocalizedUndefined":null,"LocalizedDefault":"Default","LocalizedForced":null,"LocalizedExternal":"External","LocalizedHearingImpaired":null,"DisplayTitle":"Surround 5.1 - Engels - Dolby Digital - Default","NalLengthSize":null,"IsInterlaced":false,"IsAVC":false,"ChannelLayout":"5.1","BitRate":384000,"BitDepth":null,"RefFrames":null,"PacketLength":null,"Channels":6,"SampleRate":48000,"IsDefault":true,"IsForced":false,"IsHearingImpaired":false,"Height":null,"Width":null,"AverageFrameRate":null,"RealFrameRate":null,"ReferenceFrameRate":null,"Profile":null,"Type":0,"AspectRatio":null,"Index":1,"Score":null,"IsExternal":false,"DeliveryMethod":null,"DeliveryUrl":null,"IsExternalUrl":null,"IsTextSubtitleStream":false,"SupportsExternalStream":false,"Path":null,"PixelFormat":null,"Level":0,"IsAnamorphic":null},{"Codec":"DVDSUB","CodecTag":null,"Language":"dut","ColorRange":null,"ColorSpace":null,"ColorTransfer":null,"ColorPrimaries":null,"DvVersionMajor":null,"DvVersionMinor":null,"DvProfile":null,"DvLevel":null,"RpuPresentFlag":null,"ElPresentFlag":null,"BlPresentFlag":null,"DvBlSignalCompatibilityId":null,"Rotation":null,"Comment":null,"TimeBase":"1/1000","CodecTimeBase":null,"Title":null,"VideoRange":0,"VideoRangeType":0,"VideoDoViTitle":null,"AudioSpatialFormat":0,"LocalizedUndefined":"Undefined","LocalizedDefault":"Default","LocalizedForced":"Forced","LocalizedExternal":"External","LocalizedHearingImpaired":"Hearing Impaired","DisplayTitle":"Dut - Default - DVDSUB","NalLengthSize":null,"IsInterlaced":false,"IsAVC":false,"ChannelLayout":null,"BitRate":null,"BitDepth":null,"RefFrames":null,"PacketLength":null,"Channels":null,"SampleRate":null,"IsDefault":true,"IsForced":false,"IsHearingImpaired":false,"Height":576,"Width":720,"AverageFrameRate":null,"RealFrameRate":null,"ReferenceFrameRate":null,"Profile":null,"Type":2,"AspectRatio":null,"Index":2,"Score":null,"IsExternal":false,"DeliveryMethod":null,"DeliveryUrl":null,"IsExternalUrl":null,"IsTextSubtitleStream":false,"SupportsExternalStream":false,"Path":null,"PixelFormat":null,"Level":0,"IsAnamorphic":null}],"MediaAttachments":[],"Formats":[],"Bitrate":5764150,"FallbackMaxStreamingBitrate":null,"Timestamp":null,"RequiredHttpHeaders":{},"TranscodingUrl":null,"TranscodingSubProtocol":0,"TranscodingContainer":null,"AnalyzeDurationMs":null,"DefaultAudioStreamIndex":null,"DefaultSubtitleStreamIndex":null,"HasSegments":false}

ffmpeg -analyzeduration 200M -probesize 1G -f matroska -init_hw_device d3d11va=dx11:,vendor=0x8086 -init_hw_device qsv=qs@dx11 -filter_hw_device qs -hwaccel d3d11va -hwaccel_output_format d3d11 -noautorotate -threads 2 -canvas_size 720x576 -i file:"M:\Actie-Drama\Troy\Troy.mkv" -noautoscale -map_metadata -1 -map_chapters -1 -threads 0 -map 0:0 -map 0:1 -map -0:0 -codec:v:0 av1_qsv -preset veryfast -b:v 5380150 -maxrate 5380150 -bufsize 10760300 -profile:v:0 main -level 53 -g:v:0 75 -keyint_min:v:0 75 -filter_complex "[0:2]scale,scale=720:576:fast_bilinear,format=bgra,hwupload=derive_device=qsv:extra_hw_frames=64[sub];[0:0]setparams=color_primaries=bt709:color_trc=bt709:colorspace=bt709,hwmap=derive_device=qsv,vpp_qsv=format=nv12[main];[main][sub]overlay_qsv=eof_action=pass:repeatlast=0:w=720:h=576" -start_at_zero -codec:a:0 libfdk_aac -ac 6 -ab 640000 -copyts -avoid_negative_ts disabled -max_muxing_queue_size 2048 -f hls -max_delay 5000000 -hls_time 3 -hls_segment_type fmp4 -hls_fmp4_init_filename "C:\Users\Meester\AppData\Local\Jellyfin\cache\transcodes\43476eb0db61629684f2485f7331437a-1.mp4" -start_number 0 -hls_segment_filename "C:\Users\Meester\AppData\Local\Jellyfin\cache\transcodes\43476eb0db61629684f2485f7331437a%d.mp4" -hls_playlist_type vod -hls_list_size 0 -y "C:\Users\Meester\AppData\Local\Jellyfin\cache\transcodes\43476eb0db61629684f2485f7331437a.m3u8"


ffmpeg version 7.0.2-Jellyfin Copyright © 2000-2024 the FFmpeg developers
built with clang version 19.1.7
configuration: --cc=clang --pkg-config-flags=--static --extra-cflags=-I/clang64/ffbuild/include --extra-ldflags=-L/clang64/ffbuild/lib --prefix=/clang64/ffbuild/jellyfin-ffmpeg --extra-version=Jellyfin --disable-ffplay --disable-debug --disable-doc --disable-sdl2 --disable-ptx-compression --enable-lto=thin --enable-gpl --enable-version3 --enable-schannel --enable-iconv --enable-libxml2 --enable-zlib --enable-lzma --enable-gmp --enable-chromaprint --enable-libfreetype --enable-libfribidi --enable-libfontconfig --enable-libharfbuzz --enable-libass --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libopenmpt --enable-libwebp --enable-libvpx --enable-libzimg --enable-libx264 --enable-libx265 --enable-libsvtav1 --enable-libdav1d --enable-libfdk-aac --enable-opencl --enable-dxva2 --enable-d3d11va --enable-d3d12va --enable-amf --enable-libvpl --enable-ffnvcodec --enable-cuda --enable-cuda-llvm --enable-cuvid --enable-nvdec --enable-nvenc
libavutil 59. 8.100 / 59. 8.100
libavcodec 61. 3.100 / 61. 3.100
libavformat 61. 1.100 / 61. 1.100
libavdevice 61. 1.100 / 61. 1.100
libavfilter 10. 1.100 / 10. 1.100
libswscale 8. 1.100 / 8. 1.100
libswresample 5. 1.100 / 5. 1.100
libpostproc 58. 1.100 / 58. 1.100
[AVHWDeviceContext @ 0000024d25ae52c0] Using device 8086:46d4 (Intel® Graphics).
Input #0, matroska,webm, from 'file:M:\Actie-Drama\Troy\Troy.mkv':
Metadata:
encoder : libmakemkv v1.15.2 (1.3.10/1.5.2) win(x64-release)
creation_time : 2020-08-12T20:15:50.000000Z
Duration: 02:36:06.00, start: 0.000000, bitrate: 5380 kb/s
Chapters:
Chapter #0:0: start 0.080000, end 116.800000
Metadata:
title : Chapter 01
Chapter #0:1: start 116.800000, end 388.080000
Metadata:
title : Chapter 02
Chapter #0:2: start 388.080000, end 539.200000
Metadata:
title : Chapter 03
Chapter #0:3: start 539.200000, end 836.840000
Metadata:
title : Chapter 04
Chapter #0:4: start 836.840000, end 1119.080000
Metadata:
title : Chapter 05
Chapter #0:5: start 1119.080000, end 1223.360000
Metadata:
title : Chapter 06
Chapter #0:6: start 1223.360000, end 1410.920000
Metadata:
title : Chapter 07
Chapter #0:7: start 1410.920000, end 1578.760000
Metadata:
title : Chapter 08
Chapter #0:8: start 1578.760000, end 1743.400000
Metadata:
title : Chapter 09
Chapter #0:9: start 1743.400000, end 1934.120000
Metadata:
title : Chapter 10
Chapter #0:10: start 1934.120000, end 2272.760000
Metadata:
title : Chapter 11
Chapter #0:11: start 2272.760000, end 2534.600000
Metadata:
title : Chapter 12
Chapter #0:12: start 2534.600000, end 2814.680000
Metadata:
title : Chapter 13
Chapter #0:13: start 2814.680000, end 3026.760000
Metadata:
title : Chapter 14
Chapter #0:14: start 3026.760000, end 3273.040000
Metadata:
title : Chapter 15
Chapter #0:15: start 3273.040000, end 3479.720000
Metadata:
title : Chapter 16
Chapter #0:16: start 3479.720000, end 3645.920000
Metadata:
title : Chapter 17
Chapter #0:17: start 3645.920000, end 3760.560000
Metadata:
title : Chapter 18
Chapter #0:18: start 3760.560000, end 4005.760000
Metadata:
title : Chapter 19
Chapter #0:19: start 4005.760000, end 4189.640000
Metadata:
title : Chapter 20
Chapter #0:20: start 4189.640000, end 4454.360000
Metadata:
title : Chapter 21
Chapter #0:21: start 4454.360000, end 4661.960000
Metadata:
title : Chapter 22
Chapter #0:22: start 4661.960000, end 4811.000000
Metadata:
title : Chapter 23
Chapter #0:23: start 4811.000000, end 5032.200000
Metadata:
title : Chapter 24
Chapter #0:24: start 5032.200000, end 5356.720000
Metadata:
title : Chapter 25
Chapter #0:25: start 5356.720000, end 5599.440000
Metadata:
title : Chapter 26
Chapter #0:26: start 5599.440000, end 5823.760000
Metadata:
title : Chapter 27
Chapter #0:27: start 5823.760000, end 6075.720000
Metadata:
title : Chapter 28
Chapter #0:28: start 6075.720000, end 6178.640000
Metadata:
title : Chapter 29
Chapter #0:29: start 6178.640000, end 6374.160000
Metadata:
title : Chapter 30
Chapter #0:30: start 6374.160000, end 6701.400000
Metadata:
title : Chapter 31
Chapter #0:31: start 6701.400000, end 6839.720000
Metadata:
title : Chapter 32
Chapter #0:32: start 6839.720000, end 7025.320000
Metadata:
title : Chapter 33
Chapter #0:33: start 7025.320000, end 7146.960000
Metadata:
title : Chapter 34
Chapter #0:34: start 7146.960000, end 7485.000000
Metadata:
title : Chapter 35
Chapter #0:35: start 7485.000000, end 7601.800000
Metadata:
title : Chapter 36
Chapter #0:36: start 7601.800000, end 7808.960000
Metadata:
title : Chapter 37
Chapter #0:37: start 7808.960000, end 7991.760000
Metadata:
title : Chapter 38
Chapter #0:38: start 7991.760000, end 8225.080000
Metadata:
title : Chapter 39
Chapter #0:39: start 8225.080000, end 8348.280000
Metadata:
title : Chapter 40
Chapter #0:40: start 8348.280000, end 8521.920000
Metadata:
title : Chapter 41
Chapter #0:41: start 8521.920000, end 8695.160000
Metadata:
title : Chapter 42
Chapter #0:42: start 8695.160000, end 8802.000000
Metadata:
title : Chapter 43
Chapter #0:43: start 8802.000000, end 9366.000000
Metadata:
title : Chapter 44
Stream #0:0(eng): Video: mpeg2video (Main), yuv420p(tv, progressive), 720x576 [SAR 64:45 DAR 16:9], 25 fps, 25 tbr, 1k tbn
Metadata:
BPS-eng : 4989617
DURATION-eng : 02:36:06.000000000
NUMBER_OF_FRAMES-eng: 234150
NUMBER_OF_BYTES-eng: 5841594988
SOURCE_ID-eng : 0100E0
_STATISTICS_WRITING_APP-eng: MakeMKV v1.15.2 win(x64-release)
_STATISTICS_WRITING_DATE_UTC-eng: 2020-08-12 20:15:50
_STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID
Side data:
cpb: bitrate max/min/avg: 7500000/0/0 buffer size: 1835008 vbv_delay: N/A
Stream #0:1(eng): Audio: ac3, 48000 Hz, 5.1(side), fltp, 384 kb/s (default)
Metadata:
title : Surround 5.1
BPS-eng : 384000
DURATION-eng : 02:36:05.984000000
NUMBER_OF_FRAMES-eng: 292687
NUMBER_OF_BYTES-eng: 449567232
SOURCE_ID-eng : 0180BD
_STATISTICS_WRITING_APP-eng: MakeMKV v1.15.2 win(x64-release)
_STATISTICS_WRITING_DATE_UTC-eng: 2020-08-12 20:15:50
_STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID
Stream #0:2(dut): Subtitle: dvd_subtitle (dvdsub), 720x576 (default)
Metadata:
BPS-eng : 1488
DURATION-eng : 02:35:22.191111111
NUMBER_OF_FRAMES-eng: 951
NUMBER_OF_BYTES-eng: 1734112
SOURCE_ID-eng : 0121BD
_STATISTICS_WRITING_APP-eng: MakeMKV v1.15.2 win(x64-release)
_STATISTICS_WRITING_DATE_UTC-eng: 2020-08-12 20:15:50
_STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES SOURCE_ID
Stream mapping:
Stream #0:0 (mpeg2video) -> setparams:default (graph 0)
Stream #0:2 (dvdsub) -> scale:default (graph 0)
overlay_qsv:default (graph 0) -> Stream #0:0 (av1_qsv)
Stream #0:1 -> #0:1 (ac3 (native) -> aac (libfdk_aac))
Press [q] to stop, [?] for help
[av1_qsv @ 0000024d341296c0] Current codec type is unsupported
[av1_qsv @ 0000024d341296c0] some encoding parameters are not supported by the QSV runtime. Please double check the input parameters.
[vost#0:0/av1_qsv @ 0000024d345beb00] Error while opening encoder - maybe incorrect parameters such as bit_rate, rate, width or height.
[fc#0 @ 0000024d346f8400] Error sending frames to consumers: Function not implemented
[fc#0 @ 0000024d346f8400] Task finished with error code: -40 (Function not implemented)
[fc#0 @ 0000024d346f8400] Terminating thread with return code -40 (Function not implemented)
[vost#0:0/av1_qsv @ 0000024d345beb00] Could not open encoder before EOF
[vost#0:0/av1_qsv @ 0000024d345beb00] Task finished with error code: -22 (Invalid argument)
[vost#0:0/av1_qsv @ 0000024d345beb00] Terminating thread with return code -22 (Invalid argument)
[out#0/hls @ 0000024d3385d400] Nothing was written into output file, because at least one of its streams received no packets.
frame= 0 fps=0.0 q=0.0 Lsize= 0KiB time=N/A bitrate=N/A speed=N/A
Conversion failed!

[Efficient_Good_5784]

Looks like the iGPU can only decode AV1, not encode it.
Go into your dashboard, then to transcoding settings and disable the AV1 encoding option.

[rob bindels]

That is it. Thank you.

---

CPU is now 70% and GPU 50% +/-.

Can we also see, why I am, if I translate that to the amount of streams, I am still getting to 1. Maybe 2, and it is only HD. Why do others get more? Or is it to difficult to say?

RobBee

[Efficient_Good_5784]

The usage reported doesn't scale linearly for HWA. You can test out how many streams you can transcode at once by opening multiple browser tabs and forcing a transcode on each one.

[rob bindels]

In the end I tried 3 streams, and that worked.
What I have noticed is that the CPU stays at 100% and the GPU went up to 75%.
And I have the idea that when you start a movie, that Jeffyfin starts working very, and processes the video faster then the duration of the movie. Lets say, movy of 2 hours, processed in 1 hour. And the CPU is then at 100% at work, and done after 1 hour.
Is my assumption correct?

Thanks foor the help.

RobBee

[Efficient_Good_5784]

The transcode will be handled as fast as it can be by the hardware.

You can see the actual speed in the playback info tool from the video player.
It will tell you how much fps your transcode is running at and the actual speed ratio.

So if your video runs at 24fps and the transcode is happening at 48fps, Jellyfin will show this: "48fps (2.0X)"
In this example, "2.0X" means that the transcode is happening twice as fast which you can extrapolate to mean the transcode will finish in half the time it takes to watch the video.

Videos are transcoded into small chunks and are stored on the transcode folder.
These chunks get sent to the client that started the transcode.

[rob bindels]

Thank you for the explanation.