Playback error - transcoding settings

[catakdd]

Hello,

I have a jellyfin setup on my own home-server and I think that I messed up some transcoding settings.
My mini server has the following specs:
i5 6400
8GB RAM
no GPU
I'm using docker on a separate user if that's relevant at all.

I have this issue on some of the movies in my library: "Playback failed due to a fatal player error"
Log: https://pastebin.com/XSWpQPvk

I think I messed up the settings when playing with the transcoding options. I had some issues where my CPU was at 100% used by ffmpeg while playing a movie so I thought I need to change some settings. Looked up what is available for i5 6400 and ended up checking:
Intel QuickSync (QSV) 
HEVC, MPEG2, VC1, VP8
Prefer OS native DXVA or VA-API hardware decoders
Enable hardware encoding
Enable Intel Low-Power H.264 hardware encoder
Enable Intel Low-Power HEVC hardware encoder
Allow encoding in HEVC format
* All the other options are disabled (default)

Can someone help me or guide me where to find additional information about the encoding settings? I'm new to this and I have no ideea whats good and whats not right for my CPU.

Thank you!

[theguymadmax]

Post the ffmpeg logs.

[TheDreadPirate]

Switch the HWA to VAAPI. I've noticed recently that Sky Lake CPUs are no longer working with Quick Sync. I'm wondering if support is/was deprecated for that CPU family.

[catakdd]

Switch the HWA to VAAPI.  I've noticed recently that Sky Lake CPUs are no longer working with Quick Sync.  I'm wondering if support is/was deprecated for that CPU family.

Can you provide a screenshot with the other settings so I can try to copy them? I can't really test this properly since it's happening only for some of the movies/tvshows and I don't want to test each movie with each setting until I get them all working properly.

Thanks!

---

Post the ffmpeg logs.

Code:

/usr/lib/jellyfin-ffmpeg/ffmpeg -analyzeduration 200M -probesize 1G -init_hw_device vaapi=va:,kernel_driver=i915,driver=iHD -init_hw_device qsv=qs@va -filter_hw_device qs -hwaccel vaapi -hwaccel_output_format vaapi -noautorotate -canvas_size 1920x1080 -i file:"/data/movies/Friday (1995)/Friday.1995.Directors.Cut.1080p.Blu-ray.REMUX.VC-1.TrueHD.5.1-playBD.mkv" -noautoscale -map_metadata -1 -map_chapters -1 -threads 0 -map 0:0 -map 0:1 -map -0:0 -codec:v:0 hevc_qsv -tag:v:0 hvc1 -low_power 1 -preset veryfast -b:v 24596534 -maxrate 24596534 -bufsize 49193068 -g:v:0 72 -keyint_min:v:0 72 -filter_complex "[0:4]scale=-1:1080:fast_bilinear,scale,crop,pad=max(1920\,iw):max(1080\,ih):(ow-iw)/2:(oh-ih)/2:black@0,crop=1920:1080,format=bgra,hwupload=derive_device=qsv:extra_hw_frames=64[sub];[0:0]setparams=color_primaries=bt709:color_trc=bt709:colorspace=bt709,scale_vaapi=format=nv12:extra_hw_frames=24,hwmap=derive_device=qsv,format=qsv[main];[main][sub]overlay_qsv=eof_action=pass:repeatlast=0:w=1920:h=1080" -start_at_zero -codec:a:0 libfdk_aac -ac 2 -ab 256000 -copyts -avoid_negative_ts disabled -max_muxing_queue_size 2048 -f hls -max_delay 5000000 -hls_time 3 -hls_segment_type fmp4 -hls_fmp4_init_filename "f14c9ebb1ca2e3624d721bc1c7348d14-1.mp4" -start_number 0 -hls_segment_filename "/cache/transcodes/f14c9ebb1ca2e3624d721bc1c7348d14%d.mp4" -hls_playlist_type vod -hls_list_size 0 -y "/cache/transcodes/f14c9ebb1ca2e3624d721bc1c7348d14.m3u8"


ffmpeg version 6.0.1-Jellyfin Copyright (c) 2000-2023 the FFmpeg developers
  built with gcc 12 (Debian 12.2.0-14)
  configuration: --prefix=/usr/lib/jellyfin-ffmpeg --target-os=linux --extra-version=Jellyfin --disable-doc --disable-ffplay --disable-ptx-compression --disable-static --disable-libxcb --disable-sdl2 --disable-xlib --enable-lto --enable-gpl --enable-version3 --enable-shared --enable-gmp --enable-gnutls --enable-chromaprint --enable-opencl --enable-libdrm --enable-libass --enable-libfreetype --enable-libfribidi --enable-libfontconfig --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libopenmpt --enable-libdav1d --enable-libsvtav1 --enable-libwebp --enable-libvpx --enable-libx264 --enable-libx265 --enable-libzvbi --enable-libzimg --enable-libfdk-aac --arch=amd64 --enable-libshaderc --enable-libplacebo --enable-vulkan --enable-vaapi --enable-amf --enable-libvpl --enable-ffnvcodec --enable-cuda --enable-cuda-llvm --enable-cuvid --enable-nvdec --enable-nvenc
  libavutil      58.  2.100 / 58.  2.100
  libavcodec    60.  3.100 / 60.  3.100
  libavformat    60.  3.100 / 60.  3.100
  libavdevice    60.  1.100 / 60.  1.100
  libavfilter    9.  3.100 /  9.  3.100
  libswscale      7.  1.100 /  7.  1.100
  libswresample  4. 10.100 /  4. 10.100
  libpostproc    57.  1.100 / 57.  1.100
[AVHWDeviceContext @ 0x55dd150e5180] No VA display found for any default device.
Device creation failed: -22.
Failed to set value 'vaapi=va:,kernel_driver=i915,driver=iHD' for option 'init_hw_device': Invalid argument
Error parsing global options: Invalid argument

Thanks!

[TheDreadPirate]

https://en.wikipedia.org/wiki/Intel_Quic...d_encoding

Check all the codecs in the Skylake column of this table (AVC = H264).

Do not check any of the tone mapping boxes or low power boxes.