Jellyfin Forum
transcoding HDR broken? - Printable Version

+- Jellyfin Forum (https://forum.jellyfin.org)
+-- Forum: Support (https://forum.jellyfin.org/f-support)
+--- Forum: Troubleshooting (https://forum.jellyfin.org/f-troubleshooting)
+--- Thread: transcoding HDR broken? (/t-transcoding-hdr-broken)



transcoding HDR broken? - Fidel - 2025-09-14

so, essentially i just wanted some help. i just upgraded to an intel core ultra 5 225 and its working amazing compared to what i previously had, really happy with it other than the fact that transcoding HDR content always seems to fail. i have quicksync enabled for hardware acceleration and it works great for sdr-sdr but HDR content for some reason doesnt work.if i only have VPP enabled it works for about 3 seconds and then seems to quit the transcode for no reason, and if both VPP and tone mapping are enabled it doesnt work at all. ill post the logs i get for both scenarios below:

VPP AND tone Mapping enabled:

/usr/lib/jellyfin-ffmpeg/ffmpeg -analyzeduration 200M -probesize 1G -f matroska -init_hw_device vaapi=va:,vendor_id=0x8086,driver=iHD -init_hw_device qsv=qs@va -init_hw_device opencl=ocl@va -filter_hw_device qs -hwaccel vaapi -hwaccel_output_format vaapi -noautorotate -i file:"/media/nas/NewVolume4/Jellyfin/Shows 4/Dexter - Resurrection/Season 01/Dexter Resurrection S01E08 The Kill Room Where It Happens 2160p ATV WEB-DL DDP5 1 Atmos DV HDR H 265-FLUX.mkv" -noautoscale -map_metadata -1 -map_chapters -1 -threads 0 -map 0:0 -map 0:1 -map -0:s -codec:v:0 h264_qsv -preset veryfast -b:v 41525278 -maxrate 41525278 -bufsize 83050556 -profile:v:0 high -level 41 -g:v:0 72 -keyint_min:v:0 72 -vf "setparams=color_primaries=bt2020:color_trc=smpte2084:colorspace=bt2020nc,procamp_vaapi=b=16,tonemap_vaapi=format=nv12:p=bt709:t=bt709:m=bt709:extra_hw_frames=32,hwmap=derive_device=qsv,format=qsv" -codec:a:0 libfdk_aac -ac 2 -ab 256000 -af "volume=2" -copyts -avoid_negative_ts disabled -max_muxing_queue_size 2048 -f hls -max_delay 5000000 -hls_time 3 -hls_segment_type fmp4 -hls_fmp4_init_filename "433164016dcf043e584459b3a8dc1066-1.mp4" -start_number 0 -hls_segment_filename "/var/cache/jellyfin/transcodes/433164016dcf043e584459b3a8dc1066%d.mp4" -hls_playlist_type vod -hls_list_size 0 -y "/var/cache/jellyfin/transcodes/433164016dcf043e584459b3a8dc1066.m3u8"


ffmpeg version 7.1.1-Jellyfin Copyright © 2000-2025 the FFmpeg developers
  built with gcc 13 (Ubuntu 13.3.0-6ubuntu2~24.04)
  configuration: --prefix=/usr/lib/jellyfin-ffmpeg --target-os=linux --extra-version=Jellyfin --disable-doc --disable-ffplay --disable-static --disable-libxcb --disable-sdl2 --disable-xlib --enable-lto=auto --enable-gpl --enable-version3 --enable-shared --enable-gmp --enable-gnutls --enable-chromaprint --enable-opencl --enable-libdrm --enable-libxml2 --enable-libass --enable-libfreetype --enable-libfribidi --enable-libfontconfig --enable-libharfbuzz --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libopenmpt --enable-libdav1d --enable-libsvtav1 --enable-libwebp --enable-libvpx --enable-libx264 --enable-libx265 --enable-libzvbi --enable-libzimg --enable-libfdk-aac --arch=amd64 --enable-libshaderc --enable-libplacebo --enable-vulkan --enable-vaapi --enable-amf --enable-libvpl --enable-ffnvcodec --enable-cuda --enable-cuda-llvm --enable-cuvid --enable-nvdec --enable-nvenc
  libavutil      59. 39.100 / 59. 39.100
  libavcodec    61. 19.101 / 61. 19.101
  libavformat    61.  7.100 / 61.  7.100
  libavdevice    61.  3.100 / 61.  3.100
  libavfilter    10.  4.100 / 10.  4.100
  libswscale      8.  3.100 /  8.  3.100
  libswresample  5.  3.100 /  5.  3.100
  libpostproc    58.  3.100 / 58.  3.100
libva info: VA-API version 1.22.0
libva info: Trying to open /usr/lib/jellyfin-ffmpeg/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
libva info: VA-API version 1.22.0
libva info: Trying to open /usr/lib/jellyfin-ffmpeg/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
[AVHWDeviceContext @ 0x622ffd2c1280] Failed to get number of OpenCL platforms: -1001.
Device creation failed: -19.
Failed to set value 'opencl=ocl@va' for option 'init_hw_device': No such device
Error parsing global options: No such device

With Just VPP enabled: 
ffmpeg version 7.1.1-Jellyfin Copyright © 2000-2025 the FFmpeg developers
  built with gcc 13 (Ubuntu 13.3.0-6ubuntu2~24.04)
  configuration: --prefix=/usr/lib/jellyfin-ffmpeg --target-os=linux --extra-version=Jellyfin --disable-doc --disable-ffplay --disable-static --disable-libxcb --disable-sdl2 --disable-xlib --enable-lto=auto --enable-gpl --enable-version3 --enable-shared --enable-gmp --enable-gnutls --enable-chromaprint --enable-opencl --enable-libdrm --enable-libxml2 --enable-libass --enable-libfreetype --enable-libfribidi --enable-libfontconfig --enable-libharfbuzz --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libopenmpt --enable-libdav1d --enable-libsvtav1 --enable-libwebp --enable-libvpx --enable-libx264 --enable-libx265 --enable-libzvbi --enable-libzimg --enable-libfdk-aac --arch=amd64 --enable-libshaderc --enable-libplacebo --enable-vulkan --enable-vaapi --enable-amf --enable-libvpl --enable-ffnvcodec --enable-cuda --enable-cuda-llvm --enable-cuvid --enable-nvdec --enable-nvenc
  libavutil      59. 39.100 / 59. 39.100
  libavcodec    61. 19.101 / 61. 19.101
  libavformat    61.  7.100 / 61.  7.100
  libavdevice    61.  3.100 / 61.  3.100
  libavfilter    10.  4.100 / 10.  4.100
  libswscale      8.  3.100 /  8.  3.100
  libswresample  5.  3.100 /  5.  3.100
  libpostproc    58.  3.100 / 58.  3.100
libva info: VA-API version 1.22.0
libva info: Trying to open /usr/lib/jellyfin-ffmpeg/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
libva info: VA-API version 1.22.0
libva info: Trying to open /usr/lib/jellyfin-ffmpeg/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
Input #0, matroska,webm, from 'fileConfused-facemedia/nas/NewVolume4/Jellyfin/Shows 4/Dexter - Resurrection/Season 01/Dexter Resurrection S01E08 The Kill Room Where It Happens 2160p ATV WEB-DL DDP5 1 Atmos DV HDR H 265-FLUX.mkv':
  Metadata:
    encoder        : libebml v1.4.5 + libmatroska v1.7.1
  Duration: 00:45:04.74, start: 0.000000, bitrate: 24915 kb/s
  Chapters:
    Chapter #0:0: start 0.000000, end 10.000000
      Metadata:
        title          : Scene 1
    Chapter #0:1: start 10.000000, end 92.000000
      Metadata:
        title          : Recap
    Chapter #0:2: start 92.000000, end 2637.000000
      Metadata:
        title          : Scene 2
    Chapter #0:3: start 2637.000000, end 2704.744000
      Metadata:
        title          : Credits
  Stream #0:0: Video: hevc (Main 10), yuv420p10le(tv, bt2020nc/bt2020/smpte2084), 3840x1606 [SAR 1:1 DAR 1920:803], 23.98 fps, 23.98 tbr, 1k tbn (default) (original)
      Metadata:
        BPS            : 24144643
        DURATION        : 00:45:04.744000000
        NUMBER_OF_FRAMES: 64849
        NUMBER_OF_BYTES : 8163135051
        _STATISTICS_WRITING_APP: mkvmerge v94.0 ('Initiate') 64-bit
        _STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
      Side data:
        DOVI configuration record: version: 1.0, profile: 8, level: 6, rpu flag: 1, el flag: 0, bl flag: 1, compatibility id: 1, compression: 0
  Stream #0:1(eng): Audio: eac3 (Dolby Digital Plus + Dolby Atmos), 48000 Hz, 5.1(side), fltp, 768 kb/s (default) (original)
      Metadata:
        BPS            : 768000
        DURATION        : 00:45:04.704000000
        NUMBER_OF_FRAMES: 84522
        NUMBER_OF_BYTES : 259651584
        _STATISTICS_WRITING_APP: mkvmerge v94.0 ('Initiate') 64-bit
        _STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
  Stream #0:2(eng): Subtitle: subrip (srt) (original)
      Metadata:
        BPS            : 81
        DURATION        : 00:43:34.445000000
        NUMBER_OF_FRAMES: 873
        NUMBER_OF_BYTES : 26592
        _STATISTICS_WRITING_APP: mkvmerge v94.0 ('Initiate') 64-bit
        _STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
  Stream #0:3(eng): Subtitle: subrip (srt) (original) (hearing impaired)
      Metadata:
        title          : SDH
        BPS            : 87
        DURATION        : 00:43:34.445000000
        NUMBER_OF_FRAMES: 925
        NUMBER_OF_BYTES : 28540
        _STATISTICS_WRITING_APP: mkvmerge v94.0 ('Initiate') 64-bit
        _STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
Stream mapping:
  Stream #0:0 -> #0:0 (hevc (native) -> h264 (h264_qsv))
  Stream #0:1 -> #0:1 (eac3 (native) -> aac (libfdk_aac))
Press [q] to stop, [?] for help
[hls @ 0x559e39c19600] Opening '/var/cache/jellyfin/transcodes/066498a601fa3a8b0a3f38c2d00a3dbd-1.mp4' for writing
Output #0, hls, to '/var/cache/jellyfin/transcodes/066498a601fa3a8b0a3f38c2d00a3dbd.m3u8':
  Metadata:
    encoder        : Lavf61.7.100
  Stream #0:0: Video: h264, qsv(tv, bt709, progressive), 3840x1606 [SAR 1:1 DAR 1920:803], q=2-31, 41525 kb/s, 23.98 fps, 24k tbn (default) (original)
      Metadata:
        encoder        : Lavc61.19.101 h264_qsv
      Side data:
        cpb: bitrate max/min/avg: 41525278/0/41525278 buffer size: 83050556 vbv_delay: N/A
  Stream #0:1: Audio: aac, 48000 Hz, stereo, s16, 256 kb/s (default) (original)
      Metadata:
        encoder        : Lavc61.19.101 libfdk_aac
      Side data:
        cpb: bitrate max/min/avg: 256000/256000/256000 buffer size: 0 vbv_delay: N/A
frame=  53 fps=0.0 q=14.0 size=N/A time=00:00:00.00 bitrate=N/A speed=  0x   
[hls @ 0x559e39c19600] Opening '/var/cache/jellyfin/transcodes/066498a601fa3a8b0a3f38c2d00a3dbd5.mp4' for writing


[q] command received. Exiting.

[hls @ 0x559e39c19600] Opening '/var/cache/jellyfin/transcodes/066498a601fa3a8b0a3f38c2d00a3dbd6.mp4' for writing
[hls @ 0x559e39c19600] Opening '/var/cache/jellyfin/transcodes/066498a601fa3a8b0a3f38c2d00a3dbd7.mp4' for writing
[out#0/hls @ 0x559e39bccd00] video:34683KiB audio:235KiB subtitle:0KiB other streams:0KiB global headers:0KiB muxing overhead: unknown
frame=  176 fps=146 q=19.0 Lsize=N/A time=00:00:05.13 bitrate=N/A dup=1 drop=0 speed=4.27x    

im a bit new to linux as a whole so im installed on ubuntu and not in docker. 

Server version
10.10.7
Web version
10.10.7 (f4b8aa0ed)
Build version
10.10.7

any help is greatly appreciated