SOLVED: Cannot hardware transcode HVEC HDR

[punksinatra]

General Info:

• Jellyfin 10.8.13
  
• Jellyfin Linux Docker using linuxserver.io
  
• Server specs i5-8500T, 16GB Ram, Debian 11
  

Issue: Getting "Playback Error. This client isn't compatible with the media and the server isn't sending a compatible media format" when trying to hardware transcode hvec hdr videos.

Devices (all of which cannot playback HVEC HDR videos): 

• PC using chrome, firefox, edge
  
• Android phone
  
• Xioami P1 55 TV using jellyfin app
  

More Information:

• Videos playback when I disable hardware acceleration
  
• HVEC SDR playback has no issues either hardware acceleration on or off
  
• Tried both Intel Quicksync and VAAPI same issue
  
• Confirmed transcoding works on all other type of videos
  
• Confirmed direct play for HVEC other than HVEC HDR works on devices that support it like Microsoft Edge
  

Docker compose

version: "2.1"
services:
  jellyfin:
    image: lscr.io/linuxserver/jellyfin
    container_name: jellyfin
    environment:
      - PUID=1000
      - PGID=100
      - TZ=Asia/Singapore
    group_add:
      - "107" # This is the render group
    volumes:
      - /srv/dev-disk-by-uuid-6f410b69-e75d-4861-bc4f-7f231fbb8bbb/Dockers/jellyfinconfig
      - /srv/dev-disk-by-uuid-062dc380-9c19-46c5-85ff-946da5b25980/TVdata/tvshows
      - /srv/dev-disk-by-uuid-062dc380-9c19-46c5-85ff-946da5b25980/Moviesdata/movies
      - /srv/dev-disk-by-uuid-062dc380-9c19-46c5-85ff-946da5b25980/Animedata/anime
      - /dev/shmtranscodes
    devices:
      - /dev/dridev/dri
      - /dev/dri/renderD128dev/dri/renderD128
      - /dev/dri/card0dev/dri/card0
    ports:
      - 8096:8096
      #- 8920:8920 #optional for secure connections
      #- 8920:8920 #optional
      #- 7359:7359/udp #optional
      #- 1900:1900/udp #optional
    restart: unless-stopped
    #privileged: true

ls -la /dev/dri/renderD128 and ls -lan /dev/dri/renderD128:

host

root@putanginamousr/lib# ls -la /dev/dri/renderD128
crw-rw---- 1 root render 226, 128 Jan  4 13:27 /dev/dri/renderD128
root@putanginamousr/lib# ls -lan /dev/dri/renderD128
crw-rw---- 1 0 107 226, 128 Jan  4 13:27 /dev/dri/renderD128

container (I don't know why the container shows " videoOeKngkeg" instead of render group number)

root@087fbc07aa05:~# ls -la /dev/dri/renderD128
crw-rw---- 1 root videoOeKngkeg 226, 128 Jan 25 12:53 /dev/dri/renderD128
root@087fbc07aa05:~# ls -lan /dev/dri/renderD128
crw-rw---- 1 0 107 226, 128 Jan 25 12:53 /dev/dri/renderD128

Logs:

4k HVEC SDR log: HVEC SDR Log with transcoding
4k HVEC HDR log: HVEC HDR log