SOLVED: Problem with hardware encoding in Docker

[auxin7]

I set up a new homeserver with openmediavault running 7.7.1-3 (Sandworm) on the Linux 6.12.12+bpo-amd64 kernel and using an Intel i5 14400 which supports QSV (https://www.intel.com/content/www/us/en/...tions.html), and then using portainer to set up jellyfin.

I am using the standart docker compose file

Code:

services:
  jellyfin:
    image: jellyfin/jellyfin
    user: 1000:1000
    group_add:
      - "105" # Change this to match your "render" host group id and remove this comment
    network_mode: 'host'
    volumes:
      - /path/to/config:/config
      - /path/to/cache:/cache
      - /path/to/media:/media
    devices:
      - /dev/dri/renderD128:/dev/dri/renderD128

changing the render group to "105" since this is the output of " getent group render | cut -d: -f3 ".

Checking the output of vainfo within the docker givs this error:

Code:

Trying display: drm[/color]
[color=#bfc7d5]libva info: VA-API version 1.22.0[/color]
[color=#bfc7d5]libva info: Trying to open /usr/lib/jellyfin-ffmpeg/lib/dri/iHD_drv_video.so[/color]
[color=#bfc7d5]libva info: Found init function __vaDriverInit_1_22[/color]
[color=#bfc7d5]libva error: /usr/lib/jellyfin-ffmpeg/lib/dri/iHD_drv_video.so init failed[/color]
[color=#bfc7d5]libva info: va_openDriver() returns 1[/color]
[color=#bfc7d5]libva info: Trying to open /usr/lib/jellyfin-ffmpeg/lib/dri/i965_drv_video.so[/color]
[color=#bfc7d5]libva info: Found init function __vaDriverInit_1_22[/color]
[color=#bfc7d5]libva error: /usr/lib/jellyfin-ffmpeg/lib/dri/i965_drv_video.so init failed[/color]
[color=#bfc7d5]libva info: va_openDriver() returns -1[/color]
[color=#bfc7d5]vaInitialize failed with error code -1 (unknown libva error),exit[/color]
[color=#bfc7d5]

while

Code:

docker exec -it jellyfin /usr/lib/jellyfin-ffmpeg/ffmpeg -v verbose -init_hw_device vaapi=va -init_hw_device opencl@va[/color]
[color=#bfc7d5]ffmpeg version 7.0.2-Jellyfin Copyright (c) 2000-2024 the FFmpeg developers[/color]
[color=#bfc7d5]  built with gcc 12 (Debian 12.2.0-14)[/color]
[color=#bfc7d5]  configuration: --prefix=/usr/lib/jellyfin-ffmpeg --target-os=linux --extra-version=Jellyfin --disable-doc --disable-ffplay --disable-ptx-compression --disable-static --disable-libxcb --disable-sdl2 --disable-xlib --enable-lto=auto --enable-gpl --enable-version3 --enable-shared --enable-gmp --enable-gnutls --enable-chromaprint --enable-opencl --enable-libdrm --enable-libxml2 --enable-libass --enable-libfreetype --enable-libfribidi --enable-libfontconfig --enable-libharfbuzz --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libopenmpt --enable-libdav1d --enable-libsvtav1 --enable-libwebp --enable-libvpx --enable-libx264 --enable-libx265 --enable-libzvbi --enable-libzimg --enable-libfdk-aac --arch=amd64 --enable-libshaderc --enable-libplacebo --enable-vulkan --enable-vaapi --enable-amf --enable-libvpl --enable-ffnvcodec --enable-cuda --enable-cuda-llvm --enable-cuvid --enable-nvdec --enable-nvenc[/color]
[color=#bfc7d5]  libavutil      59.  8.100 / 59.  8.100[/color]
[color=#bfc7d5]  libavcodec    61.  3.100 / 61.  3.100[/color]
[color=#bfc7d5]  libavformat    61.  1.100 / 61.  1.100[/color]
[color=#bfc7d5]  libavdevice    61.  1.100 / 61.  1.100[/color]
[color=#bfc7d5]  libavfilter    10.  1.100 / 10.  1.100[/color]
[color=#bfc7d5]  libswscale      8.  1.100 /  8.  1.100[/color]
[color=#bfc7d5]  libswresample  5.  1.100 /  5.  1.100[/color]
[color=#bfc7d5]  libpostproc    58.  1.100 / 58.  1.100[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] Trying to use DRM render node for device 0.[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] libva: VA-API version 1.22.0[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] libva: Trying to open /usr/lib/jellyfin-ffmpeg/lib/dri/iHD_drv_video.so[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] libva: Found init function __vaDriverInit_1_22[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] libva: /usr/lib/jellyfin-ffmpeg/lib/dri/iHD_drv_video.so init failed[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] libva: va_openDriver() returns 1[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] libva: Trying to open /usr/lib/jellyfin-ffmpeg/lib/dri/i965_drv_video.so[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] libva: Found init function __vaDriverInit_1_22[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] libva: /usr/lib/jellyfin-ffmpeg/lib/dri/i965_drv_video.so init failed[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] libva: va_openDriver() returns -1[/color]
[color=#bfc7d5][AVHWDeviceContext @ 0x56039da15640] Failed to initialise VAAPI connection: -1 (unknown libva error).[/color]
[color=#bfc7d5]Device creation failed: -5.[/color]
[color=#bfc7d5]Failed to set value 'vaapi=va' for option 'init_hw_device': Input/output error[/color]
[color=#bfc7d5]Error parsing global options: Input/output error[/color]
[color=#bfc7d5]

results in this error.

Now I am quite stuck, hope some of you can help me. Software encoding works, but is quite expensive....