Issue Transcoding in Jellyfin LXC on Proxmox: Driver Does Not Support VBR RC Mode

[Jumper72]

Hello Jellyfin Community,
I am experiencing an issue with FFmpeg transcoding in Jellyfin running on a Proxmox LXC. The error message is as follows:

[h264_vaapi @ 0x55659fbec280] Driver does not support VBR RC mode (supported modes: CQP).
Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height

[h264_qsv @ 0x55f73a2e9c40] Selected ratecontrol mode is unsupported
[h264_qsv @ 0x55f73a2e9c40] some encoding parameters are not supported by the QSV runtime. Please double check the input parameters.
Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height
[libfdk_aac @ 0x55f73a270ec0] 2 frames left in the queue on closing
Conversion failed!

System Details:

• Jellyfin Version:
  Jellyfin.Server 10.8.13.0
  
• System: Proxmox LXC
  
• Kernel:
  Linux jellyfin 6.5.11-7-pve #1 SMP PREEMPT_DYNAMIC PMX 6.5.11-7 (2023-12-05T09:44Z) x86_64 x86_64 x86_64 GNU/Linux
  
• Kernel Parameters:
  BOOT_IMAGE=/boot/vmlinuz-6.5.11-7-pve root=/dev/mapper/pve-root ro quiet intel_iommu-on iommu=pt
  
• CPU: Intel® Core™ i7-10710U CPU @ 1.10GHz
  

I have not made any manual changes to the default Jellyfin transcoding settings.

Format of file that is having issue (if this is relevant)
Video
Title: 1080p HEVC SDR
Codec: HEVC
Profile: Main 10
Level: 120
Resolution: 1920x804
Aspect ratio: 2.40:1
Interlaced: No
Framerate: 23.976025
Bitrate: 9189 kbps
Bit depth: 10 bit
Video range: SDR
Video range type: SDR
Pixel format: yuv420p10le
Ref frames: 1

The issue seems to arise during playback of certain media types. I would appreciate any insights or suggestions on how to resolve this error, particularly regarding the VBR RC mode and potential parameter adjustments in FFmpeg transcoding settings. Also with getting QSV working as i heard its more efficient?
Thank you!

[tmsrxzar]

https://www.reddit.com/r/jellyfin/commen...in_docker/

[Jumper72]

I tried making those changes, rebooted but im still getting these errors

[h264_qsv @ 0x55d12a2e5c40] Selected ratecontrol mode is unsupported
[h264_qsv @ 0x55d12a2e5c40] some encoding parameters are not supported by the QSV runtime. Please double check the input parameters.
Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height
[libfdk_aac @ 0x55d12a26cec0] 2 frames left in the queue on closing


[h264_vaapi @ 0x5577c615b200] Driver does not support VBR RC mode (supported modes: CQP).
Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height
[libfdk_aac @ 0x5577c614ea00] 2 frames left in the queue on closing

[TheDreadPirate]

But do they prevent the transcode from happening? Is this a privileged or unprivileged container?

[Jumper72]

I solved this by disabling low power decoding. It is working with Intel QSV Now