Hardware Acceleration

[TheDreadPirate]

What CPU/GPU do you have?

[LAB77]

Graphics:

• description: VGA compatible controller
  
• product: HD Graphics 530 [8086:1912]
  
• vendor: Intel Corporation [8086]
  

CPU:

• Intel® Core™ i5-6500 CPU @ 3.20GHz
  

[TheDreadPirate]

Can you describe your setup? Is there any virtualization besides docker? You said Ubuntu but is Ubuntu a VM? Did you install all the Intel drivers on Ubuntu?

[Efficient_Good_5784]

Graphics:

• description: VGA compatible controller
  
• product: HD Graphics 530 [8086:1912]
  
• vendor: Intel Corporation [8086]
  

CPU:

• Intel® Core™ i5-6500 CPU @ 3.20GHz
  

That's your problem, your CPU is too old for what you're trying to transcode.

From your attached logs, I see this is what you're trying to transcode: "GalaxyRG265 - Video.1.x265.10bit-GalaxyRG265"
Your CPU's iGPU doesn't support HEVC 10-bit transcoding.

Check Intel's website to see which generation the i5-6500 is from.

Then use this table to look up what codecs your CPU's iGPU can handle.

Doing the work for you from the codecs presented in Jellyfin's QSV playback settings... 
The following codecs should be enabled:

1. H264
   
2. HEVC
   
3. MPEG2
   
4. VC1
   
5. VP8
   

The following codecs should be disabled:

1. VP9
   
2. AV1
   
3. HEVC 10bit
   
4. VP9 10bit
   

If you want to upgrade, then according to the wikipedia QSV table, the oldest Intel CPU that can handle HEVC 10-bit will be a 7th gen Intel CPU.

[TheDreadPirate]

Good catch. I completely missed the 10-bitness of the video.

[LAB77]

Ah ha!
Thanks for all your help!