Transcoding Troubleshooting

[Rbolduc625]

Let me preface this with saying I'm somewhat of a LINUX noob, so if you tell me something super technical I'm probably not going to understand it without explanation. I'm sorry about that.

But I'm having some transcoding issues (I think) with Jellyfin. I have a TV that's Dolby Vision capable, and a computer monitor that is not HDR.
I can watch HDR10 and non HDR movies totally fine on my TV. I can watch both on my monitor, but HDR is washed out because tonemapping may be my issue, I'm not sure.

2 problems I'm running into. The tonemapping issue on my monitor while watching HDR movies, and Dolby Vision streaming to my TV comes out SUPER red. Whenever there's any red in the scene, the entire screen has a red hue.

When I start jellyfin in terminal, this spits out and I'm thinking this is a big issue when it comes to these two things.
Also is included a screenshot of the settings in Jellyfin but I think i got those right.

Anybody run into this and know a way to fix the issue. I'm guessing it's probably simple but it's something I'm not thinking about.

I'm running Endeavor OS (arch) and running the official repository version of Jellyfin-web and jellyfin-server, currently 10.9. I have an NVIDIA 4070.

Thank you!!!

[TheDreadPirate]

Are you using jellyfin-ffmpeg or vanilla ffmpeg?

Our Nvidia docs for Arch are here.

https://jellyfin.org/docs/general/admini...arch-linux

[Rbolduc625]

I do have the jellyfin-ffmpeg installed as well as the nvidia-utils. i can run nvidia-smi but how do i know what to uncheck?

I did notice that I re-installed nvidia-utils but it did not ask me to install the nvenc nvdec dependencies

[TheDreadPirate]

Nvidia has this handy chart.

https://developer.nvidia.com/video-encod...matrix-new

Can you list out all the nvidia/nvenc packages you have installed?

[Rbolduc625]

OH perfect. So based on 4070 I keep everything checked.

the nvidia packages I see are:

nvidia560.35.03-2 (official repo)
nvidia-hook 1.5.1-1 (Endeavour Repo)
nvidia-inst 24-1 (Endeavour Repo)
nvidia-lts 560.35.03-2 (official repo)
nvidia-settings 560.35.03-1 (official repo)
nvidia-utils 560.35.03-2 (official reop)

I searched for NVENC and didn't find anything. I do see NVENC package available on AUR, should I install that one?

Also, thank you already for the help! It's very appreciated

I did notice that nvidia-smi says I'm using ffmpeg when transcoding but the path wont' let me alter it in jellyfin to make sure i'm using the jellyfin-ffmpeg. It just says FFMPEG, which clearly isn't a path. And I can't find documentation to show what to do or why it won't let me change it.
   
correction: I did find something on the jellyfin documentation showing that nvidia-smi should show the path to the jellyfin-ffmpeg which it is not. I'm hoping this is the thing that will solve my problem if i can fix that path.

EDIT: So I copied the ffmpeg file from usr/lib/jellyfin-ffmpeg to usr/bin and replaced the ffmpeg file there and that fixed my hdr to sdr transcoding (I have the original ffmpeg file that was in there in case this was a stupid thing to do). No more washed out colors on sdr screen while watching hdr videos.

I was hoping that would fix the redness problem on Dolby Vision files streamed to my Dolby Vision TV but no dice. So it's just that issue I have left.