Tonemapping makes native HDR playback look grayish

[Saturng2005]

I've been ripping a lot of 4k Blu-Rays recently to my JellyFin so I can watch it on the go, but my internet's bandwidth usually can't handle the bitrate of them, since most of the 4k Blu-Rays are 50+/Mbps Vs. my provider's 40-ish/Mbps. Because of this, I enabled tonemapping because so it looks right when playing back.

But the problem is, some of these 4k Blu-Rays are just barely within my internet's limit. Problem is, for whatever reason when tonemapping is enabled the native HDR playback is suddenly grayed, like an HDR to SDR video would be if tonemapping is disabled. I'm not sure what to do about this, if there is anything that can be done other than lowering the bitrate so that the video starts to transcode

The problem goes away for native HDR content if I turn off tonemapping for transcoding, but then when I need to transcode 4k Blu-Rays the transcoded video looks grayed out, which makes sense

To clarify, I am playing these videos on an HDR capable screen, so it's not a screen problem haha

My setup is:
OS - OMV7
JellyFin Docker Version - 10.10.7
CPU - Intel i9 12900k
GPU - NVidia T1000 <-- GPU is what I use for hardware transcoding
RAM: 32GB DDR5

Here's what the HDR video looks like playing in the JMP Client natively with tonemapping on (Weird and grayed out):


And here's what it looks like when it's trancoding HDR to SDR with in the JMP Client with tonemapping on (What it should look like):