Strange Stuttering on Specific MKV's

[yob]

Hello everyone!
I am new to media hosting and got my jellyfin server up and running about a week ago now. It's been great! I get awesome performance, everything loads almost instantly remotely apart from the occasional 4k movie. I have however been having some strange issues with some specific MKV files for a TV series. I select an episode and it plays instantly - however as soon as it starts playing it just stutters like crazy constantly feezing frames. The audio never actually stops and the video continues playing as if theres nothing wrong - it is not buffering since I can see it quickly loads the first few minutes right away. Whats strange is when I skip forward even 1 second or backwards 1 second the stuttering instantly stops. It only happens with these 6 MKVs from a particular dump. They are 1080p H.264 media files - only about 15-25 minutes long. Each one does it except for the ones from alternative sources. Is this possibly related to some sort of corrupted data in them or issue with the codec? Anyone experience this before and know a workaround, or some simple setting? 

Preface I use hardware encoding/decoding/transcoding. The system has a Ryzen 5 6600H, 16gb DDR5, Radeon 660M with 3gb of VRAM allocated to it, 2x 2TB NVMe drives, dual gigabit ethernet ports, and is running Linux Mint Debian Edition. Its very odd. None of my other media files act this way. It's too bad because I don't think I'll be able to get them from another source without buying digital copies again.

Any advice on settings to run or advice +/ commands to debug these types of issues would be greatly appreciated! Thanks!!!

[bitmap]

A quick mediainfo or ffprobe might help. Do you know if these files are remuxing or if audio is transcoding during playback?

I have seen this before but only from sources I have personally encoded using HWA and downscaling from 4K. It was definitely the encoding that was a problem, despite it matching other files that played perfectly fine.