Jellyfin freezing my pi4b

[CacheToWin]

I have recently changed from Plex to jellyfin because I didn't like it anymore.

Jellyfin really has been a blast but for some reason my pi sometimes completely freezes and I need to reboot it before it works again.

First idea was high temperature but I made a temp log script that looks completely fine (end of post).

I did notice when I would open jellyfin on phone. Close it and later (10-15min) watch on tv the pi would have alot of usage. When Running top I would have multiple jellyfin processes running. My guess is that for some reason a couple of apps keep running in the background and my pi just can't handle it and freezes. 

Any idea what I could do/test? Or how I can make sure the instance from tv etc is completely 'dead'.

Info:
Jellyfin running inside container on portainer (along side other containers).
Version: 10.10.4 
Jellyfin resources are already limited with portainer. Just added ram to it.
Log file of temp in c
Time, temp in c
22:46:01,40.9
22:47:01,40.9
22:48:01,40.9
22:49:01,40.4
22:59:43,38.9
22:59:43,39.4
22:59:43,37.9
22:59:43,38.4