Accessing my jellyfin server locally from my laptop using the server's hostname

[jellyfinatic]

Hello I have installed Jellyfin on Ubuntu 24.04 where everything seems to be running but I cannot access it from from my laptop on my local network. I have a router that dynamically assigns an IP if the machine is rebooted (I could statically assign if needed but I don't think it's needed). Ideally, I would like to access from my laptop by providing the http(s)/hostname:<port>. Firewalls are disabled on server currently.

My question, is there a configuration setting in jellyfin to allow me to access from: hostname:<port>. I was not able to find documentation on that.

Thank you in advance.