Can't access Windows 10 Jellyfin server from Windows 10 client.

[theguymadmax]

I'm trying to access the server through Firefox by typing the IP address followed by ":8096"

Local or public IP? Local will be something like 192.168.1.10. If you're accessing it using the remote ip, you would also need to configure port forwarding on the router.