Setting up a reverse proxy with Caddy

[bigggtuna]

I tried setting up a reverse proxy with Caddy and somethings not working and I'm not sure where the issue is. Here are my steps so far:

1. Bought the domain
   
2. Created an A DNS record pointing to the public IP of my router (apple airport extreme) on the domain registrar settings
   
3. Forwarded both ports 443 and 80 to my servers LAN IP in router settings (do I need 80?)
   
4. Installed Caddy on the same device as Jellyfin and created a Caddyfile like
   

mydomain.com {
encode gzip
reverse_proxy localhost:8096
}

1. Started Caddy and went to my domain
   

And all I get is a blank white page and the tab is named 'this website is under development'. I've also tried to follow this tutorial using No-IP but it doesn't work either.
The ports 443 and 80 are not blocked by firewall on my server. I'm not sure what else to look for. I can't tell where Caddy logs are, the /var/logs/caddy/ folder is empty.