is it enough to use caddy and your own domain name for more security ?

[Drake97]

I have a doubt, I currently have jellyfin running on a pc with ubuntu desktop, I go out to the internet with caddy proxing to my jellyfin service through port 8096 and in my router I have open the tcp ports 80 and 443 for HTTP and HTTPS respectively.
When I enter the url of my domain, it redirects directly to jellyfin, all ok with that, but my question is the following:
Is that enough ? can someone who has that URL and has some computer knowledge, get into my physical server via SSH for example ? I hope you can understand me and not to be paranoid or anything haha, I'm just curious.

Thanks and greetings.