External connections with VPN

[SuperJ876]

Hi everyone, my setup is as follows:

• Jellyfin running on a Win10 desktop with 16TB of storage attached to my local network. 
  
• DuckDNS subdomain points at a Caddy instance to enable external connections without simply handing out my IP and opening ports. 
  
• I use a VPN to semi-anonymize myself online including downloading things. 
  
  

Whenever the VPN is on, the external connections don't seem to work. I can still access the server on my own network by using my local address rather than the dedicated domain. I tried setting up tunneling on my VPN's settings but that doesn't seem to work consistently. Is there anything I can do to allow myself to still upload/download files behind the VPN while users are accessing the service from outside the local network?