I feel like I've wasted my time with jellyfin

[bitmap]

Isn't casting dependent upon being on the same network as the device in question? If your phone is on the tailscale network, while the Chromecast is not, it's not gonna work. That's not a Jellyfin issue, that's a networking problem. Why not go with a reverse proxy, which should allow you to do what you're hoping for?