Upgrading would be the only way to get it faster than what you're seeing now. And even then, it isn't THAT much faster. 2-3 seconds faster at 3-5X the cost of your N100 system.
Jellyfin 10.10.5 (Docker)
Ubuntu 24.04 LTS
Intel i3 12100
Intel Arc A380
OS drive - SK Hynix P41 1TB
Storage
3x WD Red Pro 6TB CMR in RAIDZ1 (JF Library)