Unfortunately, I've never seen that error. VAAPI should work on pre-broadwell systems so I'm not sure why it isn't. QSV on pre-broadwell in Linux is deprecated, though.
Jellyfin 10.10.6 (Docker)
Ubuntu 24.04 LTS
Intel i3 12100
Intel Arc A380
OS drive - SK Hynix P41 1TB
Storage
3x WD Red Pro 6TB CMR in RAIDZ1 (JF Library)