SOLVED: HWA AMD VAAPI Stuttering

SOLVED: HWA AMD VAAPI Stuttering - Printable Version

+- Jellyfin Forum (https://forum.jellyfin.org)
+-- Forum: Support (https://forum.jellyfin.org/f-support)
+--- Forum: Troubleshooting (https://forum.jellyfin.org/f-troubleshooting)
+--- Thread: SOLVED: HWA AMD VAAPI Stuttering (/t-solved-hwa-amd-vaapi-stuttering)

HWA AMD VAAPI Stuttering - floppy - 2023-09-06

I have this weird stuttering that only happens on select media, I've not been able to pin point what actually differs from the media, I've attached some transcode log example and the stuttering result.

The only thing I can see that differs is the bad transcode input stream uses bt709

I'm using an RX580 with VAAPI in the latest linuxserver docker image

Bad Transcode:
.txt

stuttertranscode.txt (Size: 70.44 KB / Downloads: 44)
Good Transcode:
.txt

goodtranscode.txt (Size: 33.93 KB / Downloads: 40)

Vainfo:
.txt

vainfo.txt (Size: 1.5 KB / Downloads: 58)
OpenCL:
.txt

opencl.txt (Size: 2.05 KB / Downloads: 44)
Vulcan
.txt

vulcan.txt (Size: 3.83 KB / Downloads: 34)

I can't upload an example video so hopefully a discord link will be okay Smiling-face

https://cdn.discordapp.com/attachments/388074026834067456/1148691332051767336/bad.mp4
https://streamable.com/za5c7g

RE: HWA AMD VAAPI Stuttering - bitmap - 2023-09-06

Quick look? This right here:

Code:
-filter_complex "[0:3]scale=s=1920x1080:flags=fast_bilinear[sub];[0:0]setparams=color_primaries=bt709:color_trc=bt709:colorspace=bt709,scale_vaapi=format=nv12:extra_hw_frames=24,hwdownload,format=nv12[main];[main][sub]overlay=eof_action=pass:shortest=1:repeatlast=0,hwupload_vaapi"

You have more complex subs being burned in through a complex filter and the video is being scaled in the stuttering transcode. I'll look more in-depth in a bit when I have time...

RE: HWA AMD VAAPI Stuttering - floppy - 2023-09-06

(2023-09-06, 05:37 PM)bitmap Wrote: Quick look? This right here:

Code:
-filter_complex "[0:3]scale=s=1920x1080:flags=fast_bilinear[sub];[0:0]setparams=color_primaries=bt709:color_trc=bt709:colorspace=bt709,scale_vaapi=format=nv12:extra_hw_frames=24,hwdownload,format=nv12[main];[main][sub]overlay=eof_action=pass:shortest=1:repeatlast=0,hwupload_vaapi"

You have more complex subs being burned in through a complex filter and the video is being scaled in the stuttering transcode. I'll look more in-depth in a bit when I have time...

This is it! Turning off burned in subtitles resolved the stuttering, but now there is no subtitles, quick find on the cause, hopefully there is a simple solution Smiling-face

RE: HWA AMD VAAPI Stuttering - bitmap - 2023-09-06

Could you post a mediainfo or ffprobe of the file to provide more context on why the subs are being burned in? Guessing with anime the subs are too complex to display natively. If they're ASS/SSA and you're using a client that supports swapping players, you could try a different one (e.g., VLC might support more complex subs than ExoPlayer, built-in, or web). If they're PGS, DVD, VOB, etc... you'd want to find SRT subs. The down side for anime is you miss out on signs/songs translations. Personally, I don't care, but I've learned over time that I'm (in some cases literally) a heretic in a lot of the communities that I'm a part of so...

RE: HWA AMD VAAPI Stuttering - floppy - 2023-09-06

(2023-09-06, 07:13 PM)bitmap Wrote: Could you post a mediainfo or ffprobe of the file to provide more context on why the subs are being burned in? Guessing with anime the subs are too complex to display natively. If they're ASS/SSA and you're using a client that supports swapping players, you could try a different one (e.g., VLC might support more complex subs than ExoPlayer, built-in, or web). If they're PGS, DVD, VOB, etc... you'd want to find SRT subs. The down side for anime is you miss out on signs/songs translations. Personally, I don't care, but I've learned over time that I'm (in some cases literally) a heretic in a lot of the communities that I'm a part of so...

ASS/Complex subs are preferable when working as it will overlay the subs in the correct place on the screen with good font/styling, it's a deal breaker for me personally without. I've been using CPU encoding as it works flawlessly however reduces the speed of encoding and strains the system much more

FFprobe:
.txt

ffprobe.txt (Size: 4.89 KB / Downloads: 32)

RE: HWA AMD VAAPI Stuttering - bitmap - 2023-09-06

Oh I'm well aware of why folks would prefer ASS over another format. My anime collection would make teenage me extremely jealous. If only adult me had time to watch it like teenage me did. Time makes fools of us all.

RE: HWA AMD VAAPI Stuttering - nyanmisaka - 2023-09-06

Upgrading to JF 10.9 should fix issue.

RE: HWA AMD VAAPI Stuttering - floppy - 2023-09-06

(2023-09-06, 10:10 PM)nyanmisaka Wrote: Upgrading to JF 10.9 should fix issue.

Nope, same issue:
.txt

transcode.txt (Size: 16.88 KB / Downloads: 44)

Code:
ujellyfin:

    image: jellyfin/jellyfin:unstable

    container_name: ujellyfin

    network_mode: 'host'

    group_add:

      - "109"

      - "44"

    volumes:

      - ./configs/ujellyfin/config:/config

      - ./configs/ujellyfin/cache:/cache

      - /storage/downloads:/downloads

    devices:

      - /dev/dri/card0:/dev/dri/card0

      - /dev/dri/renderD128:/dev/dri/renderD128

    restart: 'unless-stopped'

Code:
Server: mserv

Version: 10.9.0

Operating System:

Architecture: X64

RE: HWA AMD VAAPI Stuttering - floppy - 2023-09-06

I solved it, upgrading to ffmpeg6 manually worked, I'll write a quick guide on how I did that in case anyone has the same issue in the future

This assumes you're using docker

Code:
docker compose exec jellyfin /bin/bash;

cd ~;

curl -L https://github.com/jellyfin/jellyfin-ffmpeg/releases/download/v6.0-6/jellyfin-ffmpeg6_6.0-6-bullseye_amd64.deb --output ffmpeg.deb;

dpkg -i ffmpeg.deb;

That should get you up and running with ffmpeg6 and removed stuttering with subtitles Smiling-face

RE: HWA AMD VAAPI Stuttering - bitmap - 2023-09-07

I don't know how other folks handle their containers, but you can set this up as a pre-launch step for your container. Put a startup script in your custom init scripts folder that does a wget or curl call for jellyfin-ffmpeg6 and forces the update over version 5. Makes it essentially invisible, but will add a few seconds to "boot" time for your container.