SOLVED: Completely unresponsive when scanning libraries

[gaming09]

As the description says, in the last few updates, when scanning libraries the system is basically unresponsive.  I am not sure what is prompting it, the logs are clear of errors but wondering if anyone else is seeing the same behavior

[toytown]

Unfortunately it's been like this for a long time.

The best thing you can do is probably turn off automatic monitoring of media files and schedule a media refresh when your clients are unlikely to be using it. It doesn't matter if you have the jellyfin install on an old spinning rust HDD or a super fast NVMe.

Saying that my Movies scan is probably complete in 30seconds and TV in 60s. So it's not too much of an issue.

[TheDreadPirate]

Can you describe your setup? I've usually seen this happen when Jellyfin's database is on a HDD instead of a SSD.

[gaming09]

JF Docker/appdata/metadata is on Unraid - PCIE4 NVME 990pro
Library is on spinning disks (seagate x18 18tb drives that don't have a sleep schedule) (but i have the NFO files being written to the array too, i turned it off and same result so i turned it back on)
5950x cpu
asus x570 mobo
128gb ddr4 4000
1660TI for transcoding (dedicated)

Roughly
10tb movies (seperate library for kids/adult movies)
12tb tv shows (library split between current and archived)
2tb youtube downloads
7tb home movie vhs / reel to reel rips

Everything encoded to h265 hevc mostly direct play

The logs dont show any errors though - which is kind of maddening
I run emby too but that doesnt seem to have the same issue, even though its configured identically.

Can you describe your setup?  I've usually seen this happen when Jellyfin's database is on a HDD instead of a SSD.

[TheDreadPirate]

Which docker image are you using?

[gaming09]

Which docker image are you using?

BBergle's repository but its all pulled from the base image:
https://hub.docker.com/r/jellyfin/jellyfin
jellyfin/jellyfin:latest

Plugins: https://imgur.com/jfkmIW2
tried to keep it as close to stock as possbile, are there better images i should be looking at ? i know linuxserver, binhex and hotio are popular

Right now its scanning and its completely unresponsive

Code:

[2024-04-05 16:22:41.450 -07:00] [INF] [234] ConfusedPolarBear.Plugin.IntroSkipper.AnalyzeEpisodesTask: Analyzing 23 episodes from "Supernatural" season 12
[2024-04-05 16:22:41.573 -07:00] [INF] [234] ConfusedPolarBear.Plugin.IntroSkipper.AnalyzeEpisodesTask: Analyzing 23 episodes from "Supernatural" season 13
[2024-04-05 16:22:41.696 -07:00] [INF] [113] Emby.Server.Implementations.ScheduledTasks.TaskManager: "Detect Introductions" Completed after 0 minute(s) and 17 seconds
[2024-04-05 16:22:41.696 -07:00] [INF] [113] Emby.Server.Implementations.ScheduledTasks.TaskManager: ExecuteQueuedTasks
[2024-04-05 16:25:16.247 -07:00] [INF] [234] Emby.Server.Implementations.ScheduledTasks.TaskManager: Queuing task "RefreshMediaLibraryTask"
[2024-04-05 16:25:16.247 -07:00] [INF] [212] Emby.Server.Implementations.ScheduledTasks.TaskManager: Executing "Scan Media Library"
[2024-04-05 16:25:16.247 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/movies"
[2024-04-05 16:25:16.248 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/ClassicTV"
[2024-04-05 16:25:16.249 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/tv"
[2024-04-05 16:25:16.250 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/youtube/YoutubeSubscription/channels"
[2024-04-05 16:25:16.250 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/classic_kids_shows"
[2024-04-05 16:25:16.250 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/kids_movies"
[2024-04-05 16:25:16.251 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/youtube/YoutubeSubscription/playlists"
[2024-04-05 16:25:16.251 -07:00] [INF] [212] Emby.Server.Implementations.Library.LibraryManager: Validating media library
[2024-04-05 16:26:46.836 -07:00] [WRN] [3] Jellyfin.Plugin.Tvdb.Providers.TvdbMissingEpisodeProvider: Unable to get episodes from TVDB
TvDbSharper.TvDbServerException: The given series ID does not exist; No results for your query: map[AiredSeason:10]
  at TvDbSharper.Infrastructure.Parser.Parse[T](ApiResponse response, IReadOnlyDictionary`2 errorMap)
  at TvDbSharper.Clients.SeriesClient.GetEpisodesAsync(Int32 seriesId, Int32 page, EpisodeQuery query, CancellationToken cancellationToken)
  at Jellyfin.Plugin.Tvdb.TvdbClientManager.<>c__DisplayClass24_0`1.<<TryGetValue>b__0>d.MoveNext()
--- End of stack trace from previous location ---
  at Microsoft.Extensions.Caching.Memory.CacheExtensions.GetOrCreateAsync[TItem](IMemoryCache cache, Object key, Func`2 factory)
  at Jellyfin.Plugin.Tvdb.Providers.TvdbMissingEpisodeProvider.GetAllEpisodes(Int32 tvdbId, String acceptedLanguage, EpisodeQuery episodeQuery)
[2024-04-05 16:29:25.604 -07:00] [INF] [24] Emby.Server.Implementations.ScheduledTasks.TaskManager: Attempting to cancel Scheduled Task "Scan Media Library"
[2024-04-05 16:29:25.605 -07:00] [INF] [24] Emby.Server.Implementations.ScheduledTasks.TaskManager: Queuing task "RefreshMediaLibraryTask"
[2024-04-05 16:40:49.924 -07:00] [INF] [29] Emby.Server.Implementations.ScheduledTasks.TaskManager: "Scan Media Library" Cancelled after 15 minute(s) and 33 seconds
[2024-04-05 16:40:49.925 -07:00] [INF] [29] Emby.Server.Implementations.ScheduledTasks.TaskManager: ExecuteQueuedTasks
[2024-04-05 16:40:50.115 -07:00] [INF] [83] Emby.Server.Implementations.ScheduledTasks.TaskManager: Executing "Scan Media Library"
[2024-04-05 16:40:50.115 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/movies"
[2024-04-05 16:40:50.115 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/ClassicTV"
[2024-04-05 16:40:50.115 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/tv"
[2024-04-05 16:40:50.115 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/youtube/YoutubeSubscription/channels"
[2024-04-05 16:40:50.116 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/classic_kids_shows"
[2024-04-05 16:40:50.116 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/kids_movies"
[2024-04-05 16:40:50.116 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/youtube/YoutubeSubscription/playlists"
[2024-04-05 16:40:50.116 -07:00] [INF] [83] Emby.Server.Implementations.Library.LibraryManager: Validating media library
[2024-04-05 16:40:50.125 -07:00] [INF] [228] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/youtube/YoutubeSubscription/playlists"
[2024-04-05 16:40:50.144 -07:00] [INF] [30] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/youtube/YoutubeSubscription/channels"
[2024-04-05 16:40:50.312 -07:00] [INF] [48] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/classic_kids_shows"
[2024-04-05 16:40:50.388 -07:00] [INF] [155] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/kids_movies"
[2024-04-05 16:40:50.436 -07:00] [INF] [136] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/ClassicTV"
[2024-04-05 16:40:50.602 -07:00] [INF] [143] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/tv"
[2024-04-05 16:40:50.732 -07:00] [INF] [43] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/movies"
[2024-04-05 16:42:51.874 -07:00] [INF] [32] Emby.Server.Implementations.HttpServer.WebSocketManager: WS "192.168.1.200" request
[2024-04-05 16:43:51.388 -07:00] [INF] [219] Emby.Server.Implementations.Session.SessionWebSocketListener: Sending ForceKeepAlive message to 1 inactive WebSockets.
[2024-04-05 16:44:00.391 -07:00] [WRN] [47] Jellyfin.Plugin.Tvdb.Providers.TvdbMissingEpisodeProvider: Unable to get episodes from TVDB
TvDbSharper.TvDbServerException: The given series ID does not exist; No results for your query: map[AiredSeason:10]
  at TvDbSharper.Infrastructure.Parser.Parse[T](ApiResponse response, IReadOnlyDictionary`2 errorMap)
  at TvDbSharper.Clients.SeriesClient.GetEpisodesAsync(Int32 seriesId, Int32 page, EpisodeQuery query, CancellationToken cancellationToken)
  at Jellyfin.Plugin.Tvdb.TvdbClientManager.<>c__DisplayClass24_0`1.<<TryGetValue>b__0>d.MoveNext()
--- End of stack trace from previous location ---
  at Microsoft.Extensions.Caching.Memory.CacheExtensions.GetOrCreateAsync[TItem](IMemoryCache cache, Object key, Func`2 factory)
  at Jellyfin.Plugin.Tvdb.Providers.TvdbMissingEpisodeProvider.GetAllEpisodes(Int32 tvdbId, String acceptedLanguage, EpisodeQuery episodeQuery)

[toytown]

Just to add, i use only the official docker and its always been like this since i've installed Jellyfin, a few other people have all reported a similar issue. Almost like the scanning ties up the main UI thread or something, or its a limitation/performance issue with the SQLite DB.

[TheDreadPirate]

Could be several things, but plugins has been a culprit before. My setup is pretty "vanilla" so I can't say for certain which one may or may not be the culprit in yours, but experiment by turning off some of your plugins.

[toytown]

No plugins on my side, it has to be something locking up the main thread till the scan completes. It's very easy to replicate, just start up a fresh docker image (official with no additional plugins), point it at a media directory with about 200 movies in. Have a second tab open with the web UI in a browser, as soon as you start a scan, hit refresh on the web UI and see that it doesn't respond.

I have a pretty big collection and it only takes about 30seconds to scan new media for my movies. But for my TV shows its a little longer, maybe due to having more folders to traverse, so its not a major issue for me. However on a new install with a decent sized library it can take a few minutes before the UI is in a usable state.

[gaming09]

Disabled all plugins (that would turn off)





Same behavior

Could be several things, but plugins has been a culprit before. My setup is pretty "vanilla" so I can't say for certain which one may or may not be the culprit in yours, but experiment by turning off some of your plugins.