Completely unresponsive when scanning libraries - gaming09 - 2024-04-02
As the description says, in the last few updates, when scanning libraries the system is basically unresponsive. I am not sure what is prompting it, the logs are clear of errors but wondering if anyone else is seeing the same behavior
RE: Completely unresponsive when scanning libraries - toytown - 2024-04-02
Unfortunately it's been like this for a long time.
The best thing you can do is probably turn off automatic monitoring of media files and schedule a media refresh when your clients are unlikely to be using it. It doesn't matter if you have the jellyfin install on an old spinning rust HDD or a super fast NVMe.
Saying that my Movies scan is probably complete in 30seconds and TV in 60s. So it's not too much of an issue.
RE: Completely unresponsive when scanning libraries - TheDreadPirate - 2024-04-02
Can you describe your setup? I've usually seen this happen when Jellyfin's database is on a HDD instead of a SSD.
RE: Completely unresponsive when scanning libraries - gaming09 - 2024-04-05
JF Docker/appdata/metadata is on Unraid - PCIE4 NVME 990pro
Library is on spinning disks (seagate x18 18tb drives that don't have a sleep schedule) (but i have the NFO files being written to the array too, i turned it off and same result so i turned it back on)
5950x cpu
asus x570 mobo
128gb ddr4 4000
1660TI for transcoding (dedicated)
Roughly
10tb movies (seperate library for kids/adult movies)
12tb tv shows (library split between current and archived)
2tb youtube downloads
7tb home movie vhs / reel to reel rips
Everything encoded to h265 hevc mostly direct play
The logs dont show any errors though - which is kind of maddening
I run emby too but that doesnt seem to have the same issue, even though its configured identically.
(2024-04-02, 04:51 PM)TheDreadPirate Wrote: Can you describe your setup? I've usually seen this happen when Jellyfin's database is on a HDD instead of a SSD.
RE: Completely unresponsive when scanning libraries - TheDreadPirate - 2024-04-05
Which docker image are you using?
RE: Completely unresponsive when scanning libraries - gaming09 - 2024-04-05
(2024-04-05, 01:01 PM)TheDreadPirate Wrote: Which docker image are you using? BBergle's repository but its all pulled from the base image:
https://hub.docker.com/r/jellyfin/jellyfin
jellyfin/jellyfin:latest
Plugins: https://imgur.com/jfkmIW2
tried to keep it as close to stock as possbile, are there better images i should be looking at ? i know linuxserver, binhex and hotio are popular
Right now its scanning and its completely unresponsive
Code: [2024-04-05 16:22:41.450 -07:00] [INF] [234] ConfusedPolarBear.Plugin.IntroSkipper.AnalyzeEpisodesTask: Analyzing 23 episodes from "Supernatural" season 12
[2024-04-05 16:22:41.573 -07:00] [INF] [234] ConfusedPolarBear.Plugin.IntroSkipper.AnalyzeEpisodesTask: Analyzing 23 episodes from "Supernatural" season 13
[2024-04-05 16:22:41.696 -07:00] [INF] [113] Emby.Server.Implementations.ScheduledTasks.TaskManager: "Detect Introductions" Completed after 0 minute(s) and 17 seconds
[2024-04-05 16:22:41.696 -07:00] [INF] [113] Emby.Server.Implementations.ScheduledTasks.TaskManager: ExecuteQueuedTasks
[2024-04-05 16:25:16.247 -07:00] [INF] [234] Emby.Server.Implementations.ScheduledTasks.TaskManager: Queuing task "RefreshMediaLibraryTask"
[2024-04-05 16:25:16.247 -07:00] [INF] [212] Emby.Server.Implementations.ScheduledTasks.TaskManager: Executing "Scan Media Library"
[2024-04-05 16:25:16.247 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/movies"
[2024-04-05 16:25:16.248 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/ClassicTV"
[2024-04-05 16:25:16.249 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/tv"
[2024-04-05 16:25:16.250 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/youtube/YoutubeSubscription/channels"
[2024-04-05 16:25:16.250 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/classic_kids_shows"
[2024-04-05 16:25:16.250 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/kids_movies"
[2024-04-05 16:25:16.251 -07:00] [INF] [212] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/youtube/YoutubeSubscription/playlists"
[2024-04-05 16:25:16.251 -07:00] [INF] [212] Emby.Server.Implementations.Library.LibraryManager: Validating media library
[2024-04-05 16:26:46.836 -07:00] [WRN] [3] Jellyfin.Plugin.Tvdb.Providers.TvdbMissingEpisodeProvider: Unable to get episodes from TVDB
TvDbSharper.TvDbServerException: The given series ID does not exist; No results for your query: map[AiredSeason:10]
at TvDbSharper.Infrastructure.Parser.Parse[T](ApiResponse response, IReadOnlyDictionary`2 errorMap)
at TvDbSharper.Clients.SeriesClient.GetEpisodesAsync(Int32 seriesId, Int32 page, EpisodeQuery query, CancellationToken cancellationToken)
at Jellyfin.Plugin.Tvdb.TvdbClientManager.<>c__DisplayClass24_0`1.<<TryGetValue>b__0>d.MoveNext()
--- End of stack trace from previous location ---
at Microsoft.Extensions.Caching.Memory.CacheExtensions.GetOrCreateAsync[TItem](IMemoryCache cache, Object key, Func`2 factory)
at Jellyfin.Plugin.Tvdb.Providers.TvdbMissingEpisodeProvider.GetAllEpisodes(Int32 tvdbId, String acceptedLanguage, EpisodeQuery episodeQuery)
[2024-04-05 16:29:25.604 -07:00] [INF] [24] Emby.Server.Implementations.ScheduledTasks.TaskManager: Attempting to cancel Scheduled Task "Scan Media Library"
[2024-04-05 16:29:25.605 -07:00] [INF] [24] Emby.Server.Implementations.ScheduledTasks.TaskManager: Queuing task "RefreshMediaLibraryTask"
[2024-04-05 16:40:49.924 -07:00] [INF] [29] Emby.Server.Implementations.ScheduledTasks.TaskManager: "Scan Media Library" Cancelled after 15 minute(s) and 33 seconds
[2024-04-05 16:40:49.925 -07:00] [INF] [29] Emby.Server.Implementations.ScheduledTasks.TaskManager: ExecuteQueuedTasks
[2024-04-05 16:40:50.115 -07:00] [INF] [83] Emby.Server.Implementations.ScheduledTasks.TaskManager: Executing "Scan Media Library"
[2024-04-05 16:40:50.115 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/movies"
[2024-04-05 16:40:50.115 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/ClassicTV"
[2024-04-05 16:40:50.115 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/tv"
[2024-04-05 16:40:50.115 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/youtube/YoutubeSubscription/channels"
[2024-04-05 16:40:50.116 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/classic_kids_shows"
[2024-04-05 16:40:50.116 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/kids_movies"
[2024-04-05 16:40:50.116 -07:00] [INF] [83] Emby.Server.Implementations.IO.LibraryMonitor: Stopping directory watching for path "/data/media/youtube/YoutubeSubscription/playlists"
[2024-04-05 16:40:50.116 -07:00] [INF] [83] Emby.Server.Implementations.Library.LibraryManager: Validating media library
[2024-04-05 16:40:50.125 -07:00] [INF] [228] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/youtube/YoutubeSubscription/playlists"
[2024-04-05 16:40:50.144 -07:00] [INF] [30] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/youtube/YoutubeSubscription/channels"
[2024-04-05 16:40:50.312 -07:00] [INF] [48] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/classic_kids_shows"
[2024-04-05 16:40:50.388 -07:00] [INF] [155] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/kids_movies"
[2024-04-05 16:40:50.436 -07:00] [INF] [136] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/ClassicTV"
[2024-04-05 16:40:50.602 -07:00] [INF] [143] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/tv"
[2024-04-05 16:40:50.732 -07:00] [INF] [43] Emby.Server.Implementations.IO.LibraryMonitor: Watching directory "/data/media/movies"
[2024-04-05 16:42:51.874 -07:00] [INF] [32] Emby.Server.Implementations.HttpServer.WebSocketManager: WS "192.168.1.200" request
[2024-04-05 16:43:51.388 -07:00] [INF] [219] Emby.Server.Implementations.Session.SessionWebSocketListener: Sending ForceKeepAlive message to 1 inactive WebSockets.
[2024-04-05 16:44:00.391 -07:00] [WRN] [47] Jellyfin.Plugin.Tvdb.Providers.TvdbMissingEpisodeProvider: Unable to get episodes from TVDB
TvDbSharper.TvDbServerException: The given series ID does not exist; No results for your query: map[AiredSeason:10]
at TvDbSharper.Infrastructure.Parser.Parse[T](ApiResponse response, IReadOnlyDictionary`2 errorMap)
at TvDbSharper.Clients.SeriesClient.GetEpisodesAsync(Int32 seriesId, Int32 page, EpisodeQuery query, CancellationToken cancellationToken)
at Jellyfin.Plugin.Tvdb.TvdbClientManager.<>c__DisplayClass24_0`1.<<TryGetValue>b__0>d.MoveNext()
--- End of stack trace from previous location ---
at Microsoft.Extensions.Caching.Memory.CacheExtensions.GetOrCreateAsync[TItem](IMemoryCache cache, Object key, Func`2 factory)
at Jellyfin.Plugin.Tvdb.Providers.TvdbMissingEpisodeProvider.GetAllEpisodes(Int32 tvdbId, String acceptedLanguage, EpisodeQuery episodeQuery)
RE: Completely unresponsive when scanning libraries - toytown - 2024-04-05
Just to add, i use only the official docker and its always been like this since i've installed Jellyfin, a few other people have all reported a similar issue. Almost like the scanning ties up the main UI thread or something, or its a limitation/performance issue with the SQLite DB.
RE: Completely unresponsive when scanning libraries - TheDreadPirate - 2024-04-06
Could be several things, but plugins has been a culprit before. My setup is pretty "vanilla" so I can't say for certain which one may or may not be the culprit in yours, but experiment by turning off some of your plugins.
RE: Completely unresponsive when scanning libraries - toytown - 2024-04-06
No plugins on my side, it has to be something locking up the main thread till the scan completes. It's very easy to replicate, just start up a fresh docker image (official with no additional plugins), point it at a media directory with about 200 movies in. Have a second tab open with the web UI in a browser, as soon as you start a scan, hit refresh on the web UI and see that it doesn't respond.
I have a pretty big collection and it only takes about 30seconds to scan new media for my movies. But for my TV shows its a little longer, maybe due to having more folders to traverse, so its not a major issue for me. However on a new install with a decent sized library it can take a few minutes before the UI is in a usable state.
RE: Completely unresponsive when scanning libraries - gaming09 - 2024-04-09
Disabled all plugins (that would turn off)
Same behavior
(2024-04-06, 01:45 AM)TheDreadPirate Wrote: Could be several things, but plugins has been a culprit before. My setup is pretty "vanilla" so I can't say for certain which one may or may not be the culprit in yours, but experiment by turning off some of your plugins.
|