• Login
  • Register
  • Login Register
    Login
    Username/Email:
    Password:
    Or login with a social network below
  • Forum
  • Website
  • GitHub
  • Status
  • Translation
  • Features
  • Team
  • Rules
  • Help
  • Feeds
User Links
  • Login
  • Register
  • Login Register
    Login
    Username/Email:
    Password:
    Or login with a social network below

    Useful Links Forum Website GitHub Status Translation Features Team Rules Help Feeds
    Jellyfin Forum Support Troubleshooting SOLVED: 10.9.2 Failing Library Scan

     
    • 0 Vote(s) - 0 Average

    SOLVED: 10.9.2 Failing Library Scan

    Library scans failing after 10.9.2 upgrade.
    gccalvin
    Offline

    Junior Member

    Posts: 17
    Threads: 3
    Joined: 2024 May
    Reputation: 1
    Country:United States
    #1
    2024-05-18, 03:37 AM
    Hello,

    My server is running on a Debian 11 bullseye virtual machine, installed via the apt repository.

    I upgraded from 10.9.1 to 10.9.2 and now my library scans are failing:

    Code:
    [2024-05-17 22:01:09.154 -05:00] [ERR] Error in "Probe Provider"
    Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 6: 'database table is locked'.
      at Microsoft.Data.Sqlite.SqliteDataReader.NextResult()
      at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
      at Microsoft.Data.Sqlite.SqliteConnectionExtensions.ExecuteNonQuery(SqliteConnection connection, String commandText, SqliteParameter[] parameters)
      at Microsoft.Data.Sqlite.SqliteTransaction..ctor(SqliteConnection connection, IsolationLevel isolationLevel, Boolean deferred)
      at Microsoft.Data.Sqlite.SqliteConnection.BeginTransaction(IsolationLevel isolationLevel, Boolean deferred)
      at Emby.Server.Implementations.Data.SqliteItemRepository.SaveMediaStreams(Guid id, IReadOnlyList`1 streams, CancellationToken cancellationToken)
      at MediaBrowser.Providers.MediaInfo.AudioFileProber.FetchAsync(Audio audio, MediaInfo mediaInfo, MetadataRefreshOptions options, CancellationToken cancellationToken)
      at MediaBrowser.Providers.MediaInfo.AudioFileProber.Probe[T](T item, MetadataRefreshOptions options, CancellationToken cancellationToken)
      at MediaBrowser.Providers.Manager.MetadataService`2.RunCustomProvider(ICustomMetadataProvider`1 provider, TItemType item, String logName, MetadataRefreshOptions options, RefreshResult refreshResult, CancellationToken cancellationToken)

    In the log (attached), you can see the "ERR" for me stopping the trickplay generation, that is before I shutdown (through the Jellyfin Shutdown button) the server and updated (through apt-get upgrade).

    Things I've tried:
    - Rollback to 10.9.1 and try the upgrade again
    - Reboot the VM
    - Restart the Jellyfin server
    - Disable the music library (which the ui won't let me re-enable, I may need to create another post on that if I can't fix it)

    This may not be related, but ever since upgrading to 10.9.0 + my library scans have been taking longer. They were previously about 2 minutes, and now they are 12-15, with minimal to no usage on the server. The scan sits around 92% for a while before it finishes. In this instance, the scan makes it to around 92% but fails. I don't know if the long scans on 10.9.0 / 10.9.1 is due to the back-end changes, or maybe my database is failing / corrupt, and now I can't scan the library fully. Oddly enough, the scan fails at the 2 minute mark. Additionally, I was able to add a song and a video to one of my libraries, and the scan picked it up, even though it failed.

    Any help is appreciated, thank you.
    Go to solution
    TheDreadPirate
    Offline

    Community Moderator

    Posts: 15,374
    Threads: 10
    Joined: 2023 Jun
    Reputation: 460
    Country:United States
    #2
    2024-05-18, 04:27 AM (This post was last modified: 2024-05-18, 04:27 AM by TheDreadPirate.)
    Two things I am seeing. First, it looks like your NFS share unmounted or was otherwise unavailable

    Code:
    [2024-05-17 21:59:50.206 -05:00] [WRN] Library folder "/nfs/media/4k_Shows/Anime" is inaccessible or empty, skipping
    [2024-05-17 21:59:50.264 -05:00] [WRN] Library folder "/nfs/media/4k_Shows/Anime" is inaccessible or empty, skipping

    Two, if I had to guess maybe you ran out of space on your partition where your jellyfin data is located?

    Code:
    [2024-05-17 22:00:45.571 -05:00] [ERR] Error in "AniDB"
    System.Xml.XmlException: Root element is missing.
    Jellyfin 10.10.7 (Docker)
    Ubuntu 24.04.2 LTS w/HWE
    Intel i3 12100
    Intel Arc A380
    OS drive - SK Hynix P41 1TB
    Storage
        4x WD Red Pro 6TB CMR in RAIDZ1
    [Image: GitHub%20Sponsors-grey?logo=github]
    gccalvin
    Offline

    Junior Member

    Posts: 17
    Threads: 3
    Joined: 2024 May
    Reputation: 1
    Country:United States
    #3
    2024-05-19, 04:21 PM
    (2024-05-18, 04:27 AM)TheDreadPirate Wrote: Two things I am seeing.  First, it looks like your NFS share unmounted or was otherwise unavailable

    Code:
    [2024-05-17 21:59:50.206 -05:00] [WRN] Library folder "/nfs/media/4k_Shows/Anime" is inaccessible or empty, skipping
    [2024-05-17 21:59:50.264 -05:00] [WRN] Library folder "/nfs/media/4k_Shows/Anime" is inaccessible or empty, skipping

    Two, if I had to guess maybe you ran out of space on your partition where your jellyfin data is located?

    Code:
    [2024-05-17 22:00:45.571 -05:00] [ERR] Error in "AniDB"
    System.Xml.XmlException: Root element is missing.

    Hello,

    Thank you for your patience. To answer your questions, no, there is plenty of space on the partition and the NAS where the media is stored. Additionally, I can access the mount with no issues.

    However, I decided to reboot the NAS, (and the vm after it booted). The problem persisted, so I disabled AniDB manually on all of my libraries and the issue went away. I then scanned each library while enabling AniDB in the library settings.

    Even now, after AniDB is enabled on all the libraries, a full library scan doesn't fail, and the AniDB error's I was getting before are gone. I still think the reboot of the NAS, fixed this, but I'm not sure.

    Over the past day, I've been unable to reproduce the issue, and there are no [ERR]s in the logs now.

    Thank you for your help. You may consider this issue closed for now.
    tbyt2000
    Offline

    Junior Member

    Posts: 2
    Threads: 0
    Joined: 2024 May
    Reputation: 0
    #4
    2024-05-23, 08:38 AM
    Hi. I have the same problem.
    Moved from 10.8.13 to 10.9.1 - accidentally. I was refershing my docker image and hadn't seen the release announcement. Unfortunately this means I don't have a backup. I took lots of test backups for the 10.9 test versions but had cleared them down before the accidental upgrade. Embarassing.
    My database is on an SSD and I have 50GB spare on that drive (my library has ballooned to 117GB after the upgrade).
    I since upgraded to 10.9.2 before I realised I had a library issue.

    Code:
    [2024-05-23 09:26:42.254 +01:00] [ERR] [167] Emby.Server.Implementations.ScheduledTasks.TaskManager: Error executing Scheduled Task
    Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 6: 'database table is locked'.
      at Microsoft.Data.Sqlite.SqliteDataReader.NextResult()
      at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
      at Microsoft.Data.Sqlite.SqliteConnectionExtensions.ExecuteNonQuery(SqliteConnection connection, String commandText, SqliteParameter[] parameters)
      at Microsoft.Data.Sqlite.SqliteTransaction..ctor(SqliteConnection connection, IsolationLevel isolationLevel, Boolean deferred)
      at Emby.Server.Implementations.Data.SqliteItemRepository.SaveImages(BaseItem item)
      at Emby.Server.Implementations.Library.LibraryManager.UpdateImagesAsync(BaseItem item, Boolean forceUpdate)
      at Emby.Server.Implementations.Library.LibraryManager.RunMetadataSavers(BaseItem item, ItemUpdateType updateReason)
      at Emby.Server.Implementations.Library.LibraryManager.UpdateItemsAsync(IReadOnlyList`1 items, BaseItem parent, ItemUpdateType updateReason, CancellationToken cancellationToken)
      at MediaBrowser.Providers.Manager.MetadataService`2.SaveItemAsync(MetadataResult`1 result, ItemUpdateType reason, CancellationToken cancellationToken)
      at MediaBrowser.Providers.Manager.MetadataService`2.RefreshMetadata(BaseItem item, MetadataRefreshOptions refreshOptions, CancellationToken cancellationToken)
      at MediaBrowser.Controller.Entities.BaseItem.RefreshMetadata(MetadataRefreshOptions options, CancellationToken cancellationToken)
      at MediaBrowser.Controller.Entities.Folder.RefreshChildMetadata(BaseItem child, MetadataRefreshOptions refreshOptions, Boolean recursive, IProgress`1 progress, CancellationToken cancellationToken)
      at MediaBrowser.Controller.Entities.Folder.<>c__DisplayClass69_0`1.<<RunTasks>b__1>d.MoveNext()
    --- End of stack trace from previous location ---
      at MediaBrowser.Controller.Entities.Folder.RunTasks[T](Func`3 task, IList`1 children, IProgress`1 progress, CancellationToken cancellationToken)
      at MediaBrowser.Controller.Entities.Folder.RefreshChildMetadata(BaseItem child, MetadataRefreshOptions refreshOptions, Boolean recursive, IProgress`1 progress, CancellationToken cancellationToken)
      at MediaBrowser.Controller.Entities.Folder.<>c__DisplayClass69_0`1.<<RunTasks>b__1>d.MoveNext()
    --- End of stack trace from previous location ---
      at MediaBrowser.Controller.Entities.Folder.RunTasks[T](Func`3 task, IList`1 children, IProgress`1 progress, CancellationToken cancellationToken)
      at MediaBrowser.Controller.Entities.Folder.RefreshChildMetadata(BaseItem child, MetadataRefreshOptions refreshOptions, Boolean recursive, IProgress`1 progress, CancellationToken cancellationToken)
      at MediaBrowser.Controller.Entities.Folder.<>c__DisplayClass69_0`1.<<RunTasks>b__1>d.MoveNext()
    --- End of stack trace from previous location ---
      at MediaBrowser.Controller.Entities.Folder.RunTasks[T](Func`3 task, IList`1 children, IProgress`1 progress, CancellationToken cancellationToken)
      at MediaBrowser.Controller.Entities.Folder.ValidateChildrenInternal2(IProgress`1 progress, Boolean recursive, Boolean refreshChildMetadata, Boolean allowRemoveRoot, MetadataRefreshOptions refreshOptions, IDirectoryService directoryService, CancellationToken cancellationToken)
      at MediaBrowser.Controller.Entities.Folder.ValidateChildrenInternal(IProgress`1 progress, Boolean recursive, Boolean refreshChildMetadata, Boolean allowRemoveRoot, MetadataRefreshOptions refreshOptions, IDirectoryService directoryService, CancellationToken cancellationToken)
      at MediaBrowser.Controller.Entities.AggregateFolder.ValidateChildrenInternal(IProgress`1 progress, Boolean recursive, Boolean refreshChildMetadata, Boolean allowRemoveRoot, MetadataRefreshOptions refreshOptions, IDirectoryService directoryService, CancellationToken cancellationToken)
      at Emby.Server.Implementations.Library.LibraryManager.PerformLibraryValidation(IProgress`1 progress, CancellationToken cancellationToken)
      at Emby.Server.Implementations.Library.LibraryManager.ValidateMediaLibraryInternal(IProgress`1 progress, CancellationToken cancellationToken)
      at Emby.Server.Implementations.ScheduledTasks.ScheduledTaskWorker.ExecuteInternal(TaskOptions options)
    [2024-05-23 09:26:42.255 +01:00] [INF] [167] Emby.Server.Implementations.ScheduledTasks.TaskManager: "Scan Media Library" Failed after 4 minute(s) and 5 seconds

    As I don't have a 10.8 backup I am pretty knackered. Any help in resolving would be very much appreciated.
    Thanks Jellyfin friends!
    Fate
    Offline

    Member

    Posts: 219
    Threads: 3
    Joined: 2023 Jun
    Reputation: 16
    #5
    2024-05-23, 09:58 AM
    that is weird. My libary.db is around 520MB and my jellyfin.db around 0,4mb.  (Around 20TB of Data in the Libary)

    Which file got so big?
    as for unlocking your database. Either a reboot or copying the database and copy it back to original place should "unlock" it. Since it's only an Sqlite it doesn't really get locked internally, it gets just locked by a process accessing it.
    tbyt2000
    Offline

    Junior Member

    Posts: 2
    Threads: 0
    Joined: 2024 May
    Reputation: 0
    #6
    2024-05-23, 01:08 PM
    Hi Fate. Thanks for your response.
    My library.db is over 800MB. The meteadta folder is the size problem - approx 112GB. My library is very big Smiling-face
    I have temprorarily fixed the SQL locking by setting the Parallel library scan tasks limit (In General settings) to 1.
    I think simultaneous library scans (which is now the default behaviour) are locking each other out. There is a bug logged for this (which is where I found the workaround).
    My Jellyfin is back up and running Smiling-face
    Fate
    Offline

    Member

    Posts: 219
    Threads: 3
    Joined: 2023 Jun
    Reputation: 16
    #7
    2024-05-23, 02:23 PM
    So if it's all metadata then probably you have trackplay and chapter picture enabled in your library settings?

    My guess is trickplay is the issue, that would explain also why your libary scans take so long they lock each other.
    « Next Oldest | Next Newest »

    Users browsing this thread: 1 Guest(s)


    • View a Printable Version
    • Subscribe to this thread
    Forum Jump:

    Home · Team · Help · Contact
    © Designed by D&D - Powered by MyBB
    L


    Jellyfin

    The Free Software Media System

    Linear Mode
    Threaded Mode