• Login
  • Register
  • Login Register
    Login
    Username/Email:
    Password:
    Or login with a social network below
  • Forum
  • Website
  • GitHub
  • Status
  • Translation
  • Features
  • Team
  • Rules
  • Help
  • Feeds
User Links
  • Login
  • Register
  • Login Register
    Login
    Username/Email:
    Password:
    Or login with a social network below

    Useful Links Forum Website GitHub Status Translation Features Team Rules Help Feeds
    Jellyfin Forum Support General Questions High Disk Activity

     
    • 0 Vote(s) - 0 Average

    High Disk Activity

    Excessive read/write on NAS
    MediaMaan
    Offline

    Junior Member

    Posts: 10
    Threads: 3
    Joined: 2024 Apr
    Reputation: 0
    Country:Canada
    #1
    2024-10-29, 08:07 PM
    Since I switched to the Bbergle-jellyfin docker on unRAID, I've noticed a LOT of disk activity. It genuinely seems excessive.
    Multiple times per day, the disks are "chunking" away. Prior to installing Jellyfin, this wasn't happening.

    My guess is that it has something to do with the Medial Library, and scanning.
    A look at recent logs for example, shows the following :
    [09:26:02] [INF] [76] MediaBrowser.MediaEncoding.Encoder.MediaEncoder: Starting /usr/lib/jellyfin-ffmpeg/ffprobe with args -analyzeduration 200M -probesize 1G -i file:"/data/tvshows/HDTV/Tom Clancy's Jack Ryan/Season 4/Tom Clancy's Jack Ryan - S04E05 - Wukong.mkv" -threads 0 -v warning -print_format json -show_streams -show_chapters -show_format

    What is Jellyfin trying to accomplish here? Why is it probing multiple times a day?

    I want Jellyfin to monitor the various libraries, so I checked "Enable Real-time Monitoring" in order that new files are added to the DB within a few moments of being placed in a Directory. But having such frequent disk activity is a little concerning when nobody is connected to Jellyfin. Especially since it is running the disks for hours at a time, day & night.

    Is this a Real Time Monitoring issue, or something else? What settings should I be playing with to sort this out?

    Thanks for your help!
    TheDreadPirate
    Offline

    Community Moderator

    Posts: 15,375
    Threads: 10
    Joined: 2023 Jun
    Reputation: 460
    Country:United States
    #2
    2024-10-29, 08:10 PM
    Do you have trickplay enabled? Or chapter image extraction? Depending on how you've got jellyfin setup and what your hardware specs those two tasks can take hours to complete.

    But we'd need to see your full server log via pastebin.
    Jellyfin 10.10.7 (Docker)
    Ubuntu 24.04.2 LTS w/HWE
    Intel i3 12100
    Intel Arc A380
    OS drive - SK Hynix P41 1TB
    Storage
        4x WD Red Pro 6TB CMR in RAIDZ1
    [Image: GitHub%20Sponsors-grey?logo=github]
    MediaMaan
    Offline

    Junior Member

    Posts: 10
    Threads: 3
    Joined: 2024 Apr
    Reputation: 0
    Country:Canada
    #3
    2024-10-30, 03:00 AM
    (2024-10-29, 08:10 PM)TheDreadPirate Wrote: Do you have trickplay enabled?  Or chapter image extraction?  Depending on how you've got jellyfin setup and what your hardware specs those two tasks can take hours to complete.

    But we'd need to see your full server log via pastebin.

    Thanks for the reply!

    Trickplay & Chapter Extraction are disabled in all libraries, but the logs seem to show them.
    Looks like a lot of things going on here, which probably explains the drive thrashing.
    Oddly, it is doing this regularly, even when no changes have been made to the media libraries for weeks.

    https://pastebin.com/F3W0Wx7v

    What all are you seeing here?
    TheDreadPirate
    Offline

    Community Moderator

    Posts: 15,375
    Threads: 10
    Joined: 2023 Jun
    Reputation: 460
    Country:United States
    #4
    2024-10-30, 12:56 PM
    I see ffprobe probing for codec information and I see ffmpeg pre-extracting subtitles. I don't see ffmpeg/ffprobe being called for anything else.
    Jellyfin 10.10.7 (Docker)
    Ubuntu 24.04.2 LTS w/HWE
    Intel i3 12100
    Intel Arc A380
    OS drive - SK Hynix P41 1TB
    Storage
        4x WD Red Pro 6TB CMR in RAIDZ1
    [Image: GitHub%20Sponsors-grey?logo=github]
    MediaMaan
    Offline

    Junior Member

    Posts: 10
    Threads: 3
    Joined: 2024 Apr
    Reputation: 0
    Country:Canada
    #5
    2024-10-30, 04:59 PM
    (2024-10-30, 12:56 PM)TheDreadPirate Wrote: I see ffprobe probing for codec information and I see ffmpeg pre-extracting subtitles.  I don't see ffmpeg/ffprobe being called for anything else.

    Is it supposed to do these same probes daily? Even when there have been no changes to files?
    Should I disable subtitle preextraction?
    Does it need to reextract them daily, or is it my library is so large it does a certain number at a time then stops?
    Where is it saving these extractions?

    [2024-10-28 09:25:33.602 -06:00] [INF] [52] Emby.Server.Implementations.Library.LibraryManager: Removing item, Type: "Episode", Name: "Interview with Sir David Attenborough", Path: "", Id: e21c2223-fc9b-d408-a17e-b7c9f255318c

    Here it looks like it is deleting something. Don't know if that is from the JF database (in which case there should be no writes to parity as database files are held on an SSD cache drive), or a file it had temporarily created. But I can see that my Parity drive is not timing out. That means writes / deletions are being made from a disk every few hours, or it would spin down. This is when no one else has access to the server.

    Or am I seeing the same files over and over again only when they get errors? e.g.

    [2024-10-28 21:25:53.202 -06:00] [INF] [54] MediaBrowser.MediaEncoding.Encoder.MediaEncoder: Starting "/usr/lib/jellyfin-ffmpeg/ffprobe" with args "-analyzeduration 200M -probesize 1G -i file:\"/data/tvshows/4K TV/Tom Clancy's Jack Ryan/Season 2/Tom Clancy's Jack Ryan S02E02 Tertia Optio [2160p x265 10bit Joy].mkv\" -threads 0 -v warning -print_format json -show_streams -show_chapters -show_format"
    [2024-10-28 21:25:53.356 -06:00] [ERR] [115] MediaBrowser.Providers.TV.EpisodeMetadataService: Error in "TheMovieDb"
    System.FormatException: The input string '73375-jack-ryan' was not in a correct format.
    at System.Number.ThrowFormatException[TChar](ReadOnlySpan1 value)
    at System.Int32.Parse(String s, NumberStyles style, IFormatProvider provider)
    at MediaBrowser.Providers.Plugins.Tmdb.TV.TmdbEpisodeProvider.GetMetadata(EpisodeInfo info, CancellationToken cancellationToken)
    at MediaBrowser.Providers.Manager.MetadataService
    2.ExecuteRemoteProviders(MetadataResult1 temp, String logName, Boolean replaceData, TIdType id, IEnumerable1 providers, CancellationToken cancellationToken)

    Interestingly, when I ran a different Docker, I don't think all the disk activity was happening...
    So I'm wondering if it is something I have done in my setup.
    TheDreadPirate
    Offline

    Community Moderator

    Posts: 15,375
    Threads: 10
    Joined: 2023 Jun
    Reputation: 460
    Country:United States
    #6
    2024-10-30, 05:05 PM
    It is re-scanning due to failing over and over.

    How do you have your library configured? Is the "/tvshows" folder added to the library? Or is "/tvshows/HDTV" and "/tvshows/4K TV" added to your library individually?
    Jellyfin 10.10.7 (Docker)
    Ubuntu 24.04.2 LTS w/HWE
    Intel i3 12100
    Intel Arc A380
    OS drive - SK Hynix P41 1TB
    Storage
        4x WD Red Pro 6TB CMR in RAIDZ1
    [Image: GitHub%20Sponsors-grey?logo=github]
    MediaMaan
    Offline

    Junior Member

    Posts: 10
    Threads: 3
    Joined: 2024 Apr
    Reputation: 0
    Country:Canada
    #7
    2024-10-31, 05:04 AM
    (2024-10-30, 05:05 PM)TheDreadPirate Wrote: It is re-scanning due to failing over and over.

    How do you have your library configured?  Is the "/tvshows" folder added to the library?  Or is "/tvshows/HDTV" and "/tvshows/4K TV" added to your library individually?

    In my library, TV shows contains 2 subdirectories. 
    /data/tvshows/HDTV
    /data/tvshows/SDTV

    4KTV is a separate library item.
    /data/tvshows/4kTV
    TheDreadPirate
    Offline

    Community Moderator

    Posts: 15,375
    Threads: 10
    Joined: 2023 Jun
    Reputation: 460
    Country:United States
    #8
    2024-10-31, 12:38 PM
    Good.

    Try adding the TMDB ID to the folder name of Jack Ryan

    Code:
    Tom Clancy's Jack Ryan (2018) [tmdbid-73375]
    Jellyfin 10.10.7 (Docker)
    Ubuntu 24.04.2 LTS w/HWE
    Intel i3 12100
    Intel Arc A380
    OS drive - SK Hynix P41 1TB
    Storage
        4x WD Red Pro 6TB CMR in RAIDZ1
    [Image: GitHub%20Sponsors-grey?logo=github]
    « Next Oldest | Next Newest »

    Users browsing this thread: 1 Guest(s)


    • View a Printable Version
    • Subscribe to this thread
    Forum Jump:

    Home · Team · Help · Contact
    © Designed by D&D - Powered by MyBB
    L


    Jellyfin

    The Free Software Media System

    Linear Mode
    Threaded Mode