Deleted and Missing

[enesha]

Good Afternoon

First let me say, to anyone who read my last post, i'm sorry I was so angry and whatnot.  It was a bad time for my pc to be locked up.  Anyway just saying sorry I was pissy.

Ok So I'm having two problems:

1) I have the empty seasons and episodes.
  I have tried unchecking the empty episode item...(why the heck would that be checked by default?  Seems that's the sort of thing the admin should do.  Is that how we ended up with so many people having this problem and being told too bad delete and re-add?)

Then I did a full scan - no change.  Suggestions were to remove the series and add it back.  That's a BS answer, as i'm sure many of you are like me and have your series scattered across different drives.  JF has the option to combine if you do that....  Also It's in MANY of my series.  I can't simply remove each directory and add back,...just not feasible or reasonable to be put out as the only option I read in threads about this.  I also saw someone suggest just rempving the item frtom the interfae.  Sure it should work, but instead it tells me it doesn't have premissiions (to delete the non existing item) and fails to remove it.

2) the server is not removing deleted / moved media.  I have one persnickety series that keept pulling in a non connected item (named properly do idk why).  Ok so then I deleted that.  It's STILL in my library.  As a second copy of episode 2 of that series.  After deleting it no longert has a preview image but it is STILL THERE with media info etc.  I even have a show whose full directory was deleted and it STILL shows up.  One season with episodes and 6 or so empty seasons.  If the directory isn't there why the heck is it still populating after a full scan?   What's up?  Maybe it doesn't bother people but i'm getting constant chatter back from the family about trying to play something that fails.

I have lots of "missing" media

I know i asked it before, but frankly I never looked back for responses.  Am I the only one having trouble since 10.9?  I NEVER had trouble with 10.8.  It took a very long time for 10.8 to continue increasing in point releases.  With 10.9 it seems theres an update to fix some problem or another every week or so.  Just feels like 10.9 simply didn't get tested enough?  This many bugs and releases is pretty bad....

Anyway I don't expect much, but I thought I'd check on here and see if anyone has resolved it for themselves
So various problems:
This missing episide drama
That stupid chmod (I see the update properly kills JF first?  Not sure if it did that before)
A strange and hard to chase lag when opening the main screen.  I can take between instant and 2~ minutes just to populate the home screen.  Client and server are local both on gig ethernet.

I am on linux (6.10)
I am running 10.9.11
Lotsa drives
Pleanty of RAM and cpu cycles

I can't do things a series at a time.  MAYBE I can blast a library at a time and rebuild them.  Not sure if that then keeps user data and watched status.  If I have to do all that, with who knows what other bugs coming that maybe it's time to look again at emby or plex.  I hate plex, and everything they stand for, but if there's going to be continuing problems with basic functionaly I guess....

[TheDreadPirate]

So various problems:
This missing episide drama

There is a SQL query someone came up with to scan the database and remove the "missing" items.  Stop Jellyfin before attempting, also backup your databases.  Read the post linked below.

https://forum.jellyfin.org/t-how-to-disa...6#pid31946

The Missing Episode Fetcher is a relatively new addition to the TVDB plugin and individual items in metadata providers can't be disabled on install.

That stupid chmod (I see the update properly kills JF first?  Not sure if it did that before)

If you're talking about the permissions issue on fresh 10.9.10 installs, that was an oversight for the deb package build where permissions weren't being set during install.  That should be resolved in .11

A strange and hard to chase lag when opening the main screen.  I can take between instant and 2~ minutes just to populate the home screen.  Client and server are local both on gig ethernet
I can't do things a series at a time.  MAYBE I can blast a library at a time and rebuild them.  Not sure if that then keeps user data and watched status.  If I have to do all that, with who knows what other bugs coming that maybe it's time to look again at emby or plex.  I hate plex, and everything they stand for, but if there's going to be continuing problems with basic functionaly I guess....

I'd need to see your logs and whether the jellyfin database is stored on a SSD or not.

[enesha]

Hiya DreadPirate

Thank you for that script, I hadn't noticed it when I searched.
I ran the commands...not very versed in sql so I just did what it said. Not sure yet the actual effect, but it did reduce the db by about 100 megs.

The chmod may have been that version. Wasn't a fresh install, it was an upgrade using aptitude. Everything seems fine now tho.

The drive is definitly ssd, formatted ext4 trim and all that. Does that make a difference here? It's actually upgraded from a chs drive because it was laggy and the new drive ias significantly faster. The lag has mostly resolved now, so I'm assuming that / was just pretty busy

As for the other files...The one that is currently offending me is Dr Who Season 1 episode 2. I have two listings in the library, one for real and one that it's just determined to have there.

I have uploaded todays log file. I triggered a few things to show the best. I will super gratefully accept your assistance with the log file. There are just a bunch of errors and warnings that i haven't had the time to reallly look at I welcome yout input into what i'm sure i did wrong. Here is my log file:

https://logpaste.com/OmUHf75y

Thank you greatly

[TheDreadPirate]

Sheesh. A lot going on in that log. I'm assuming most of your storage are on several network shares. Do you have real time monitoring enabled? Do you save/use images stored with the media? Or NFOs? What metadata providers do you use?

A couple things I noticed as I was skimming the log, you have a few multiple episode files where there is a space in between the two episode numbers. Like "E01 - E02". For the multi-episode syntax there can't be a space.

Also, your folder and file naming is very inconsistent. I don't think it is causing the lag you're seeing, but depending on your answers to my questions above

[theguymadmax]

Jellyfin expects your media to be named in a specific format, but your current naming scheme is inconsistent. You should spend some time and conform your media according to Jellyfin's guidelines.

Shows:
└── Series Name (2010)
    ├── Season 01
    │  ├── Series Name S01E01.mkv
    ├── Season 02
    │  ├── Series Name S02E01.mkv

Movies:
└── Best_Movie_Ever (2019)
    ├── Best_Movie_Ever (2019).mp4

[TheDreadPirate]

There are tools you can use to automate this process. Tiny Media Manager and one of the *arrs, IIRC, can mass rename files and folders.

[enesha]

Yeah definitely a lot going on there. I was ill equipped to analyzy the totality of it lol.

Thanks for the info re: naming convention. I will add that to my list and get something looked at and fixed.
At one point I did try to be consistent, but I got overwhelmed and dropped the ball, I get that.

The /mnt convention is simply a hold over from my early days of linux in the 90's. All physical disks were mounted there. All of those are local disks. Several connected via a pcie x4 controller and some on the controller on the motherboard, including the root drive. They are a mix of drives. Some are rather old like 5T drives, some are rather new ssd 17T drives so there is definitely differences in write speed, tho everything is SATA 3 6G.

The lag I was having was not in the viewing, it was strictly in the opening of the app. The tiles would hang or slowly fill in on the home screen. I'll admit at that time I had a rather slow drive as root (wasn't aware how slow until I actually benchmarked with dd, it was reading at only like 75m/s as I was trying to find the problem) Between that being replaced and any updates the wonderful devs have done that problem has largly resolved itself.

It is weird, i dunno if it showed up in that log, but I've occasionally seen it say a directory isn't there when it is...

Something else weird. I have 8 data and 1 root drive. So when I make libraries I usually make a directory on all 8 drives (some I haven't full fleshed yet) but I have at least one library that. when looked at in the libraries page, the library claims 9 directories, yet only 8 are defined if you look inside.

I have just recently turned on the option to keep images and metadata with the media. I wasn't sure if that would be retroactive for the existing media, but I ran a scan and hoped at least lol

As far as metada provider, I think I usually leave the defaults. Right now I looked at the TV LIbrary has theTVDB and the open movie database. A Random movie library has themoviedb and open movie database. Looks like they have nfo checked as well, but as a rule I do not put any nfo's in the dir.

I went to tiny media manager, looks interesting, I will look into it as well.

Direct to theguymadmax, Hello sir I saw your message. Episodes are ok to have spaces, but movies are not?
And I did see the bit about the multiple eps...that's why they work funny lol

I havent had occasion yet to see if the sql worked, as I don't specifically remember the ones I saw before so I'll just have faith that it worked

Would these naming convention issues be the source of some of the crazy errors in the log? I had half considered, just to get things clean, a wipe and fresh install, but then I'd lose all watched data etc. Blargh

Ooh one more update. I was just looking and I have one library that claims 9 dirs, and one that claims 10. Again nothing should claim more than 8

*quick-edit* just changing some verbage and spelling errors

[theguymadmax]

Direct to theguymadmax, Hello sir  I saw your message.  Episodes are ok to have spaces, but movies are not?

Spaces are fine for both. That example was taken directly from the documentation, but from the multiple version section which had it written that way. Generally, movies are more forgiving with naming conventions than TV shows.

Generally for movies:
The Best Movie (2004)
----- The Best Movie – any extra info.ext

For Multiple versions:
The Best Movie (2004)
----- The Best Movie (2004) – version 1.ext
----- The Best Movie (2004) – version 2.ext

Would these naming convention issues be the source of some of the crazy errors in the log? I had half considered, just to get things clean, a wipe and fresh install, but then I'd lose all watched data etc. Blargh

Yes! For example:

Code:

[2024-09-12 00:25:50.035 -04:00] [INF] Starting "/usr/lib/jellyfin-ffmpeg/ffprobe" with args "-analyzeduration 200M -probesize 1G -i file:\"/mnt/MainServer6/Media/British TV/My Family/Season 06/My Family, Series 6, 05 An Embarrassment Of Susans 720p.mkv\" -threads 0 -v warning -print_format json -show_streams -show_chapters -show_format"
[2024-09-12 00:25:50.144 -04:00] [ERR] Episode S06Enull not found for series 0:"My Family, Series 6, 05 An Embarrassment Of Susans"
[2024-09-12 00:25:50.144 -04:00] [ERR] Error in "TheMovieDb"
System.FormatException: The input string '643-my-family' was not in a correct format.
  at System.Number.ThrowFormatException[TChar](ReadOnlySpan`1 value)
  at System.Int32.Parse(String s, NumberStyles style, IFormatProvider provider)
  at MediaBrowser.Providers.Plugins.Tmdb.TV.TmdbEpisodeProvider.GetMetadata(EpisodeInfo info, CancellationToken cancellationToken)
  at MediaBrowser.Providers.Manager.MetadataService`2.ExecuteRemoteProviders(MetadataResult`1 temp, String logName, Boolean replaceData, TIdType id, IEnumerable`1 providers, CancellationToken cancellationToken)

[enesha]

Fair enough. I just inspected that item. The naming is as the log shows, but interestingly in the web it shows that episode list in the, also interestingly they are not in order, but if you get info on that episode it is generic, no info and nothing to play. Ive actually watched that series in the not distant past, but I guess I just never noticed that there were episodes missing.

There is none so blind...

so I shall run tiny media manager and start standardizing things. I just added things blindly and depended on your algorithm, but that does sound stupid now lol.

So I should not have trouble with the server recognizing that the old name was removed?

So those generalities down, what about that dr who 2005 s02 e02 that has two copies? It's super weird in that it made that second by adding a file that was from a different series with a differnt name. even deleting that file the entry still exists in the ui

and thanks for the help so far
or the incorrect number of dirs it thinks are in a library?
I have a lot of stuff so I shall start slowly. I'll fix up the dir names as well, just for conformity.

[theguymadmax]

Sometimes Jellyfin has trouble detecting changes, but a scan and replace of all metadata often resolves the issue. Another useful trick, if media isn't being removed, is to keep the empty folders and place a dummy file inside them.


Ex:
Some deleted TV (2004)
------Season 01
---------randomnamefile
------Season 02
---------randomnamefile


We should create an entire section in the form dedicated to Doctor Who, considering how often it comes up. It would be helpful to provide specific file names for that series. Doctor Who is particularly challenging due to its numerous specials, multi-part episodes, varying series (2005 vs. 2024), and differences between air order and DVD order, not to mention the differences among various scrapers.


Make sure you match your seasons and show names according to the scraper you use, for example:
https://www.themoviedb.org/tv/239770-doctor-who/seasons
Doctor Who (2005) Ended at season 13
Doctor Who (2024):
Season 14 as you have it: Should be a “Specials” folder or “Season 00”.