PMM does not find any movie based on IMDb Charts | Kometa | Page 1

white ledgeBOT Jun 28, 2023, 10:10 PM

#

Welcome!

Someone from <@&938443185347244033> will assist when they're available.

Including the meta.log from the beginning is a huge help, type !logs for more information.

#

You can press the "Close Post" button above or type !close at any time to close this post.

white ledgeBOT Jun 28, 2023, 10:10 PM

#

white ledge You can press the "Close Post" button above or type `!close` at any time to clos...

opal coral Jun 28, 2023, 10:17 PM

#

that should be all that's required.

You probably want to delete that config as it has all your tokens in it.

#

ORIGINAL:
Installed PMM from scratch today. I have (for testing purposes) just a small library of 4K Movies. I just left the "imdb" default in the config.yml file.

When I run the script, no movies are found for Popular, IMDB Top 250 or Lowest Rated. I am certain that I have movies that are in the Top 250 in my library. Is there any particular configuration that is needed in Plex for this to work?

I have attached both the meta.log and the config.yml

📎 meta.log

#

@minor needle

#

The meta.log contains a redacted copy of the config.

minor needle Jun 28, 2023, 10:21 PM

#

opal coral that should be all that's required. You probably want to delete that config as ...

Thank you for deleting the original message. Is there any additional information that you would need to investigate the issue?

opal coral Jun 28, 2023, 10:21 PM

#

Perhaps try a run with --trace I can't see any obvious problems there.

minor needle Jun 28, 2023, 10:21 PM

#

Will do and provide a new log

knotty saddleBOT Jun 28, 2023, 10:21 PM

#

"provide log" command detected, if you need more information on how to provide log files, type !logs

minor needle Jun 28, 2023, 10:26 PM

#

Here is the new log

📎 meta.log

#

Is PMM looking for the movies based on name or on IMDb ID?

opal coral Jun 28, 2023, 10:28 PM

#

It used the TMDB id as the interchange ID.

minor needle Jun 28, 2023, 10:31 PM

#

Do I need any particular configuration in Plex in order for this to work? For example, I have "The Dark Knight" in my library, and it seems to have the correct id, but PMM does not find it

opal coral Jun 28, 2023, 10:31 PM

#

Shouldn't. Are you using some oddball agent in Plex?

minor needle Jun 28, 2023, 10:32 PM

#

Plex Movies

#

Not the Legacy one

opal coral Jun 28, 2023, 10:32 PM

#

Then not that

#

Looks like this might be new breakage.

#

Same thing's happening here.

#

and I'm on nightly, not latest.

#

Probably something changed on the IMDB side, since this code hasn't changed on the PMM side for some time.

minor needle Jun 28, 2023, 10:37 PM

#

That makes sense. Please let me know if there is anything you need me to do and/or test to help resolve the issue. Thanks

opal coral Jun 28, 2023, 10:37 PM

#

| Processing IMDb Chart: Top 250 Movies                                                              |
| https://www.imdb.com:443 "GET /chart/top HTTP/1.1" 403 None                                        |

That would do it.

Nothing to do but wait for IMDB to get their ducks in a row.

minor needle Jun 28, 2023, 10:38 PM

#

If I understand correctly, even though you can access the top 250 via a browser, you cannot via API?

opal coral Jun 28, 2023, 10:39 PM

#

Well, though, that works in a browser. I wonder if they changed something...

#

curl -fLv https://www.imdb.com/chart/top gets a 403...

#

For that matter so does curl -fLv https://www.imdb.com/ Doesn't really feel intentional

minor needle Jun 28, 2023, 10:43 PM

#

without the -flv the command works

opal coral Jun 28, 2023, 10:44 PM

#

not here

minor needle Jun 28, 2023, 10:45 PM

#

That's strange. From the terminal in Windows 11 the command works

chilly fox Jun 28, 2023, 10:45 PM

#

idk if it matters but

curl -sI https://www.imdb.com -o/dev/null -w '%{http_version}\n'
2

#

its serving http2

#

not 1.1

opal coral Jun 28, 2023, 10:47 PM

#

if I add a user agent all is well

curl -A "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36" https://www.imdb.com/chart/top

#

apparently any user agent:

curl -A "ozzy-tony-geezer-bill" https://www.imdb.com/chart/top

minor needle Jun 28, 2023, 10:49 PM

#

So this is something that would need to change in the PMM code?

chilly fox Jun 28, 2023, 10:49 PM

#

they probably added this to deter scraping

chilly fox Jun 28, 2023, 10:49 PM

#

minor needle So this is something that would need to change in the PMM code?

yes

minor needle Jun 28, 2023, 10:50 PM

#

OK, thanks

#

Does that mean that I would have to wait until the next release?

fiery dawn Jun 28, 2023, 10:52 PM

#

Likely or maybe IMDb will fall back to when things worked…but no real clue at this point

opal coral Jun 28, 2023, 10:52 PM

#

well, until the next nightly anyway, or patch your local files.

minor needle Jun 28, 2023, 10:54 PM

#

If you can provide me with a patch I am happy to apply it, I really want to use PMM against my complete library (9k movies), and having IMDb Top 250 and othe charts is important to me. Thanks

opal coral Jun 28, 2023, 10:54 PM

#

You could try creating or finding mdblist or trakt equivalents.

minor needle Jun 28, 2023, 10:55 PM

#

Yes, thanks! I will look into those

opal coral Jun 28, 2023, 11:06 PM

#

I'm heading to bowling, but here's something totally untested:

at about line 220 of modules/imdb.py:

this:

        return self.config.get_html(f"https://www.imdb.com/{url}").xpath("//div[@class='wlb_ribbon']/@data-tconst")

to

        some_headers = {
            'User-Agent': 'something-not-nothing',
        }
        return self.config.get_html(f"https://www.imdb.com/{url}", headers=some_headers).xpath("//div[@class='wlb_ribbon']/@data-tconst")

minor needle Jun 28, 2023, 11:21 PM

#

Thanks, I will try this also

minor needle Jun 29, 2023, 11:31 AM

#

@opal coral , sorry for the daly, I was not able to test more yesterday. I have just tested and that patch did not make a difference

opal coral Jun 29, 2023, 12:37 PM

#

Well, I did come up with it in a couple minutes.

minor needle Jun 29, 2023, 2:46 PM

#

In the meantime, I found a IMDb Top 250 based on mdblist, and I am proceeding with my configuration

#PMM does not find any movie based on IMDb Charts