Oversight Scraping of new IMDB format - use mobile option

[lordy]

[This is fixed now - ignore instructions below ]
Due to recent imdb changes scraping is not working correctly in Oversight.

Symtoms include:

- "Imdb" appearing in Movie Titles.
- Tv shows classified as movies.


I plan to fully address this in the next release.

In the meantime:

1. Ensure you are running the latest Oversight 2beta version.
2. change the source to the mobile website: Oversight -> Setup -> Scraping -> IMDB Source -> Mobile
to fix the titles (although you may not get cast listings and certification displayed is just for USA)

---

A bit of background:

Just before the last release of Oversight I noticed the new page format in firefox.
I wasnt able to scrape this page easily but I could look at the source in Firefox and made some untested changes that should have coped with the new format.
(wish I had known about the labs.imdb.com at the time then I could have tested it more thoroughly - I also suspect the actual html has changed from the one I tested against)

I also added scraping from mobile.imdb.com (although this will lack some information - eg certification is just USA)

The last release of Oversight incorporated mobile.imdb.com and untested new format for imdb.

I'm currently doing some i18n changes whilst also trying to make oversight less reliant on IMDB generally, that needs a fair bit of coding at the moment.

I hope that this will be out in a week or two. In the mean time it's probably best to use the mobile imdb.com option.

[xua]

Thanks a lot.

Mobile is working much better that the desktop imbd. Actualy there is only one problem: it is NOT scraping the ratings field. With mobile all movies have 0 for rating.

Thanks

[Atinkler]

Hi lordy. I know you have your hands full with the new release but I was wondering if you have an update on the imdb situation? I'm missing my ratings and stuff like that on oversight

[lordy]

(01-22-2011 08:36 PM)Atinkler Wrote:  Hi lordy. I know you have your hands full with the new release but I was wondering if you have an update on the imdb situation? I'm missing my ratings and stuff like that on oversight

That should all be fixed in the alpha release. See alpha release thread for more.
There is still some work before this becomes a proper release.
Mainly a Drop-Down list selector for different alphabets.

If you are using the alpha and are seeing any issues with IMDB pleaser report here.
Cheers,
Lordy