Glitch on the ratings system

  • 3
  • Problem
  • Updated 11 months ago
  • Solved
Today an unusual number of movies had a drop in its ratings. Movies with 7.1 dropped to 7.0, movies with 7.0 dropped to 6.9 and so on. And I mean a lot of movies, which obviously points to a glitch, while there were almost no movies with crescent ratings. I know because I have a list of almost 2000 movies and I am constantly observing its ratings movements. Please, take a look and try to fix it. Thanks and sorry for my english.
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
  • frustrated

Posted 11 months ago

  • 3
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
I am an IMDb user for 24 years now. I know what I'm talking about.
Photo of bderoes

bderoes, Champion

  • 2278 Posts
  • 3759 Reply Likes
I've captured  some more data. Using one of my lists with 2600+ titles, I used ATS to look at the 276 titles currently rated 6.9 or 7.0. Using the mouseover data from earlier this week, I identified 51 of the 276 that declined in rating, and 3 that ascended. By exporting them, I've captured the number of votes, so we can look at them again later if needed.
Here's the export:
https://docs.google.com/spreadsheets/d/1y4PBDfYnk1rWIIC_aFoaC0g41Buo1XWbSTK4rPUVbh0/edit?usp=sharing
And here are the lists:
7Aug2019 Titles rated 6.9-7.0
276 titles 
7Aug2019 Titles that dropped this week
51 titles

Angelo, I'd be willing to extract similar data from your list, if you'd like to share its URL.
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
This confirms my suspicion that the ratings system has been altered in some way. What we need to know now is if it is an adjustment made deliberately or if it is an error. If only an IMDb representative could say something about this...
Well...here is my list:
https://www.imdb.com/list/ls070918528/?sort=alpha,asc&st_dt=&mode=detail&page=1
Photo of bderoes

bderoes, Champion

  • 2278 Posts
  • 3759 Reply Likes
Did you remove the 4 films (How to Marry a Millionaire, The Other, Hairspray and The Grifters) from your list, or is there another list where they appeared?

When I restrict this list to the 6.9-7.0 entries (100 of them), I only have mouseover data for 26 of them, and only 1 dropped this week (The Barefoot Contessa (1954) from 7.1 to 7.0).

Looking at the 20 films on that list rated below 6.9, I also found 
The Jazz Singer (1927) dropped from 6.7 to 6.6
The Birth of a Nation (1915) from 6.6 to 6.5
The Broadway Melody (1929) from 6.1 to 6.0
(I only had mouseover data for 9 of them.)

Given that Birth has 20,598 votes, how many votes would need to be under 6 to change the average from (speculating here) 6.45 (which should round to 6.5) to something that rounds to 6.4?  A single vote of 5 changes the average to 6.4499, which Google Sheets (correctly) rounds to 6.4. 

I'll wait to create a sublist until you confirm this is the correct list.

I am getting the itch to update my mouseover data (for other reasons), but am holding off for this thread.
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
This is the list. I have removed those movies to keep a better track of the changes. But you can look which movies had changed from 7.2 to 7.1, 7.3 to 7.2 and so on. 
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
Today two more movies from this list have dropped from 7.0 to 6.9: Nevada Smith and The Mechanic. I've already removed those from the list to keep a better track. It is really serious. 
Photo of Michelle

Michelle, Official Rep

  • 13256 Posts
  • 10636 Reply Likes
Hi Angelo -

I have reported your observations (as well as the other observations mentioned in this thread) to the appropriate technical team who will take a look, as soon as I have further information I will share the updates with you here.
(Edited)
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
Thanks, Michelle!
Photo of bderoes

bderoes, Champion

  • 2278 Posts
  • 3759 Reply Likes
Checked my list of 276 films with rating 6.9-7.0 created yesterday (22 hours ago as of this edit), and updated the spreadsheet to compare today's ratings.

I'm surprised to find that 24 films have changed rating, only 1 of which increased, AND that only 5 had a change in the number of votes:

Updated to show the 6 titles that dropped already this week.
(Edited)
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
Definitely there is a problem with the ratings. 
Photo of Jeorj Euler

Jeorj Euler

  • 7420 Posts
  • 9838 Reply Likes
Maybe a whole bunch of sockpuppet accounts were uncovered and subsequently nuked.
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
No. There is a pattern. The movies which were going up are still going up in a normal pace. The movies which were going down are now going down in a way faster pace than usual. If IMDb don't fix this soon, all the ratings system will be ruined. 
Photo of Jeorj Euler

Jeorj Euler

  • 7420 Posts
  • 9838 Reply Likes
Ruined? But for how long?
Photo of Péter Kaszás

Péter Kaszás

  • 16 Posts
  • 38 Reply Likes
Angelo is absolutely right. I check this website https://250.took.nl/ every single day, it shows how the Top250 changes on a daily basis. And in the last couple of days, I have noticed that instead of 10-15 daily changes, it shows now every day approx. 100-150 changes, which is abnormal. I also noticed, the there is a drop only for old movies.

The list is really long, but just to mention some classics for today (9th of August): Casablanca, Star Wars, City Lights, Alien, Apocalypse Now, Vertigo, Dr. Strangelove, etc. I mean, the chance, that the ratings for all these movies drop on the same day is just simply impossible.

So either there is a failure in the system or someone - or a group - has registered multiple accounts which tasks is to get rid of the old ones from the list. Would be a pity though, if that would be possible.

Please, check it.
Peter


Photo of Marco

Marco

  • 1628 Posts
  • 2073 Reply Likes
And in the last couple of days, I have noticed that instead of 10-15 daily changes, it shows now every day approx. 100-150 changes, which is abnormal. I also noticed, the there is a drop only for old movies.

I noticed the same thing. Old titles that have (almost) always been in the Top 250 are now gone. Perhaps there's no foul play and everything is as it should be, but it is very strange indeed that in a few days all the following titles have been deleted from the Top 250.

The Maltese Falcon (last Top 250 date August 2nd: https://250.took.nl/title/tt0033870)
The Wizard of Oz (last date: August 5th: https://250.took.nl/title/tt0032138)
Jaws (last date August 5th: https://250.took.nl/title/tt0073195)
Les Diaboliques (last date August 6th: https://250.took.nl/title/tt0046911)
The Grapes of Wrath (last date August 7th: https://250.took.nl/title/tt0032551)
Photo of Jeorj Euler

Jeorj Euler

  • 7415 Posts
  • 9825 Reply Likes
Strange for it to happen so quickly.
Photo of sunofabeach78

sunofabeach78

  • 27 Posts
  • 49 Reply Likes
Also The Exorcist, Beauty and the Beast, Donnie Darko, Dog Day Afternoon and others...

If this continues, i'm afraid in the next few days we 'll have to say goodbye to Gandhi, Groundhog Day (both huge drops in the last days), and then maybe Akira, Paris, Texas, Guardians of the Galaxy, Before Sunset, The Terminator...?? :(
Photo of honolulu styles

honolulu styles

  • 66 Posts
  • 100 Reply Likes
hi Angelo, check my thread as well:
https://getsatisfaction.com/imdb/topics/indian-movies-top-250?utm_source=notification&utm_medium=email&utm_campaign=new_reply&utm_content=reply_button&reply[id]=20234321#reply_20234321

i've analyzed the movements in the top 250:
-russian, turkish, and most of all indian and some japanese and old movies went up more than 20 places in 2 weeks (movies that usually dropped a lot of positions in the last months)
-classics dropped more than 20 place while they usually kept the same spot for years.

I've seen that on the weekend (saturday and sunday) we have the same old chart: 10 changes only and the movies follows the "old" scheme
From Monday to Friday in the last 2 weeks looks like a guy is pressing some buttons to make movies go up and down from the list and adjusting their overall vote, weighting manually the vote.
It's a pity and i hope they will solve the issue soon.
I hope this week they won't make a mess again, instead in a month we'll see a whole 250 list filled with unknown Indian movies, while the classics sit outside the chart.

200.took.nl is perfect for analyzing such strange changes in the rating system.

Let's see what they will do... and if they want to give us some answers....
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
Hi, as you could see, the problem isn't affecting only the Top 250, but the whole site. Thousands of movies had suffered a suddenly and abrupt drop on its ratings. It looks like it has stopped now, but the ratings were not restored to the way they were a week ago. I hope they can fix this. 
Photo of MikeTheWhistle

MikeTheWhistle

  • 847 Posts
  • 1134 Reply Likes
I wonder if this is related to this thread where the same user has multiple reviews posted for the wizard of oz.
https://getsatisfaction.com/imdb/topics/how-to-report-a-same-user-profile-who-left-36-reviews-for-1-...

Although because they are rating it 10/10 they might be trying to keep it high, but some others might be using this glitch to lower others and raise others??

Photo of Ed Jones(XLIX)

Ed Jones(XLIX)

  • 23100 Posts
  • 27442 Reply Likes
Been reading all this and it seems to me that a lot of those titles that we loved and rated as the absolute highest number we could give it was a little higher than our older and wiser self is willing to bear. I like others may be downgrading our ratings. I like many individuals that are becoming senior citizens are looking at the limitations that filmmakers of the 30's 40's 50's and 60's in tech available for scene creation. CGI has gotten so good that The Wizard of Oz can't hold a candle to Avatar. A new generation is rating the classics lower and I find myself looking at the Wizard and saying to myself that it is not a movie that rates an 8. Don't get me wrong, I love the Wizard, but it isn't an 8 to me anymore. I had an old account that I can no longer access where I had rated it a 9. I would not rate it today more than a 7. I may not be the only person thinking this same way.


Photo of Jeorj Euler

Jeorj Euler

  • 7420 Posts
  • 9838 Reply Likes
I'm not buying it, but I acknowledge the possibilities.
Photo of MikeTheWhistle

MikeTheWhistle

  • 847 Posts
  • 1134 Reply Likes
I wonder if "regular IMDb voters" (and I assume they aren't referring to fiber diets) has some impact. I don't see a definition of it and assume it's for a reason, but I'd bet depending on how that is defined impacts. I wonder at what point people fall from being regular and newer users become regular.
I hope that imdb has some good statisticians and ORAs that work on this.
Photo of Appraiser1

Appraiser1

  • 255 Posts
  • 263 Reply Likes
I cannot wait for the rating to drop below the 8! What's taking so long with removing the hacker's 19 ten/ten votes? 
Photo of MikeTheWhistle

MikeTheWhistle

  • 847 Posts
  • 1134 Reply Likes
Ed as a fellow senior (although I'm less senior) I have to disagree. Some movies (and shows) are classics regardless of technology. Technology is certainly a facet, but do you rate movies solely on technology?  When I rate a movie I certainly look at tech, but also consider the acting, story, does it make me want to watch it again, something I would want to share, and several other angles I can't express.
I'd bet that I probably rate things more highly than you in general. Maybe it's because I'm not in the biz as you, so my standards are different.
Without looking I'm sure Oz has a 10 from me without looking, and I can't image lowering it. Off the top of my head another title would be Rikki-Tikki-Tavi. Animated nothing like what can be done today (like the Monsters movies), but to me it's simply a great story.
But I have to agree that I do change ratings on titles, but I tend to do so about equally up and down but it's not for what I think are considered "classics" or ground-breakers.
Just some thoughts from a bum.
Photo of Jeorj Euler

Jeorj Euler

  • 7420 Posts
  • 9838 Reply Likes
I do wonder if some older pictures (that were extremely popular or acclaimed in their time) are marked mediocre simply for not being adequately politically correct or something such. To me, politics is like an infection of which the arts-and-sciences world just cannot be rid, likewise the identity politics facet of politics regularly invades other aspects of politics. However, I don't want to conflate political consciousness with simply the inability to identify with protagonists in one particular story or another, so I'm just not sure how various audiences may necessarily view things.
Photo of Appraiser1

Appraiser1

  • 255 Posts
  • 263 Reply Likes
I love old movies and have been wondering what will happen when Millennials discover TCM! I foresee the day where owning their DVDs/streams will be as illegal as raw milk in Milwaukee and they will come, guns drawn, to your house, search your files, leave the child p--n intact and delete Casablanca and Citizen (Kandy) Cane and cuff you and haul you right then and there, in front of your crying kids. 
Photo of Appraiser1

Appraiser1

  • 255 Posts
  • 263 Reply Likes
Uh that was "corporate you". I didn't mean to imply anyone has those ch-p files on their devices. Sorry about that. Point badly made, but you get the point. 
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
I love the classics too, but this is not the point. There is no one doing this "downgrading" manually. It is a glitch or an adjustment on the system. I think it is a glitch because it only affected the movies which were on a falling tendency on the ratings. If it was an adjustment it would affect the movies with crescent ratings too, I think. 
Photo of Appraiser1

Appraiser1

  • 255 Posts
  • 263 Reply Likes
For me, if I had read this page before finding the "Wizard of Oz" obsessed fan, I'd have said it's normal that a movie goes from 7.0 to 6.9. It is not a huge drop in the ratings, (definitely not like going from 8 to say a 5) but I reckon those of you who watch this closely know better than I do. 
(Edited)
Photo of honolulu styles

honolulu styles

  • 66 Posts
  • 100 Reply Likes
Somebody is clearly pushing some buttons to make movies go up and down.
Like I said, the weekend was ok with no huge movements and then.......it's now monday morning in the USA and we can see AGAIN some huge movements in the list.

At 9pm CET we had 10 movements in the top 250 (maximum +2 or -2 places)
At 10.30pm CET we have now 150 movements in the top 250 (maximum +5 places from russian, indian movies AGAIN).

this site is becoming useless. you know any other place with a clear rating system? is there a site where we can have some fun like we had on IMDB til a month ago ?
Photo of Ed Jones(XLIX)

Ed Jones(XLIX)

  • 23097 Posts
  • 27403 Reply Likes
There needs to be an overhaul of the 250 Concept
1. IMDb International Top 250. To qualify, the titles must have been available in multiple languages. Russian, English, Spanish, Japanese, Hindi, & Chinese. (or an agreement of minimum languages) To qualify the titles must be available in the first 3 languages (See agreement mentioned) and at least 2 of the last three. (No Bootleg translations) The country of origin language shall count that are not part of the top 6 languages, but still must be translated into the top 3 languages to be considered.
2. IMDb European Top 250
3. IMDb Middle Eastern Top 250
4. IMDb Former Soviet Bloc Top 250
5. IMDb North American Top 250
6. IMDb Central and South American Top 250 (Can include Spain and Portugal if it makes sense)
(Edited)
Photo of honolulu styles

honolulu styles

  • 66 Posts
  • 100 Reply Likes
Ok and what is the point of eskyia gaining 30 position in 2 weeks while its arithmetic vote dropped down ? The worst votes it gets the higher the titles goes in the top 250
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
Yes, and today two more movies from my list of classics have turn from 7.0 to 6.9: Barabbas and Harper. When the things were normal this was very rare. It usually occured with no more than 5 movies a year. And no answers from IMDb staff yet. 
(Edited)
Photo of Ed Jones(XLIX)

Ed Jones(XLIX)

  • 23100 Posts
  • 27442 Reply Likes
If IMDb has been purging long inactive accounts. The ones that are as old as the database then those votes would disappear. IMDb will probably not admit to it. It is the only logical explanation for these major shifts. Many of those old account I suspect may have a large percentage of the "Top 1000" voters. That would make the voting shift even more as their votes heavily influence the weighted average formula.
Photo of bderoes

bderoes, Champion

  • 2278 Posts
  • 3759 Reply Likes
Here's today's update of my sample of 276 titles which had a rating of 6.9-7.1 on 7Aug.
18 titles dropped, 3 rose.
Notice that only 1 title LOST VOTES, and that is a single vote. 
6 highlighted titles dropped for the 2nd or 3rd time since ~5Aug.
I did monitor the list over the weekend, and nothing changed then; these are all changes as of today.

To see the full spreadsheet, click here.
To see the 92 drops (some titles listed 2 or 3 times, see this list.
Photo of Péter Kaszás

Péter Kaszás

  • 16 Posts
  • 38 Reply Likes
@bderoes thanks for the list, it shows really well that something is not right.
It is strange to see, that the rating of these movies dropped besides having the same number of votes.
Yeah, I believed for a minute the previous explanation stating that inactive accounts have been deleted, which btw would make sense, but than the number of votes should have dropped as well, so obviously there must be a glitch.

IMDB!!!!! PLEASE FIX THE ISSUE!
Photo of Jeorj Euler

Jeorj Euler

  • 7415 Posts
  • 9825 Reply Likes

The following formula is used to calculate the Top Rated 250 titles. This formula provides a true 'Bayesian estimate', which takes into account the number of votes each title has received, minimum votes required to be on the list, and the mean vote for all titles:

weighted rating (WR) = (v ÷ (v+m)) × R + (m ÷ (v+m)) × C

Where:

R = average for the movie (mean) = (rating)

v = number of votes for the movie = (votes)

m = minimum votes required to be listed in the Top Rated list (currently 25,000)

C = the mean vote across the whole report

Please be aware that the Top Rated Movies Chart only includes theatrical features: shorts, TV movies, miniseries and documentaries are not included in the Top Rated Movies Chart. The Top Rated TV Shows Chart includes TV Series, but not TV episodes or Movies.

That appears to be the same as always.
Photo of Péter Kaszás

Péter Kaszás

  • 16 Posts
  • 38 Reply Likes
One more thing. I am not checking the formula iMDB uses regularly.
Did someone notice any change? Or is it the same formula they use for years?
Because that would also explain the change.
Photo of Péter Kaszás

Péter Kaszás

  • 16 Posts
  • 38 Reply Likes
Actually I was never a fan of the idea that "India invades the Top250".
Bollywood creates more movies than Hollywood, still, only like 15-20 of them are present in the Top250. Also, I have seen many terribly rated Indian movies as well, which kinda proves my point.

And for the record, movies like Dangal, Taare Zameen Par, 3 Iditos, Lagaan, Khuda Kay Liye, Swades, Kal Ho Naa Ho, Black, My Name is Khan, Kahaani, Talaash are pure classics as well and they should definitely be listed among the greatests of all time.

On the other hand, as Indians are presumably overrating their moves, we can pretend, that people from other countries sharing this opinion tend to downrating them...which makes the whole thing equal anyway.
Photo of Ed Jones(XLIX)

Ed Jones(XLIX)

  • 23097 Posts
  • 27403 Reply Likes
It cannot be equal. Misconception. India has a population of 1.33 Billion (BILLION)
The combined English speaking population is barely over 500 million or roughly 27-28% of India's. A little tipsy in India's favor. Told you I thought this through thoroughly before replying.
Photo of Péter Kaszás

Péter Kaszás

  • 16 Posts
  • 38 Reply Likes
So you mean, that only English speaking countries watch US movies or what?

Also, only approx. 500 million Indians have Internet access as of today. And how many of them do you think watch movies regularly? Maybe 150 million. And how many of them rate these movies on iMDB? Who knows. But in a few seconds, that number dropped a lot.
Photo of honolulu styles

honolulu styles

  • 66 Posts
  • 100 Reply Likes
Exactly! That's why I think is more a commercial move from IMDB to gain some visibility in India. But since there is an Indian top 250, I don't understand why IMDB have to flood another chart with all these movies..
Photo of Marco

Marco

  • 1628 Posts
  • 2073 Reply Likes
The problem is that we can only speculate. Of course, IMDb can't say too much about this, but I feel they should be able to tell us if they significantly tweaked something in the last two weeks or not.
Photo of MikeTheWhistle

MikeTheWhistle

  • 847 Posts
  • 1134 Reply Likes
First, this thread shows "in progress" and Michelle said above that it's been directed to. Unfortunately that was right before the weekend so then two days passed without action, but hopefully it means that maybe something will be spoken soon.

There are so many good points. If imdb made a change and would just say they made a change (vs we make changes) or say there are external forces at work that they are working on. That would make such a difference. (see para 1 on when that might happen).

But a list that's top 250 "worldwide" is going to have titles from multiple countries and genres. If not now, it's destined to at some time.

And lastly, pretty much everything I've read assumes that Indians are voting high for reasons other than they really like certain movies. I've read where it's cultural pride, but if that were the case I'd expect far more movies to have shifted because that would mean every movie would be rated highly and there's been a change of I believe 15 titles and that would assume a country of 1.3B have only voted high on 15 movies.

Lastly again, a quick search shows that about 500M Indians have internet capable cell phones. So the person that had it down to 150M is shooting too low since imdb is mobile. Who knows, maybe imdb just did a big ad buy in India and lots of mobile users signed up. That too could have caused such an impact and imdb will likely never say anything. I know amazon owns imdb, but certain types of significant actions have to be disclosed (by law) in SEC filings but they will follow in the quarterly and sometimes annual filing. Any true impactful action, which trying to cater more to a country with 1.3B people like India, would require disclosure unless someone likes prison.

Good luck world.
(Edited)
Photo of MikeTheWhistle

MikeTheWhistle

  • 847 Posts
  • 1134 Reply Likes
This article has probably been discussed, but it seemed on point. A quote from it is "... IMDb planned to customize more features for Indian audiences, and reach out to stakeholders in the Indian film-industry about the company's premium product, IMDbPro."

The article is from 12/2018, so one would think about time that they started doing something. If a goal was to expand into India and put imdbpro there, then it would make sense that they would want Indian films in the top 250.

Movie-mad India could overtake U.S. as top user-base - IMDb
https://wdez.com/news/articles/2018/dec/12/movie-mad-india-could-overtake-us-as-top-user-base-imdb/

Photo of MikeTheWhistle

MikeTheWhistle

  • 847 Posts
  • 1134 Reply Likes
And this other one: "Out of total users from 190 countries that access these page, Needham said, 70% are from India."

https://timesofindia.indiatimes.com/business/india-business/india-second-largest-market-for-imdb-founder/articleshow/67064196.cms

Photo of honolulu styles

honolulu styles

  • 66 Posts
  • 100 Reply Likes
that's why they pushing movies: DOLLARS not for QUALITY
Photo of honolulu styles

honolulu styles

  • 66 Posts
  • 100 Reply Likes
Today they forgot to push the button and everything is normal. No huge drops, Indian movies dropping some positions too. Hope it will be like this forever from now on.
Photo of Péter Kaszás

Péter Kaszás

  • 16 Posts
  • 38 Reply Likes
Yeah, you guys have a point there about India being a huge market for IMDB, I admit.
But then how can you explain these changes?

The only reasonable change is Avengers getting ahead of Spiderman.
Photo of honolulu styles

honolulu styles

  • 66 Posts
  • 100 Reply Likes
They finally pushed the button at 10 pm CET. I HAVE seen that in 15 October 2013 til 15 January 2014 a lot of movies like 3 idiots gained like 100 places. I think they are doing the same changing the system to change the whole chart. When I say they push a button is real. I mean they decide which movie deserve to go up or down. There are some common points. Us movies, super heroes movies, the major part of old movies go down. Non English movies, the lion king go up. Now the list of USA movies is under 150 (-10 in 2 weeks) .. let's see if they stop pulling out movies random.
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
I don't think so, because it is happening with movies with under 500 votes too. This is not a "top 250" thing. 
Photo of sunofabeach78

sunofabeach78

  • 27 Posts
  • 49 Reply Likes
"I don't think so, because it is happening with movies with under 500 votes too. This is not a "top 250" thing."

You are right that it's happening all over the database, it's just that it's more obvious in the Top 250 list, where everybody can see and compare more easily.
Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
Exactly. 
Photo of sunofabeach78

sunofabeach78

  • 27 Posts
  • 49 Reply Likes
"This is the day that both Gandhi and Groundhog Day have been fallen off the Top 250 after being there for, well, ever since it all started: https://250.took.nl/title/tt0107048 and https://250.took.nl/title/tt0083987

The lack of communication on IMDb's part doesn't help of course."

Marco, this is what i replied to a previous message of yours, 2 days ago:

"Also The Exorcist, Beauty and the Beast, Donnie Darko, Dog Day Afternoon and others...

If this continues, i'm afraid in the next few days we 'll have to say goodbye to Gandhi, Groundhog Day (both huge drops in the last days), and then maybe Akira, Paris, Texas, Guardians of the Galaxy, Before Sunset, The Terminator...?? :("

Unfortunately, today that indeed happened...
And the favouritism of Indian movies continues as well.

Photo of Angelo Pilla

Angelo Pilla

  • 184 Posts
  • 273 Reply Likes
Today was the worst day of all. FIVE movies from my list of classics have fallen from 7.0 to 6.9. It usually happens with five movies a YEAR, not a day. This is terribly serious. To me it is a glitch that the technical team cannot fix. Or don't care. Anyway, IMDb is going to an end. And I mean it. Soon there will be no more classics above 7.0.
The movies:
Treasure Island (1950) 6,085 votes
Spider Baby or, the Maddest Story Ever Told (1967) 5,407 votes
Harper (1966) 7,530 votes
Thoroughly Modern Millie (1967) 5,443 votes
Up in Smoke (1978) 33,804 votes

(Edited)
Photo of bderoes

bderoes, Champion

  • 2278 Posts
  • 3759 Reply Likes
Below find the 24 drops that occurred today in my 276-title sample. I've added a column to show the number of changes since ~5Aug. I found no changes on the list yesterday. Please see my prior post for links to the spreadsheet and the lists.

Please recall that this thread began as a concern about middle-rated (7.0) films, not about the top 250 films.

Let's take the 1932 film Wonder Bar (tt0026007) as an example.
It has dropped twice since 7Aug from 6.9 to 6.7, with no change in the number of votes (536), which could be from the number of lost votes matching the number of gained votes.
On 7Aug, it had a rating of 6.9, which could have meant an average as low as 6.85.
On 14Aug, it has a rating of 6.7 (it dropped 0.1 on a day in between), which can mean an average as high as 6.749.
So it dropped at least a full 0.1 points, with 536 votes. In other words, it lost at least 53.6 "ratings points" (if the average were unweighted).
Those lost "ratings points" would need to be from either multiple voters downscaling their vote, and/or some sort of IMDb intermittent update of whose votes are counted more heavily in the weighting. ...or... multiple changes in the calculation itself???
A title with this few votes seems an unlikely candidate for the number of vote changes required to drop so much in such a short period of time. And yet there are 25 titles in my sample that have also experienced a drop since ~5Aug. 94 titles total from the 276 have experienced 116 drops.
I hope IMDb will soon explain what is happening. 
Meanwhile, I'm going to export my ratings, in case hacking turns out to be the cause.


(Edited)
Photo of sunofabeach78

sunofabeach78

  • 27 Posts
  • 49 Reply Likes
"So it dropped at least a full 0.1 points, with 536 votes. In other words, it lost at least 53.6 "ratings points" (if the average were unweighted).
Those lost "ratings points" would need to be from either multiple voters downscaling their vote, and/or some sort of IMDb intermittent update of whose votes are counted more heavily in the weighting. ...or... multiple changes in the calculation itself???"

I, too, think this is what's happening: IMDB is making changes to its "regular voters" basis, by removing and adding members to it, and/or is changing the calculating formula that uses to determine the weighted average.

"I hope IMDb will soon explain what is happening."

I really hope that too, but i seriously doubt it... 

Photo of Michelle

Michelle, Official Rep

  • 13256 Posts
  • 10636 Reply Likes
Hi All -

Thank you for all your additional examples and comments.

Our voting system is constantly being improved and the formulas used to calculate the ratings and charts are tweaked regularly in order to improve our ability to detect and defeat ballot stuffing and other attempts to influence the results.

Weighted ratings are frequently recalculated, so when the formula is changed, the ratings may also change even without the addition of many votes. The changes you are seeing are normal and result from this periodic fine tuning of the weighing mechanism.
Photo of Ed Jones(XLIX)

Ed Jones(XLIX)

  • 23100 Posts
  • 27442 Reply Likes
I think I have said that already.
Angelo................The Sky is Not Falling!
They are implementing worldwide weather control.
That is bound to take a little bit of tweaking over a specific period of time.
It's not a flip a switch and it's fixed thing!
They are fooling around with the tweaks and seeing the results of those tweaks and going.........WELL THAT didn't work! Lets try this.
Give it time.
Following this during this tweaking period will just drive you nuts.
Wait for the end result when the numbers stabilize.
That may be in a day or 6 months or a year. Who knows!
Photo of Marco

Marco

  • 1628 Posts
  • 2075 Reply Likes
Following this during this tweaking period will just drive you nuts. Wait for the end result when the numbers stabilize.

I think that's the best (and only) thing to do. We'll see in a few weeks what the situation is.
Photo of Marco

Marco

  • 1628 Posts
  • 2075 Reply Likes
Following this during this tweaking period will just drive you nuts. Wait for the end result when the numbers stabilize.

I think that's the best (and only) thing to do. We'll see in a few weeks what the situation is.
Photo of sunofabeach78

sunofabeach78

  • 27 Posts
  • 49 Reply Likes
"Our voting system is constantly being improved and the formulas used to calculate the ratings and charts are tweaked regularly in order to improve our ability to detect and defeat ballot stuffing and other attempts to influence the results."

So, all these years there was BALLOT STUFFING for all these great/classic movies (Gandhi, Groundhog Day, The Maltese Falcon, Jaws, Grapes of Wrath, Les Diaboliques, The Exorcist etc), so they had to have HUGE falls and be removed from the Top 250.
And they had to be replaced by Indian movies only, because as we all know, Indian movies are the only movies in the world that ballot stuffing is not happening in IMDB.
Yeah, right...

"The changes you are seeing are normal and result from this periodic fine tuning of the weighing mechanism."

Even if this is the case and it's just a "fine tuning", then how come the vast majority of all categories of movies have both rises and falls (but mostly falls, huge in some cases) and then there is ONE category, Indian movies, that has only rises, huge in some cases?

You call this "fine tuning"?? I think it's better called "FAVOURITISM".
Photo of honolulu styles

honolulu styles

  • 66 Posts
  • 100 Reply Likes
Today.. 178 changes.
Non us or uk movies go only up.
Movies in the chart for 20 years losing 15 places in a single day..but yeah it's normal.
By the way, somebody not from India has ever know the movie "sholay"? I think you heard that name only in this list. None of the critics in the world know about that.
But hey it's better than Donnie darko and jaws and a bunch of classics for IMDB.
Photo of bderoes

bderoes, Champion

  • 2278 Posts
  • 3759 Reply Likes
Link to my prior data post.

Among my sample of 276 titles, today 33 dropped and 1 gained.
14 of the drops had dropped previously (highlighted in yellow).
One title, Hollywood Revue of 1929, dropped from 6.6 to 6.3; it's also had the most drops. The others were all 0.1 drops.

continued (Showing My Favorite Brunette on both pieces to confirm I didn't skip something):


Links:
Spreadsheet:
https://docs.google.com/spreadsheets/d/1y4PBDfYnk1rWIIC_aFoaC0g41Buo1XWbSTK4rPUVbh0/edit?usp=sharing
List of full sample:
https://www.imdb.com/list/ls048810523/
List of the drops:
https://www.imdb.com/list/ls048878764/
Since ~5Aug, among my 276-title sample,
110 titles have dropped, with a total of 149 drops.
7 titles had an increase in rating; 1 title increased then decreased back to the original average.

The Hitch-Hiker gained 31 votes since 7Aug.  I'm thinking film studies class.
(Edited)
Photo of Chris

Chris

  • 59 Posts
  • 130 Reply Likes
The one thing IMDB had going for it was consistency before the Amazon behemoth took it over.  Now who knows what they're going to change next.  You might be fine with that they're doing right now with the list feature, interface, the rating feature, etc.  But just wait until they change something you've always like then you'll be changing your tune.

This latest rating "tweek" puts less faith in IMDB's features not more.  People want reliability not drastic arbitrary changes just the sake of changes.  Right now I don't believe any score on IMDB reflects anything if they finally found after decades that something was wrong or should have been improved.  Maybe Shawshank isn't even a top 10 film for all we know.  They might find some new algorithm that shows that IMDB users don't even rate it a top 100 film in a few years.  Who knows at this point its anyone's guess.  I know Rotten Tomatoes has been pretty consistent and honest with their critics average ratings at least.
Photo of bderoes

bderoes, Champion

  • 2273 Posts
  • 3736 Reply Likes
As Amazon.com subsidiary (1998–present)
In 1998, Jeff Bezos, founder, owner, and CEO of Amazon.com, struck a deal with Needham and other principal shareholders to buy IMDb outright for approximately $55 million and attach it to Amazon as a subsidiary, private company.
IMDb - Wikipedia
Photo of MikeTheWhistle

MikeTheWhistle

  • 847 Posts
  • 1134 Reply Likes
I just looked at RT's top 100 movies of all time. I don't like that list either. Can I please have a #3 with fries?
Photo of Ed Jones(XLIX)

Ed Jones(XLIX)

  • 23097 Posts
  • 27403 Reply Likes
No Pickles or Onions, with Bacon please. Easy on the ice!
Photo of Jeorj Euler

Jeorj Euler

  • 7415 Posts
  • 9825 Reply Likes
They have already downgraded things that I did not like being downgraded, so I'm spent, so to speak. IMDb was rolling strong for the first eighteen years after Amazon and IMDb partnered. We could say that it is still rolling strong but yet in a completely different way from the earlier trend.
Photo of MikeTheWhistle

MikeTheWhistle

  • 847 Posts
  • 1134 Reply Likes
Look at it this way, IMDB decided that the new market offered better profit than the old market.  Dec 2018 articles indicate they very much want to expand into India. It took about 6 months to cause the impact and I think what happened is "new" "regular" raters expanded causing the existing raters weights to be lowered (explains why no vote change but lower rating).

What they did is a common occurrence for companies when they try to expand into a new market that is different than their current market. Maybe it will be good for imdb, or maybe it'll be like when Starbucks wanted to expand into Australia and it failed miserably.

There are other top 250 lists, so one just needs to find one that fits them. Perhaps imdb will do something with their top's lists to help accommodate those that have been their loyal customers.
Photo of Chris

Chris

  • 59 Posts
  • 130 Reply Likes
This reply was created from a merged topic originally titled IMDB ratings issue.

Hello, there seems to be an issue with some titles on the IMDB.  See below.  The title was a 7.1 user rating as you can see by the arithmetic mean but is now a 6.1 just a few days later.



Other titles with a strange ratings discrepancies:
https://www.imdb.com/title/tt0019788/ratings?ref_=tt_ql_op_4
https://www.imdb.com/title/tt0006333/ratings?ref_=tt_ql_op_4
https://www.imdb.com/title/tt0004181/ratings?ref_=tt_ql_op_4
https://www.imdb.com/title/tt0018618/ratings?ref_=tt_ql_op_4
https://www.imdb.com/title/tt0004707/ratings?ref_=tt_ql_op_4
https://www.imdb.com/title/tt0018440/ratings?ref_=tt_ql_op_4
https://www.imdb.com/title/tt0012675/ratings?ref_=tt_ql_op_4
https://www.imdb.com/title/tt0024067/ratings?ref_=tt_ql_op_4

And many others.  Not sure if something was accidentally deleted or added to the rating algorithm.  I believe this was a recent change/glitch.  Seems to be on a lot of silent films but other films as well.

Photo of Péter Kaszás

Péter Kaszás

  • 16 Posts
  • 38 Reply Likes
@Chris, you mean people from the US don't have access to entertainment from other countries, right? Because I guess they are not really interested in movies from other countries.

But rest assured, other countries (mainly EU) do know whether a very good movie was released in Mexico, Poland or South Korea. In the era of Internet, i wouldn't say something like people don't know about movies simply because their cinemas don't play them.
Photo of Ed Jones(XLIX)

Ed Jones(XLIX)

  • 23100 Posts
  • 27422 Reply Likes
Ever hear of a language barrier? Also there may also be no granted rights. I have tried to view certain UK titles only to be denied "ON" the internet, that streaming rights were not available in your location!
Photo of Chris

Chris

  • 59 Posts
  • 130 Reply Likes
One thing that they may also be doing is purging the really old votes with accounts that haven't been active in a really long time.  Perhaps assuming either new accounts were created or they died of old age or something along those lines.  Which is why you're seeing mostly the older films shrink in ratings over newer films.
Photo of Chris

Chris

  • 59 Posts
  • 130 Reply Likes
One thing that they may also be doing is purging the really old votes with accounts that haven't been active in a really long time.  Perhaps assuming either new accounts were created or they died of old age or something along those lines.  Which is why you're seeing mostly the older films shrink in ratings over newer films.
Photo of bderoes

bderoes, Champion

  • 2278 Posts
  • 3745 Reply Likes
Chris, 
While it's certainly possible that IMDb is purging old accounts, my 276-title sample does not support that conjecture. Only 1 title has lost votes between 7Aug and 21Aug. Lots of titles changed rating without a visible change in votes (of course, it could be that a new vote arrived to replace a purged vote). Here's a summary of changes since my last data post on 15Aug. The summary is copied from this list description: 7Aug2019 Titles that dropped since ~5Aug, which I've been updating daily.
16Aug: 3 drops
17Aug: 16 dropped; 1 rose: Gilda Live (1980)
20Aug: no changes since 17Aug
21Aug: 11 dropped; 3 rose: Night Nurse (1931), Ma and Pa Kettle at the Fair (1952), The Kettles in the Ozarks (1956)

Here's the spreadsheet so you can view the change (and lack thereof) in votes.
From the spreadsheet (currently sorted by the change in wtd avg since 7Aug), we have 100 titles down, and 8 titles up.
25 of the drops had no change in votes, as did 3 of the rises.

Feel free to make a copy of the spreadsheet to play with the data yourself:
File > Make a Copy.