Provisional IMDb Stats update (@ACT_1) and Birth dates search (@bderoes)

  • 1
  • Praise
  • Updated 2 years ago
Hey, ACT_1:



(Since Col has closed the previous thread because, I guess, it was going off-topic, I'll try to give you a quick update on IMDb numbers; I hope that official Stats page will be rebuilt on the new technology soon)

New tsv files are vastly less informative than former list files, but many basic numbers can be retrieved from them.

From title.basics.tsv and name.basics.tsv (27 Apr 2018):

TOTAL TITLES: 4,963,640 (year range: 1874-2125)

    By type:

          Film: 483,967

          Short film: 618,077

          Video: 198,292

          TV movie: 124,700

          TV short: 8,364

          TV special: 10,729

          Series (parent): 145,688

          Miniseries: 22,295

          Episode: 3,330,222

          Videogame: 21,306


    By genre:
       (tsv file only offers up to 4 genres per title, yet we know that actually over 24,000 titles
        have 5 or more genres attached, so the following numbers are a bit underestimated)

          Action: 212,199
          Adventure: 176,860
          Adult: 145,700
                Oddly, 83 titles (such as Anal Empire 5, Dripping Creampies 4 or
                      White Bitch Sandwich 5) have the Adult genre, but are identified as
                      "non-adult titles" according to the boolean field isAdult ()
          Animation: 260,286
          Biography: 60,760
          Comedy: 1,080,819
          Crime: 226,884
          Documentary: 512,811
          Drama: 1,238,313
          Family: 352,590
          Fantasy: 95,988
          Film-Noir: 768
          Game-Show: 172,956
          History: 67,705
          Horror: 93,272
          Musical: 37,702
          Music: 263,378
          Mystery: 107,142
          News: 348,702
          Reality-TV: 243,568
          Romance: 424,334
          Sci-Fi: 73,394
          Short: 688,266
          Sport: 103,065
          Thriller: 86,944
          Talk-Show: 467,764
          War: 21,575
          Western: 25,180


    By year:
      



TOTAL NAMES: 8,573,409 (total credits unavailable)

    By primary profession:
       (tsv file only offers up to 3 professions per name, so people with 4 o more frequent roles
        may cause the following numbers to be an underestimation too; note that, unlike IMDb
        Stats page, these numbers count people, not credits)

          Actress: 2,077,042
          Actress: 1,229,310
          Animation department: 136,496
          Art department: 306,231
          Art director: 64,068
          Assistant: 2,704
          Assistant director: 172,536
          Camera department: 528,912
          Casting department: 37,737
          Casting director: 21,906
          Cinematographer: 243,471
          Composer: 207,768
          Costume department: 101,607
          Costume designer: 53,725
          Director: 466,941
          Editor: 230,387
          Editorial department: 125,140
          Electrical department: 1
          Executive: 22,653
          Legal: 2,781
          Location management: 51,896
          Make-up department: 151,494
          Manager: 9,373
          Miscellaneous: 952,138
          Music department: 161,633
          Producer: 756,897
          Production department: 2
          Production designer: 57,099
          Production manager: 142,727
          Publicist: 2,868
          Script department: 1
          Set decorator: 38,391
          Sound department: 270,807
          Soundtrack: 120,469
          Special effects: 49,785
          Stunts: 61,885
          Talent agent: 9,651
          Transportation department: 65,516
          Visual effects: 149,720
          Writer: 580,743


    By birth year and death year:
      
      


    By birthday and deathday:
       (in fact, these graphics come from biographies.list [22 Dec 2017] because the tsv file only
        gives birth/death years, not months nor days, but, just for fun after reading this thread, I'd
        like to post it here)
      
      
Photo of ljdoncel

ljdoncel, Champion

  • 865 Posts
  • 1850 Reply Likes

Posted 2 years ago

  • 1
Photo of ljdoncel

ljdoncel, Champion

  • 865 Posts
  • 1850 Reply Likes
@bderoes:
You're absolutely right that, if we rely on Advanced Name Search to find out the earliest-born person on , we'll end up thinking that it's this one (who, piquantly enough, has wrong birth date and place), when we positively know that (using your same example) Homer's birth occurred much earlier...



Moreover, not only BC dates aren't searchable, but neither are any date that doesn't match the YYYY format (e.g. circa dates), as in Larry Abbott (I)'s birth date. When doing an ATS search for people born in 1936 (or within the range 1935-1937), his name isn't one of the results, although the birth info is there in both his name page and update form.



Besides incompleteness, another downside of the tsv files is that their data are "less pure" than list files's; I mean, info provided by list files seemed to come from the very inners of the database, so that every data (either displayed/visible or "hidden" within the update form) was available. In other words, list files were "raw pieces" from the source, so investigating most errors was viable. On the other hand, tsv files are processed fragments that, in many cases, don't allow us to reach the root of the problem. If we look for the birth dates of Homer (I) and Larry Abbott (I) in the tsv archive, they show up as missing values (/N)...



...but if we explore the latter list file, ta-da!...


As of 27 Dec 2017, 16 people have BC birth or death dates listed. Homer (I) is, indeed, the earliest-born person on (c. 850 BC - c. 800 BC), followed by Aesop (I) (c. 620 BC - c. 560 BC), Lao-Tse (604 BC - 531 BC), Confucius (551 BC - 479 BC), Aeschylus (525 BC - 456 BC), Sophocles (496 BC - 406 BC), Euripides (c. 484 BC - 406 BC), Socrates (II) (c. 470 BC - 399 BC), Aristophanes (I) (c. 450 BC - c. 388 BC), Xenophon (430 BC - 354 BC), Plato (I) (427 BC - 347 BC), Titus Maccius Plautus (254 BC - 184 BC), Gaio Giulio Cesare (100 BC - 44 BC), Publius Vergilius Maro (70 BC - 19 BC), Ovid (43 BC - AD 17) and Philo Judaeus (20 BC - AD 50). Neither of them appears on a search filtered by date.

Same happens with another 1,572 people who have circa dates. I'll leave their names here just in case any fellow contributor (we miss you, Lina) would like to research the exact birth or death dates, so these people finally stop being invisible to the search engine.



       ► PDF file (968 KB) here
Photo of bderoes

bderoes, Champion

  • 1742 Posts
  • 2863 Reply Likes
Advanced name search:
Males/Females (Sorted by Birth Date Ascending)
1-50 of 4,982,828 names. | Next »

versus your finding  TOTAL NAMES: 8,573,409 (total credits unavailable)

I can't see how to make ANS find all people.
This is akin to my discovering that we cannot search for titles with fewer than 5 votes (reported). The number of votes field doesn't get populated until 5 are tallied, and a blank field is not interpreted as 0.
Photo of Marco

Marco

  • 1373 Posts
  • 1749 Reply Likes
Same happens with another 1,572 people who have circa dates. I'll leave their names here just in case any fellow contributor (we miss you, Lina) would like to research the exact birth or death dates, so these people finally stop being invisible to the search engine.
As always you've created an extremely useful list ljdoncel! I can't help out here (Lina sure is missed!), but I did notice that both Jim Kid and Jim Kidd (I) have the exact same date of birth and death: https://www.imdb.com/name/nm0452208/ and https://www.imdb.com/name/nm1130112/. Perhaps someone can try to fix this?
Photo of ljdoncel

ljdoncel, Champion

  • 865 Posts
  • 1850 Reply Likes
Jim Kid and Jim Kidd (I) have the exact same date of birth and death
Fantastic catch, Marco! Thank you very much...

And, of course, here's what you're expecting now...

As of 27 Dec 2017, there were 6 trios and 731 couples who share exact same dates of birth and death (I've only checked people with complete records [day, month, year]). A quick look at the list reveals lots of potential duplicates that should be considered for merging.



       ► PDF file (768 KB) here


Photo of Col Needham

Col Needham, Official Rep

  • 6866 Posts
  • 4902 Reply Likes
New tsv files are vastly less informative than former list files, but many basic numbers can be retrieved from them.
We saw your comment last week and you should have received an email offering full access to the data set (much more than available previously).  Did you receive the message?
Photo of ljdoncel

ljdoncel, Champion

  • 865 Posts
  • 1850 Reply Likes
Ooops, sorry, Col, I hadn't read the mail... I'm checking it right now. Thank you!