Skip to content
Download data from IMDB movies and parse into useful form
Branch: master
Clone or download
Pull request Compare This branch is even with hadley:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.gitignore
00-download.sh
01-movies.sql
02-import.rb
03-export.rb
readme.md

readme.md

The internet movie database, imdb.com, is a website devoted to collecting movie data supplied by studios and fan. It claims to be the biggest movie database on the web and is run by amazon. More about information imdb.com can be found online, including information about the data collection process.

IMDB makes their raw data available. Unfortunately, the data is divided into many text files and the format of each file differs slightly. To create one data file containing all the desired information these ruby scripts extract the relevant information and store in a database. Finally, this data is exported to csv to make it easier to import into data analysis packages.

The following text files were downloaded and used:

  • business.list. Total budget
  • genres.list. Genres that a movie belongs to (eg. comedy and action)
  • movies.list. Master list of all movie titles with year of production.
  • mpaa-ratings-reasons.list. MPAA ratings.
  • ratings.list. IMDB fan ratings.
  • running-times.list. Movie length in minutes.

Movies were selected for inclusion if they had a known length and had been rated by at least one IMDB user. The final output contains the following fields:

  • title. Title of the movie.
  • year. Year of release.
  • budget. Total budget (if known) in US dollars
  • length. Length in minutes.
  • rating. Average IMDB user rating.
  • votes. Number of IMDB users who rated this movie.
  • r1-10. Distribution of votes for each rating, to mid point of nearest decile: 0 = no votes, 4.5 = 1-9$%$ votes, 14.5 = 11-19$%$ of votes, etc. Due to rounding errors these may not sum to 100.
  • mpaa. MPAA rating.
  • action, animation, comedy, drama, documentary, romance, short. Binary variables representing if movie was classified as belonging to that genre.
You can’t perform that action at this time.