PageOneX in Ruby on Rails
PageOneX is an open source tool to code, analyze and visualize the evolution of stories on newspaper front pages. PageOneX is an free software/open source software tool designed to aid the coding, analysis, and visualization of front page newspaper coverage of major stories and media events. Newsrooms spend massive time and effort deciding what stories make it to the front page. In the past, this approach involved obtaining copies of newspapers, measurement by hand (with a physical ruler), and manual input of measurements into a spreadsheet or database, followed by calculation and analysis. Some of these steps can now be automated, while others can be simplified; some can be easily shared by distributed teams of investigators working with a common dataset hosted online.
How is your project different from what already exists? Communication scholars have long used column-inches of print newspaper coverage as an important indicator of mass media attention. PageOneX simplifies, digitizes, and distributes the process across the net.
Pageonex is an open-source project. If you don't want to use the hosted version of pageonex at http://pageonex.com you have a few options to run it yourself.
- You can run pageonex locally using docker-compose and our generated images. This is the easiest way.
- You can run pageonex locally using docker-compose and building locally the docker images. This is recommended if you want to do some development.
- You can install pageonex locally compiling in your system all the needed files. This option is more advanced and it is only recommended if you're doing heavy development.
- You can use our Docker images to deploy pageonex against your mysql database. This is an advanced setup that it is useful if you're planning to maintain your own pageonex production environment.
The project has many collaborators. The coders have been/are Ahmd Refat, Edward L Platt, Rahul Bhargava, Rafael Porres and Pablo Rey Mazón. Sasha Costanza-Chock is giving advice and support from the Center for Civic Media; Alfonso Sánchez Uzábal is providing tecnical support and Montera34 the server. Thanks to Jeff Warren for his advice and Rogelio López for his testing.
Join the project
The project has gone through different phases. Initially, this type of data visualization was made through a ‘manual’ process: images of newspaper front pages were downloaded from the web and reorganized in a vector graphics program to draw rectangles on top of them to highlight certain stories.
The first version of an automated tool was a script written in Processing, that downloaded newspapers front pages and generated an organized array of images ordered by date.
The second version is this tool written in Ruby on Rails that you are using. It is developed to be a web platform to provide a ready to use front page analysis tool for anyone with a connection to the Internet. The platform automates the process of newspaper selection, download, thread coding, and data visualization. The alpha version was developed by Pablo Rey Mazón with Ahmd Refat, thanks to Google Summer of Code program 2012 (GSOC) and the Berkman Center as host institution in Summer 2012.
In Winter-Spring 2013, at the MIT Center for Civic Media at MIT Media Lab, we developed with rahulbot and elplatt the first beta version and preparing a stable deployment. rporres developed a web crwer for kisoko.net.
The beta version can be used at PageOneX.com.
Check the documentation of the project at the wiki hosted in this same repository.
In 2016 Sasha Costanza-Chock and Pablo Rey-Mazón published PageOneX: New Approaches to Newspaper Front Page Analysis, we hope it provides an useful guide and resource to the field of the newspapers front page analysis and to clarify the different possible uses of PageOneX.