Log Analysis Project

Purpose is to answer three questions based on data from a postgresql database called news There are three tables:

Column:Type -> author:integer, title:text, slug:text, lead:text, body:text, time:timestamptz, id:integer
8 rows

Column:Type -> path:text, ip:inet, method:text, status:text, time:timestamptz, id:integer
1,677,735 rows

Questions that the program answers

What are the most popular three articles of all time? Which articles have been accessed the most? Present this information as a sorted list with the most popular article at the top.
Who are the most popular article authors of all time? That is, when you sum up all of the articles each author has written, which authors get the most page views? Present this as a sorted list with the most popular author at the top.
On which days did more than 1% of requests lead to errors? The log table includes a column status that indicates the HTTP status code that the news site sent to the user's browser.

Ubuntu users: If you are running Ubuntu 14.04, install VirtualBox using the Ubuntu Software Center instead. Due to a reported bug, installing VirtualBox from the site may uninstall other software you need.

Download it from this link
Windows users: The Installer may ask you to grant network permissions to Vagrant or make a firewall exception. Be sure to allow this.

When vagrant up finishes running and the shell prompt is back, run vagrant ssh to log in to the Linux VM

Files in the VM's /vagrant directory are shared with the vagrant folder on your computer. But other data inside the VM is not.
For instance, the PostgreSQL database itself lives only inside the VM.
If you exit the terminal or reboot the computer, you will need to run vagrant up to restart the VM

Now that you are logged in, run cd /vagrant to gain access to the shared directory
Download the .sql file from here, unzip, put file into same directory as log-analysis.py
Run psql -d news -f newsdata.sql to populate the database
Once the data is loaded, connect to the database using psql -d news and explore the tables using \dt and \d table commands and select statements.
Setup is complete! Now it is time to run the log analysis program I wrote.