Skip to content

araftery/Gov-2430-Web-Scraping-Assignment

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Description of Files

  • montana.py - Script to scrape precinct location for voters in Montana. Uses Mechanize to submit the form and BeautifulSoup to parse the result.
  • nebraska.py - Script to scrape precinct location for voters in Nebraska. Uses Mechanize to submit the form and BeautifulSoup to parse the result. Unfortunately, since the HTML on the page seems to be broken, Mechanize has trouble parsing it and throws an exception. As an alternative, I wrote two additional scripts for Nebraska using Requests and Selenium respectively.
  • nebraska_requests.py - Script to scrape precinct location for voters in Nebraska. Uses Requests to submit the form by directly posting the relevant data to the page, and BeautifulSoup to parse the result. Luckily, this one works.
  • nebraska_selenium.py - Script to scrape precinct location for voters in Nebraska. Uses Selenium to submit the form and BeautifulSoup to parse the result. This one works too, despite the broken HTML.

Requirements

To install the required libraries for this repo, execute:

pip install beautifulsoup4==4.4.1 requests==2.8.1 selenium==2.52.0 mechanize==0.2.5

Results

  • Montana
    • Example output:
    Example: Richard Hill, DOB: 12/30/1946
    HELENA VALLEY COMMUNITY CENTER
    3553 TIZER DR HELENA MT 59602
    
  • Nebraska
    • Example output:
    Example: 2701 Hickory, Zip Code: 68105
    Primary Election 2016
    05/10/2016
    Not Available
    Columbus Park Recreation Center
    1515 South 24th Street Meeting Room (ADA NORTH ENTRANCE)
    Omaha, NE 68108
    

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages