Skip to content

tigeorgia/Parliament.ge-VotingRecord-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 

Repository files navigation

Parliament.ge Voting Record Scraper

Description

A tool to scrape voting records of passed / draf bills from Georgia's parliament website. The results are placed into JSON files for each individual bill.

Requirements

  • Python 2.7 But older and newer versions might work.
  • BeautifulSoup 3.2.0 To install, e.g.: $ sudo apt-get install python-beautifulsoup or $ sudo pip install BeautifulSoup

Optional:

  • epydoc
  • make If you want to generate API documentation.

Configuration

You should be able to run the scraper as is. If something on parliament.ge changes, edit HOST, DOC, PARAMS and NEXT_PAGE accordingly.

Usage

$ python scrape.py --output=OUTDIR

It outputs data in JSON format for each voting record (by kan_id, some bills don't have a number) into the given . The script will output status messages about each record being written and the time it took to scrape one page.

Documentation

If you have epydoc and make installed, you can create the API documentation using

$ make doc

Enjoy.

About

Scrape Georgia's parliament website for voting records of passed and draft bills

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages