Remuneração dos servidores da Câmara Municipal de São Paulo
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
data
remuneration_cmsp
.gitignore
.travis.yml
LICENSE
Makefile
README.md
datapackage.json
requirements.in
requirements.txt
scrapy.cfg
tox.ini

README.md

Remunerations of the São Paulo Civil Council's public servants

This repository contains a scraper that extracts the remuneration data from the São Paulo's Civil Council website. You can find the data already extracted on data/remuneration.csv.

This repository is also a Data Package, so you can use any tools that support the specification.

Using

Requirements

The only requirements to run this code is Python 3.6 and tox (it'll probably run with earlier version of Python, but I haven't tested it).

Updating the data

To update the data, open your command-line and run:

make clean
make

Validating the data

We use goodtables to validate that the data we extract conforms to the schema we defined in the datapackage.json file. To execute the tests, simply run tox.