Getting data from data.gouv.fr in a more easily readable format.
Ruby
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
.gitignore
ministere-de-l-interieur.csv
ministere-de-l-interieur.json
readme.md
scrapper.rb

readme.md

Datagouv Scrapper

This tool was built during the Open Data 2014 Hackathon in Paris.

The goal was to get data from http://data.gouv.fr/ in a more easily readable way for human. We wanted to get a simple spreadsheet to manually check each file to see if the data contained in the downloadable ressources were easy to use or not.

The tool will generate json and csv file by requesting the CKAN API exposed by data.gouv.fr, ask for an organization, loop through all associated packages, request the api for each of these packages, loop through their associated items and aggregate all this data to form a nicely coherent list.

Usage

$ ruby ./scrapper.rb ministere-de-l-interieur

Fetching organization

http://qa.data.gouv.fr/api/1/datasets?organization=ministere-de-l-interieur

Fetching a package

http://qa.data.gouv.fr/api/1/datasets/ce01b63a-63fc-4a00-a340-bcdec51e2035