No description, website, or topics provided.
JavaScript HTML Jupyter Notebook Other
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
datasets
notebooks
results
schemas
README.md
generate_wordcloud.py
get_portal_datasets.py
search_portal_datasets.py
stopwords

README.md

CommuniData project

Public repository of the research project CommuniData: Open Data for Local Communities http://www.communidata.at

Open Data in Austria

Wordclouds

  • titles from all 2297 datasets in data_gv_at portal, 373 datasets in www_opendataportal_at portal (latest snapshot: 1st week of 2017 '1701')
  • Exception from the API: {u'message': u'QueuePool limit of size 20 overflow 10 reached, connection timed out, timeout 30'} after ~150 requests (data_gv_at: 1643 snapshot)

data.gv.at Wordcloud (2297 datasets as of 31.12.2016)

data.gv.at wordcloud

opendataportal.at Wordcloud (373 datasets as of 31.12.2016)

opendataportal.at wordcloud

Jupyter Notebook Tutorials

The tutorials are published on our web-site

Search

  • load csv files with get_portal_datasets.py script
  • grep $PATTERN *

For example, the following queries return the rows associated with the 2nd district of Vienna: grep ";1020;" * grep ";90200;" * grep -i ";Leopoldstadt;" *

ES search API sample results

Request: "Musik im Park"

Results: Garagen und Park & Ride-Anlagen - Standorte - Wien Park- und Ride Anlagen K\xe4rnten Musik- und Singschulen - Standorte - Wien

Schemas

Sample datasets revealing the schemas for each of the Austrian OD portals are stored in the folder schemas and can be dynamically retrieved from the Portalwatch API:

StuwerNews

Tracking news for the local communities from social media (Twitter)

See https://github.com/vendi12/StuwerNews

Prerequisites

Wordcloud

Jupyter Notebooks

  • pandas
  • seaborn

License

This project is licensed under the MIT License

Acknowledgments

References

Open Data projects

** Open Data portal

** GeoHub platform + Video

Jupyter Notebooks

... launches a docker container for each user that requests one.

... deploying via nginx.

Deploying JupyterHub for Education

** Tutorials

** Health Inspection Dashboard Tutorial: [Video] [Code]