Processing and visualising Hong Kong government open data with Elasticsearch, Kibana and Timelion

In this workshop, we will explore creating a mock data processing pipeline using open data from the Hong Kong government.

What this workshop hopes to show you is how easily you can get up and running with the Elastic stack and visualise and explore your data in real-time. Ultimately this workshop should provide you the foundations to expand the example pipeline for your own data or other open source data you find.

Requirements

• A computer running Windows, OSX or Linux
• Java 7 or 8 installed
• 20% free disk space
• Elasticsearch 2.3.3, Logstash 2.3.2, Kibana 4.5.1 downloaded from here

Slides

• here

Datasets

• Daily air pollution index measurements taken from 14 stations siuated around Hong Kong. Dates are between 2000 and 2013.
• Overall daily weather measurements (i.e., temperature, humidity, air pressure, etc.) for Hong Kong taken between 2000 and 2013