Dengue-dashboard

Deployed app here: https://dengue-db.herokuapp.com/

How it's made: https://towardsdatascience.com/creating-a-web-application-to-analyse-dengue-cases-1be4a708a533

This application aims to provide intelligence on a niche topic with the following 3 features:

1. Analysis: Visualise the number of dengue cases, along with an overlayed map of dengue hot zones and breeding spots.
2. News: This tab is able to retrieve news from multiple sources regarding "Dengue".
3. Twitter Analysis: There are 4 charts:
   • Line chart showing how sentiment of tweets related to "dengue" is changing every 5 minutes
   • Pie chart showing the proportion of sentiments for tweets related to "dengue"
   • Data table to gather live tweets
   • Word cloud to visualise frequently occuring words

Concepts:

1. Dash by Plotly - Web framework in Python
2. Heroku - Deployment of web application
3. Newsapi - Fetch news from a variety of sources
4. Folium - Geospatial analytics
5. Tweepy - Twitter Data Scraping
6. TextBlob - Sentiment Analysis
7. PostgreSQL - Database for scraping and retrieval

Resources:

1. Data:
   • https://data.gov.sg/dataset/dengue-clusters
   • https://data.gov.sg/dataset/areas-with-high-aedes-population
2. Deploying with Heroku: https://www.youtube.com/watch?v=j3VvVaNnDH4&t=480s
3. DBC: https://dash-bootstrap-components.opensource.faculty.ai/
4. DCC: https://dash.plotly.com/dash-core-components
5. Newsapi: https://newsapi.org/
6. Folium: https://blog.algorexhealth.com/2018/04/everything-you-never-wanted-to-know-about-geographic-charting/
7. Folium integration: https://medium.com/@shachiakyaagba_41915/integrating-folium-with-dash-5338604e7c56
8. Inspiration: https://github.com/nagarajbhat/dash-covid19-multilingual
9. Tweepy Guide: https://github.com/Chulong-Li/Real-time-Sentiment-Tracking-on-Twitter-for-Brand-Improvement-and-Trend-Recognition

Setup:

1. Create an anaconda enviornment with python=3.6
2. Update your environment with conda env update -n <environment name> -f environment.yml --prune
   • If update fails follow this script: https://stackoverflow.com/questions/35802939/install-only-available-packages-using-conda-install-yes-file-requirements-t
3. If fiona package has an error, follow (source: https://stackoverflow.com/questions/54734667/error-installing-geopandas-a-gdal-api-version-must-be-specified-in-anaconda ):
   • conda remove gdal fiona pyproj six rtree geopandas
   • pip install pipwin
   • pipwin install gdal fiona pyproj six rtree geopandas
4. Clone this repo

Limitations:

1. This application is not optimised for speed. The twitter analysis tab especially, will take quite some time to load.
2. This application does not focus on UI/UX. Hence, it is not meant to look nice/pleasing to the eyes.
3. The budget for this application is $0. As a free-tier member, there is a limited number of news and tweets I can retrieve, limited storage space.