This project is for the COMP90024 Cluster and Cloud Computing, including a tweet harvester, couchDB connector and couchDB processor.
Ansible is used to make the deployment of system automaticly.
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.
-
Apache CouchDB Click to install a toturial
-
Python 3.XX version
-
TwitterAPI
pip3 install TwitterAPI
- CouchDB lib
pip3 install CouchDB
- A Twitter Application Account for developer:apply one
Login with a twitter account and then apply for a application, collect your consumer key and tokens etc.
- change 'search_tweets' to whichever tokens are you going to search.
- change the 'consumer_key','consumer_secret','access_token_key' and 'access_token_secret' to your own token
python3 Tweet.py -c [city] -t [token]
python3 Tweet_by_city.py -c [city] -t [token]
The above [city] refers to any major city described by boudning box in support.py, [token] refers to your secret tokens. The city has to be lowcase characters. (see support.py)
- Any exception occured will be record into log file. Usually the only exception is the duplication issue when inserting an existing tweet into database.
Add additional notes about how to deploy this on a live system
- Twitter API - API wrapper for harvest
Currently version one
- Zelong Cong - Initial work
This project is licensed under the MIT License - see the LICENSE.md file for details
- Professor Richard Sinnott, gave us great pressure to do the project....ORZ....