DD-CSS is an open source web application that helps collecting data from social media platforms such as Twitter, and analyze them. It is powered by Flask, a highly modular microframework for Python. DD-CSS is initiated by Talha Oz.
In this project I highly benefitted from the books Mining the Social Web and Flask Web Development.
- Obtain an OAuth access token on behalf of a Twitter user
- Get the friends/followers list of a user as JSON/CSV file
- Get last 3200 tweets of a user in JSON/CSV format
- Get IDs as well as many other information on the members of a Twitter list in JSON/CSV format
After installing MongoDB, there is no need to create db or collection. The only configuration is to ensure indexing.
- Index the queries by db.queries.ensureIndex({username:1, created_time:1, qname:1})