Twitter Data Exporter
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
Documents
app
docs_theme
migrations
tests
.gitignore
LICENSE
README.md
config.py
index.py
manage.py
mkdocs.yml
requirements.txt

README.md

DD-CSS


Data-driven Computational Social Science

DD-CSS is an open source web application that helps collecting data from social media platforms such as Twitter, and analyze them. It is powered by Flask, a highly modular microframework for Python. DD-CSS is initiated by Talha Oz.

In this project I highly benefitted from the books Mining the Social Web and Flask Web Development.

Features


Twitter

  • Obtain an OAuth access token on behalf of a Twitter user
  • Get the friends/followers list of a user as JSON/CSV file
  • Get last 3200 tweets of a user in JSON/CSV format
  • Get IDs as well as many other information on the members of a Twitter list in JSON/CSV format

Installation


MongoDB

After installing MongoDB, there is no need to create db or collection. The only configuration is to ensure indexing.

  • Index the queries by db.queries.ensureIndex({username:1, created_time:1, qname:1})