netprov

Twitter reading scripts

Demo

To get the data, search for the hashtag you want on Twitter. You have to scroll all the way through in order to get all the tweets. Save the page as html and then run the script to create a csv.

E.g. reads from ./sootfall.html and writes to ./sootfall.csv.

python netprov.py sootfall

For example of output (pretty printed in HTML), see http://www.hyperrhiz.net/hyperrhiz11/archives/sootfall.php.

Thanks to Tim Menzies http://menzies.us/ and Simon Hudson http://hudsonsoapbox.com/2013/06/09/extracting-historical-data-from-twitter-using-python/