Skip to content
twitter data analysis using pymongo
HTML Python
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.idea
.gitignore
MongoDB_test.py
README.md
access_mongodb_database.py
bad_char.txt
counthash_search.py
counthash_stream.py
csv_process.py
data_analysis_with_pymongo.py
hashtags_match.txt
json_to_csv.py
map.html
mona_counthash_stream.py
newtest1.txt
pymongo_tweepy.py
sahil_counthash_stream.py
test.py
test1.txt
test2.txt
test_tweepy.py
tweepy_data_miner.py
tweet_emoji_analysis.py
tweet_map.py
tweet_spider.py
tweet_spider_JSON_streaming.py
unique_hashtags.txt
usa_tweets.csv
usa_twitter_analysis.py
wenjun_counthash_stream.py

README.md

mongo_tweets

tweet_spider.py: The script is used for searching tweets from last week. Just right click the on it and run. Data will be stored in MongoDB and json files.

pymongo_tweepy.py: Minor changes to dump json files.

counthash_search.py: count the hashtags using search api. output files:

  1. search_result_match.txt: hashtags that has keywords: vote, midterm, election, november
  2. search_result_not_match.txt: hashtags that doesn't contain the keywords

counthash_stream.py: count the hashtags using streaming api. output files:

  1. stream_result_match.txt: hashtags that has keywords: vote, midterm, election, november
  2. stream_result_not_match.txt: hashtags that doesn't contain the keywords
You can’t perform that action at this time.