Skip to content

Tweets, Twitter, Search, Crawling, Tool, Big Data Analysis, Data Mining, Time Series Analysis

License

Notifications You must be signed in to change notification settings

mpfarmer/TwSearchEnabled

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

TwSearchEnabled

A Python scripts run you multiple (No. keywords * No. days) browsers with auto-login and auto-scroll-down features for crawling historical data (tweets) by keywords

Getting Started

  1. Check out the tweetsearch.py and read the comments for understanding
  2. Create username.txt and password.txt for storing credentials
  3. Setup the keywords in the code as you like, current keywords are 'Android' and 'iOS'
  4. Setup the Start date and End date in the code

Prerequisites

Python3 pip (Optional) Firefox Mozilla geckodriver Selenium

Installing

Python3 Link - https://www.python.org/downloads/ pip Link - https://pip.pypa.io/en/stable/installing/ Firefox Link - https://www.mozilla.org/en-US/firefox/new/?f=116 Mozilla geckodriver Link - https://github.com/mozilla/geckodriver/releases Selenium Link - https://pypi.python.org/pypi/selenium

Some more guidance:

  1. For Selenium installation, follow the Selenium Link above or get pip installed and type command below For Windows user, pip install -U selenium For OS X user, $ pip3 install -U selenium (or use brew)

  2. For geckodriver, please put the executable in a System Path (e.g. under the Python3 folder)

Built With

  1. Command Line python tweesearch.py (Windows) $ python3 tweetsearch.py (Linux or OS X)
  2. Sublime Text3 + Anaconda (My favorite for now)

Authors

License

This project is licensed under the MIT License - see the LICENSE.md file for details

Acknowledgments

Marco Randy Daw-Ran Liou Craig Trim

Please feel free to pull request for improvement or questions

About

Tweets, Twitter, Search, Crawling, Tool, Big Data Analysis, Data Mining, Time Series Analysis

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages