Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scripts to scrape tweets. #4

Open
6 tasks
adiah80 opened this issue May 12, 2020 · 0 comments
Open
6 tasks

Scripts to scrape tweets. #4

adiah80 opened this issue May 12, 2020 · 0 comments

Comments

@adiah80
Copy link
Member

adiah80 commented May 12, 2020

Add a script to scrape tweets from twitter.

Some basic functionality should include :

  • Scraping all the (original) tweets of a user.
  • Scraping all the tweets liked by a user.
  • Scraping all the tweets retweeted by a user.
  • Scraping all the tweets on which a user has commented.
  • Scraping all the accounts followed by a user.
  • Scraping all the tweets from all the accounts followed by the user.

We would also need functions to update the "tweet database" regularly. This would require some scraping functions that implement the above features after a certain last-saved tweet.

This could be done by adding an optional parameter characterizing the last-saved tweet to the above functions.

Refer to twintproject/twint for some ideas on implementation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant