-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Figure out how to progamatically extract Twitter Data "At Scale" #1
Comments
Following @steven4354 's link, this specifically: https://github.com/bear/python-twitter/wiki/Rate-Limited-API---How-to-deal-with. |
This tutorial has an easy to follow code snippet for programmatic extraction within rate limits: https://medium.com/agatha-codes/0-to-280-getting-twitter-timeline-data-for-your-awesome-nlp-project-ff41b941ed6 |
@nathanhc did a great job adding endpoints to the twitter pull in PR 52, closing a bunch of issues for those. Let's be sure to target that code in our main folder, so moving . Also creating a new issue for moving that code into the main/code path and renaming to represent the main trunk for that process now. |
Closing this issue as we're now looking at a weekly chron job until and unless we acquire elevated creds. |
The issue is that calling the Twitter API for many rows, there's "Rate Limiting". So we need to figure out a way around that.
The text was updated successfully, but these errors were encountered: