New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rate limit exceeded on large lists of followers #263

Open
pwalck opened this Issue Mar 12, 2015 · 5 comments

Comments

Projects
None yet
5 participants
@pwalck
Copy link

pwalck commented Mar 12, 2015

When running the "followers" command on a user with a lot of followers the rate limit is exceeded, probably because of pagination causing multiple API calls. I would prefer if the command just waited the 15 minutes and then continued to run. As is, I don't get any output at all.

Noticed this on a user with ~20k followers.

@sthen

This comment has been minimized.

Copy link

sthen commented Jan 16, 2016

I ran into similar with 't reach'. It would be nice to have at least an option to have t wait rather than exit when the limit is reached.

@ppival

This comment has been minimized.

Copy link

ppival commented Jun 10, 2016

I'm in the same boat as @pwaick - needing to grab a list of over a million followers! Possible to include a flag of some sort that could take this into account? Either pausing every 60 seconds, 15 minutes, or 5000 users, as appropriate? https://dev.twitter.com/rest/public/rate-limits BTW this seems to be the same as #307 if you want to count one more vote :-)

Just found that tweepy has a flag to wait_on_rate_limit=True http://docs.tweepy.org/en/v3.5.0/api.html - Could that be added to t?

@brianfeister

This comment has been minimized.

Copy link

brianfeister commented Sep 16, 2016

Any chance to get a response from an active dev on this issue? This is a pretty serious blocker for alot of use cases.

For myself I think the CLI user should own the responsibility for the rate limit and the t should just automatically return the first chunk in what would be a paginated API response and automatically set a limit equal to the threshold of the Twitter rate limit.

To get paginated responses beyond the rate limit, you could do:

t followers {user}  --page=2

Thoughts on this?

@brianfeister

This comment has been minimized.

Copy link

brianfeister commented Nov 2, 2016

@sferik I feel like there must but a pagination feature in t that I'm just not seeing. Is something like this possible?

t followers {user}  --page=2
@ish3lan

This comment has been minimized.

Copy link

ish3lan commented May 19, 2017

any update on this, are you guys using any alternatives? this repo seems dead.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment