You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I want to download all followers of a Twitter user with the function get_followers() from the rtweet package. With an older version of the rtweet package, this worked without any problems. Since I updated the package (current version is 1.0.2), I only get the first 75,000 followers, even though I set the retryonratelimit-option to TRUE.
The function downloads the first 75,000 followers, then waits 15 minutes and then ends the download process without any message.
Reproduce the problem
library(rtweet)
# I have authenticated myself with auth_setup_default()df_follower<- get_followers("CDU", n=800000, retryonratelimit=TRUE)
>df_follower# A tibble: 75,000 × 2from_idto_id<chr><chr>
rtweet version
I am using rtweet version: 1.0.2
Session info
R version 4.1.2 (2021-11-01)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 10 x64 (build 19044)
Matrix products: default
The text was updated successfully, but these errors were encountered:
The first lines, starting with #, are flushed once the R gets out of get_followers.
If you need so much data, I would recommend to use the app (or the bot) authentication method. However, it seems there is a problem with the pagination.
I'll look in more detail soon. Thanks for the report.
The pagination via cursor after hitting the rate limit it waited and then found that the last API call returned an error and silently stopped. I might have broken this inadvertently as I think this worked well previously.
Currently if the rate limit is hit and retryonratelimit is TRUE it will try again and continue working (I pushed it to the devel branch). I also modified the other internal iterators (chunked, premium) besides the one using cursor.
To be sure I added an additional (manual) test to check before next release.
Problem
I want to download all followers of a Twitter user with the function
get_followers()
from thertweet
package. With an older version of the rtweet package, this worked without any problems. Since I updated the package (current version is 1.0.2), I only get the first 75,000 followers, even though I set the retryonratelimit-option to TRUE.The function downloads the first 75,000 followers, then waits 15 minutes and then ends the download process without any message.
Reproduce the problem
rtweet version
I am using rtweet version: 1.0.2
Session info
R version 4.1.2 (2021-11-01)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 10 x64 (build 19044)
Matrix products: default
The text was updated successfully, but these errors were encountered: