Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

API. Search. Submissions older than November 3, 2022 are not available (search by Subreddits) #132

Open
smirnovstr-paul opened this issue Jan 9, 2023 · 10 comments

Comments

@smirnovstr-paul
Copy link

smirnovstr-paul commented Jan 9, 2023

API. Search. Submissions older than November 3, 2022 are not available (search by Subreddits)

https://api.pushshift.io/reddit/search/submission/?metadata=true&size=500&subreddit=binance&before=1667505777

image

https://api.pushshift.io/reddit/search/submission/?metadata=true&size=500&subreddit=binance&before=1667505780

image

Sorting by creation date does not work. Not looking for submissions (on all subreddits) older than November 3, 2022.

@smirnovstr-paul smirnovstr-paul changed the title API. Search. Subreddits older than November 3, 2022 are not available API. Search. Submissions older than November 3, 2022 are not available (search by Subreddits) Jan 9, 2023
@abhranil26
Copy link

yes even older user submissions don't load anymore

@datanizing
Copy link

Same for me 😭. Also, the API is only available as http where it used to be https.

If there is anything to do where I can help, I would be happy to contribute.

@jannat5134
Copy link

Do you know how to fix it? or Any API to get historical reddit?

@RaedShabbir
Copy link

RaedShabbir commented Jan 13, 2023

Any word on when this will be resolved?

Temporary Solution here
https://www.reddit.com/r/pushshift/comments/107pm28/does_anybody_have_reddit_web_scraping_alternatives/

@ranbix666
Copy link

Same for me! Can someone please take a look at this issue? It works fine for comments.

@JacobGeoGeek
Copy link

Is there any news on this problem? Also, does the Reddit API allows devs to extract the oldest posts from a subreddit?

@rbjakab
Copy link

rbjakab commented Feb 6, 2023

I'm afraid this problem is still active, any news on it? Does anybody know what causes it and is anybody working on it?

@RaedShabbir
Copy link

RaedShabbir commented Feb 7, 2023

https://www.reddit.com/r/pushshift/comments/zkggt0/update_on_colo_switchover_bug_fixes_reindexing/

Caused by server switch-over.
I'd advise you to follow the instructions here for a temporary workaround.

Copied below for anybody else that comes across this issue.

Link to Reddit Archives Torrent
Link to extraction code for multi-processing:

@rbjakab
Copy link

rbjakab commented Feb 7, 2023

@RaedShabbir thanks, but for me it won't work out since I don't have 2TB spare space on my laptop.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

9 participants