Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dont work no more any way around with local dumps?? #20

Closed
adikami5665 opened this issue May 28, 2023 · 4 comments
Closed

dont work no more any way around with local dumps?? #20

adikami5665 opened this issue May 28, 2023 · 4 comments

Comments

@adikami5665
Copy link

So i got the local dumps downloaded but I don't know how to proceed and get subreddit file like I used to get in db format. any help to move forward. I know the api is down but can https://github.com/yakabuff/redarc help in any way to generate files like before.

@DoaJCBlogger
Copy link

Do you mean that you downloaded the Zstandard files?

@adikami5665
Copy link
Author

yes

@voussoir
Copy link
Owner

voussoir commented Jun 25, 2023

Hi guys. I have added a new module to timesearch that can import the archive files into a timesearch database.

zst is a compressed format. Please use a tool like 7-Zip to extract the actual json files. The files inside the archive do not have a file extension, but that's ok.

Please do a python -m pip install voussoirkit --upgrade just in case I've changed anything in my libraries since you last updated.

Please do a git pull of your timesearch repository to get the new commit 8b3fe52.

Then,

python timesearch.py ingest_jsonfile robotwars_submissions -r robotwars

python timesearch.py ingest_jsonfile robotwars_comments -r robotwars

Hope that helps

image

image

@DoaJCBlogger
Copy link

This is great. Thank you. The only thing I would suggest is adding support for Zstandard so you don't have to decompress them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants