-
Notifications
You must be signed in to change notification settings - Fork 17
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
List of datasets | Monolingual raw files #13
Comments
Yes, you can use |
Amazing! Thank you so much!! Silly me for not reading properly. That's just great, it works nicely. One last question, however. I notice that the 'raw' category gives me xml files, you can try:
I'm after the untokenized raw text, if at all possible. I can get it through the api by doing something like:
(As the api gives me an object with key "corpora", and the second option within that is the raw, untokenized monolingual text file.) Cf. here. Any chance you might integrate that option in the future? That list functionality is great, also with the size displayed, I'll be able to use that programmatically (to sort the queue downloads by size). |
In case, I made this little script that uses the Python utility to download the mono raw files. |
Ok, I see. Yes, the raw files are xml files that contain untokenized text. We can probably add the raw non-xml files to be able to be downloaded with There is also the |
Sounds good, thanks for your answer! Awesome that you developed this utility, very useful. As you can see I could get what I wanted with a bit of Python scripting, but thanks for the |
Hi,
Just stumbling across this tool, which looks promising!
I've been wondering:
Thanks a lot in advance!
The text was updated successfully, but these errors were encountered: