Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LM finetuning example missing data #47

Closed
bnic24 opened this issue Aug 6, 2019 · 2 comments
Closed

LM finetuning example missing data #47

bnic24 opened this issue Aug 6, 2019 · 2 comments
Assignees
Labels
bug Something isn't working

Comments

@bnic24
Copy link

bnic24 commented Aug 6, 2019

Trying to run examples/lm_finetuning.py results in FileNotFoundError: [Errno 2] No such file or directory: '../data/finetune_sample/train.txt'. The other examples seem to be able to automatically download the dataset if it's not present.

@tholor
Copy link
Member

tholor commented Aug 6, 2019

Yep, there's already a PR in the making: #44
It's currently under review but will be merged soon :)

@tholor tholor added the bug Something isn't working label Aug 6, 2019
@tholor tholor self-assigned this Aug 6, 2019
@tholor
Copy link
Member

tholor commented Aug 6, 2019

Just merged it! You should have some dataset containing NIPS papers now for running the example. Just be aware that data preprocessing is currently sequential and therefore rather slow on large datasets. We are already working on speeding things up via multiprocessing in #45. Should be ready within the next days ...

@tholor tholor closed this as completed Aug 6, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants