Question answering example throws an exception even if sanity check is skipped #233
Comments
Strangely, I got the |
Ah, nevermind, this happens at the evaluation step, so we got to let it finish training the epoch first. I confirm I see this error too. |
|
I attempt to fix this issue with PR #235. |
@SeanNaren ^^ 馃惏 |
Bad bot. Strangely I cant close this issue myself? |
The QA task is really broken... I don't have time to debug it but if anyone can help would appreciate it! |
@mariomeissner, would you be interested in diving in and debugging this issue? 馃惏 |
I've been away for a while and don't know the current situation. Was PR #235 not enough? I'd be happy to dig into this again if you point me in some direction 馃槃 |
I may say that the best would be just to check it out :) |
馃悰 Bug
Running the squad example
python train.py task=nlp/question_answering dataset=nlp/question_answering/squad trainer.gpus=[1] training.batch_size=8 trainer.num_sanity_val_steps=0
throws an exception while finalizing training. This is not a replication of #218To Reproduce
Steps to reproduce the behavior:
python train.py task=nlp/question_answering dataset=nlp/question_answering/squad trainer.gpus=[1] training.batch_size=8 trainer.num_sanity_val_steps=0
Environment
conda
trainer.num_sanity_val_steps=-1
is used, as in I see AssertionError when running QA example command.聽#184The text was updated successfully, but these errors were encountered: