Skip to content

Conversation

@VictorSanh
Copy link
Member

@VictorSanh VictorSanh commented Sep 20, 2021

This PR reintegrates story_cloze which a dataset that is not yet merged into HF/datasets' master.
Lots of similarities #443 (that we reverted b32f2de because it was making the test fail).
Ultimately, once story_cloze is merged in huggingface dataset master, we won't need these custom hacks anymore.

With these corrections:

  • the tests (in particular test_templates.py) are not longer failing
  • we can do a import seqio; import promptsource.seqio_tasks without crashing (which is necessary for the training)

Note: the test show_new_templates is failing because story_cloze requires manual download which is a non supported case of this test

VictorSanh and others added 3 commits September 20, 2021 14:36
Co-authored-by: zaidalyafeai <alyafey22@gmail.com>
Co-authored-by: zaidalyafeai <alyafey22@gmail.com>
Co-authored-by: zaidalyafeai <alyafey22@gmail.com>
@VictorSanh VictorSanh marked this pull request as draft September 20, 2021 18:37
@VictorSanh VictorSanh marked this pull request as ready for review September 20, 2021 21:30
@VictorSanh VictorSanh merged commit 7aec9c1 into main Sep 21, 2021
@VictorSanh VictorSanh deleted the fix_seqio_import_for_story_cloze branch October 7, 2021 22:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants