Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unified dataset format #10

Merged
merged 19 commits into from
Dec 19, 2021
Merged

Unified dataset format #10

merged 19 commits into from
Dec 19, 2021

Conversation

zqwerty
Copy link
Member

@zqwerty zqwerty commented Dec 19, 2021

Description:
Unify the format of different datasets so that it is convenient to:

  1. evaluate a new model on many different datasets.
  2. evaluate existing models on a new dataset.
  3. conduct pre-training and domain-transfer experiments.

Example usage:

from convlab2.util import load_dataset, load_ontology, load_database

dataset = load_dataset('multiwoz21')
ontology = load_ontology('multiwoz21')
database = load_database('multiwoz21')

@zqwerty zqwerty self-assigned this Dec 19, 2021
@zqwerty zqwerty added this to In progress in Benchmark via automation Dec 19, 2021
@zqwerty zqwerty added this to the Phase 1 milestone Dec 19, 2021
@zqwerty zqwerty merged commit c71c9bf into master Dec 19, 2021
Benchmark automation moved this from In progress to Done Dec 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging this pull request may close these issues.

None yet

1 participant