You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
You could accomplish this by just using sacrebleu as a library. It’s pretty easy:
from sacrebleu.utils import get_source, get_references, get_files
# trigger sacrebleu test set
# make these optional: nargs=“?” for argparse
if args.source is None and args.references is None:
if args.sacrebleu_dataset is None:
# throw error
# some test sets are hierarchical, e.g., “mtedx/valid”
test_set, langpair = args.sacrebleu_dataset.rsplit(“/“, maxsplit=1)
source = get_source(test_set, langpair)
ref = get_referencees(test_set, langpair)
# alternative
source, ref, _ = get_files(test_set, langpair)
[Extracting from #30]
It would be nice to would be to add support for sacrebleu-style builtin test sets, e.g.,
You could accomplish this by just using sacrebleu as a library. It’s pretty easy:
Originally posted by @mjpost in #30 (comment)
The text was updated successfully, but these errors were encountered: