Skip to content
Branch: master
Find file History
Type Name Latest commit message Commit time
Failed to load latest commit information. Initial commit of hellaswag May 29, 2019
hellaswag_test.jsonl Initial commit of hellaswag May 29, 2019
hellaswag_val.jsonl Initial commit of hellaswag May 29, 2019


This folder contains training, validation, and unlabeled test sets for HellaSwag, in .jsonl format. Here's what each dataset example contains:

  • ind: dataset ID
  • activity_label: The ActivityNet or WikiHow label for this example
  • context: There are two formats. The full context is in ctx. When the context ends in an (incomplete) noun phrase, like for ActivityNet, this incomplete noun phrase is in ctx_b, and the context up until then is in ctx_a. This can be useful for models such as BERT that need the last sentence to be complete. However, it's never required. If ctx_b is nonempty, then ctx is the same thing as ctx_a, followed by a space, then ctx_b.
  • endings: a list of 4 endings. The correct index is given by label (0,1,2, or 3)
  • split: train, val, or test.
  • split_type: indomain if the activity label is seen during training, else zeroshot
  • source_id: Which video or WikiHow article this example came from
You can’t perform that action at this time.