This repository contains pre-trained models and raw training logs for the experiments in our CoLLAs-22 CompoSuite paper. Additionally, it contains the evaluation results of the zero-shot experiments.
In the directory structure,
- default refers to the standard setting of the benchmark in the paper
- smallscale refers to the CompoSuite∩<element> experiments in the paper
- holdout refers to the CompoSuite\<element> experiments in the paper
The main code for the benchmark is available at CompoSuite.