Repository navigation
Breaking changes:
- Rename
MBRGenerationConfigtoMBRConfig MetricRunnernow returns aMetricOutputdict instead of the raw tensor of scores.
New features:
- Make the size of the metric cache configurable via
MBRConfig.metric_cache_size - Allow that the number of references can be larger than the number of samples (if generated separately from the samples)
Other changes:
- Remove
GenerationConfigas parent class ofMBRConfig - Use FIFO cache instead of LRU for metric cache
- Extend caching to
CometMetricRunner