Skip to content

2.7.4

Choose a tag to compare

@KennethEnevoldsen KennethEnevoldsen released this 19 Jan 11:19
· 1089 commits to main since this release

2.7.4 (2026-01-19)

Fix

  • fix: Update metadata to include active number of parameter to ModelMeta (#3837)

  • Add active parameter column on LB

  • update ModelMeta with parameters

  • update ModelMeta of models

  • Delete parameter_update_results.csv

  • fix test

  • fix tests

  • delete script

  • rename for consistency

  • convert active_parameter to property

  • rename and fix property

  • update embedding parameters for model2vec models

  • remove duplicate loading of models

  • fix

  • lintter

  • fix

  • remove separate method for embedding parameter calculation

  • fix embedding calculation to pass typecheck

  • lintter

  • fix checking

  • rename active parameters

  • upd docstring

  • fix tests

  • remove n_active_parameters_override from ModelMeta of all models

  • lintter

  • rename file instead of merging main

  • fix tests

  • correct tests

  • Delete model total and active parameters - model_parameters.csv


Co-authored-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com> (a45359e)

Refactor

  • refactor: split BRIGHT benchmark into individual subset tasks (#3285)

  • refactor: split BRIGHT benchmark into individual subset tasks

  • readd bright

  • readd bright subset tasks

  • feat: add descriptive stats for BRIGHT subsets retrieval tasks

  • feat: add top_ranked for excluded_ids handling

  • change main score to recall@1 for long version

  • improve BRIGHT task descriptions

  • add prompts to BRIGHT retrieval tasks

  • refactor: BRIGHT(v1.1)

  • calculate descriptive stats for BRIGHTLongRetrieval

  • update prompts

  • normalize names in prompts

  • don't filter tasks

  • remove filter_queries_without_positives and update revision

  • don't create top ranked if not necessary

  • get back naucs

  • fix instructions

  • add warning

  • fix import


Co-authored-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com> (2c9b9e9)