2.7.4
2.7.4 (2026-01-19)
Fix
-
fix: Update metadata to include active number of parameter to
ModelMeta(#3837) -
Add active parameter column on LB
-
update ModelMeta with parameters
-
update ModelMeta of models
-
Delete parameter_update_results.csv
-
fix test
-
fix tests
-
delete script
-
rename for consistency
-
convert active_parameter to property
-
rename and fix property
-
update embedding parameters for model2vec models
-
remove duplicate loading of models
-
fix
-
lintter
-
fix
-
remove separate method for embedding parameter calculation
-
fix embedding calculation to pass typecheck
-
lintter
-
fix checking
-
rename active parameters
-
upd docstring
-
fix tests
-
remove n_active_parameters_override from ModelMeta of all models
-
lintter
-
rename file instead of merging main
-
fix tests
-
correct tests
-
Delete model total and active parameters - model_parameters.csv
Co-authored-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com> (a45359e)
Refactor
-
refactor: split
BRIGHTbenchmark into individual subset tasks (#3285) -
refactor: split BRIGHT benchmark into individual subset tasks
-
readd bright
-
readd bright subset tasks
-
feat: add descriptive stats for BRIGHT subsets retrieval tasks
-
feat: add top_ranked for excluded_ids handling
-
change main score to recall@1 for long version
-
improve BRIGHT task descriptions
-
add prompts to BRIGHT retrieval tasks
-
refactor: BRIGHT(v1.1)
-
calculate descriptive stats for BRIGHTLongRetrieval
-
update prompts
-
normalize names in prompts
-
don't filter tasks
-
remove filter_queries_without_positives and update revision
-
don't create top ranked if not necessary
-
get back naucs
-
fix instructions
-
add warning
-
fix import
Co-authored-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com> (2c9b9e9)