2.15.0
2.15.0 (2026-06-09)
Ci
-
ci: Update actions (#4780)
-
update github
-
remove remove
-
upd
-
remove free space
-
rename step
-
fix conda wargning
-
add concurrency to lb
-
remove concurrences (
52a6f73)
Feature
-
feat: Add evaluation runtime for indexing and retrieval (#4639)
-
Add evaluation runtime for indexing and retrieval
-
change timer from maintaining state to passed as an attribute
-
add timer argument to load_data
-
add timer argument to evaluate
-
removed timer from kwargs
-
update plots for split/subsets
-
fix tests
-
fix typing errors
-
typing errors
-
change typing
-
correct typing
-
apply changes from review
-
update to handle overwritten load_data
-
changes from review
-
added evaluation phases merging logic and fix typecheck
-
added * seprator at all places in load_data
-
changes from review
-
added split/subset at all places
-
change split/subset in other functions as well
-
small typecheck update
-
changes from review
-
reordering
-
implement for clustering task
-
implement for classification task
-
remove logger statement from clustering
-
implement for pair classification task
-
remove logger statement for pair classification task
-
implement for bitext mining task
-
implement for STS task
-
implement for summarization task
-
implement for sklearn evaluator
-
fix lintter
-
Delete .specstory/history/2026-04-23_09-55Z-testing-mechanism-for-new-datasets.md
-
minor changes from review
-
fix typecheck
-
update stacklevel=2
-
add TimingStack as default argument
-
fix evaluators tests
-
update deprecate_evaluator
-
minor fix
-
modified implementation to handle override task
-
added utlity function in TaskResult to plot timings
-
Added docs
-
changes from review
-
added commnts
-
simplify plot calling and update docs with example
-
changed phases naming format in plots
-
add tests and minor changes
-
update to handle indexing and searching phase
-
rollback changes in deprecated_evaluator
-
move import to top level and minor fix in tests
-
fix import
-
update tests
-
change Scoring to aggregate level in Classification task
-
remove unwanted file
-
fix lintter and typecheck errors after merge
-
revert changes in other classification task
-
changes from copilot review and add new test
-
changes from review
-
update condition
-
make lint
-
updated docs
Co-authored-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com> (6a3e816)