Skip to content

2.18.5

Choose a tag to compare

@KennethEnevoldsen KennethEnevoldsen released this 19 Jul 18:06
· 392 commits to main since this release

2.18.5 (2026-07-19)

Fix

  • fix: correctly isolate splits when aggregating scores in aggregated tasks (#4897)

  • fix: correctly isolate splits when aggregating scores in aggregated tasks

  • test: add regression test for isolated split aggregation in AbsTaskAggregate

  • chore: format regression test with ruff

  • test: refactor regression test to use existing MockAggregatedTask

  • test: fix state leakage in MockAggregatedTask by using model_copy

  • chore: format test with ruff

  • test: specify results for both inner tasks of MockAggregatedTask to properly simulate aggregation

  • feat: validate task results match requested tasks in AbsTaskAggregate

  • chore: fix import sorting with ruff check

  • fix: set main_score to None when missing task results instead of raising ValueError

  • test: add dev split assertion to missing task test

  • minor fix


Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com> (023b0b1)