Skip to content

Release v0.21.0

Choose a tag to compare

@github-actions github-actions released this 19 Oct 12:54
· 34 commits to main since this release

Added

  • AnswerCoverageEvaluator — how much of a reference answer an answer states (improver.AnswerCoverage, also
    registered by AddFluxImprover*). It splits the reference answer into atomic facts, or takes a fact list, judges each
    supported / partial / missing, and scores (supported + 0.5 × partial) ÷ facts — the nugget evaluation of the TREC
    2024 RAG Track. For evaluation sets that carry an expected answer, which the existing evaluators never used.

Changed

  • Breaking — the Faithfulness score is the share of supported claims, not the model's own number. The model still
    lists the claims and marks each supported or not; the score is now computed from those verdicts, so the same verdicts
    always give the same score (before, verdicts of one supported claim in four could come back as 0.9). An answer with no
    claims keeps the model's score. Details gains scoreSource (claims / model), supportedClaims and totalClaims
    when IncludeDetails is on. Migration: none in code; expect different (lower, where the model was generous) scores and
    re-check thresholds tuned on old scores. FluxImproverServices gains a trailing AnswerCoverage parameter — code that
    constructs the record itself adds it.

Removed

  • Breaking — IEmbeddingService, IRerankService and ITokenizer (FluxImprover.Services). Nothing in FluxImprover
    called or accepted them: no enrichment, filtering or QA path embeds, reranks or counts tokens through them, so an
    implementation registered for them was never used. Migration: delete your implementations and registrations.

Dependencies

  • Re-pinned sibling package(s) LMSupply.Generator 0.116.0 -> 0.117.0, LMSupply.Generator.Onnx 0.116.0 -> 0.117.0.
  • Re-pinned sibling package(s) LMSupply.Generator 0.117.0 -> 0.117.1, LMSupply.Generator.Onnx 0.117.0 -> 0.117.1.
  • Re-pinned sibling package(s) LMSupply.Generator 0.117.1 -> 0.118.0, LMSupply.Generator.Onnx 0.117.1 -> 0.118.0.
  • Re-pinned sibling package(s) LMSupply.Generator 0.118.0 -> 0.119.0, LMSupply.Generator.Onnx 0.118.0 -> 0.119.0.
  • Re-pinned sibling package(s) Iyu.Conventions.Testing 0.9.0 -> 0.10.0, LMSupply.Generator 0.119.0 -> 0.120.0, LMSupply.Generator.Onnx 0.119.0 -> 0.120.0.
  • Re-pinned sibling package(s) LMSupply.Generator 0.120.0 -> 0.121.0, LMSupply.Generator.Onnx 0.120.0 -> 0.121.0.
  • Re-pinned sibling package(s) LMSupply.Generator 0.121.0 -> 0.122.0, LMSupply.Generator.Onnx 0.121.0 -> 0.122.0.
  • Re-pinned sibling package(s) LMSupply.Generator 0.122.0 -> 0.123.0, LMSupply.Generator.Onnx 0.122.0 -> 0.123.0.
  • Re-pinned sibling package(s) LMSupply.Generator 0.123.0 -> 0.124.0, LMSupply.Generator.Onnx 0.123.0 -> 0.124.0.
  • Re-pinned sibling package(s) LMSupply.Generator 0.124.0 -> 0.125.0, LMSupply.Generator.Onnx 0.124.0 -> 0.125.0.
  • Re-pinned sibling package(s) LMSupply.Generator 0.125.0 -> 0.126.0, LMSupply.Generator.Onnx 0.125.0 -> 0.126.0.
  • Re-pinned sibling package(s) LMSupply.Generator 0.126.0 -> 0.127.0, LMSupply.Generator.Onnx 0.126.0 -> 0.127.0.
  • Re-pinned sibling package(s) LMSupply.Generator 0.127.0 -> 0.128.0, LMSupply.Generator.Onnx 0.127.0 -> 0.128.0.
  • .NET runtime packages 10.0.12 -> 10.0.13 (the 10.0 servicing band; Microsoft.Extensions.* and their siblings move together).