Skip to content

CLI + Agent Skill 2.0.8

Choose a tag to compare

View all tags
@sandeepbele sandeepbele released this 29 Aug 04:20
v2.0.8
3952552
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

CLI and Agent Skill 2.0.8

This release improves evidence-aware evaluation authoring while keeping Halios setup bounded and transparent.

Highlights

  • Records unresolved evidence and coverage gaps in optional local .halios/discovery.yml notes.
  • Reports discovery gaps separately from executable-suite validity and evaluation outcomes.
  • Adds concise, matched RAG check and scenario examples for retrieval evidence, faithfulness, relevance, correctness, citations, and honest evidence limits.
  • Distinguishes fixed-question coverage from repeated trials: -k repeats stable scenarios; it does not generate new questions.
  • Supports plain-language “expand the scenarios” requests, adapting to fixed-question datasets or conversational situations.
  • Keeps setup bounded to one smoke scenario unless a broader run is explicitly requested.

Package boundary

This is the coupled haliosai-cli and Halios Agent Skill release. It does not release the separate haliosai Python SDK.

Assets 2
Loading