Repository navigation
Releases
v0.2.1
What's Changed
- Load Gym rollouts without ng_trajectory from the Responses envelope by @aleckhoury in #75
- Fix typo in SKILL.md header by @BrianNewsom in #96
- docs: install example CLI from PyPI by @callingmedic911 in #97
- docs: introduce NeMo Compass Dev Notes by @cairnsim in #98
- Add turns and typed ATIF fields to the trace contract by @aleckhoury in #79
- Warn Compass users about Nemotron Lightning tool-calling failures by @haggs in #101
- Fix first-use inspection of trace tool models by @callingmedic911 in #103
- Check startup and cold model inspection with pytest by @callingmedic911 in #104
- Remove the separate wheel smoke check by @callingmedic911 in #105
- Add cost-efficiency signal for prompt-cache misses after tool changes by @xdieu-nv in #84
- Use ripgrep for source discovery and search by @mdcox in #106
- Show severity before description and evidence by @mdcox in #115
- Use ETHOS.md to select and prioritize compiled insights by @haggs in #86
- Return extracted user messages directly from NOOA by @nicot in #118
- Move cost field extraction out of ingestion by @callingmedic911 in #117
- Type Trace case and session keys and add the record-merge helper by @aleckhoury in #108
- Build conversation turns with a shared helper by @aleckhoury in #109
- Load each Intake conversation as one trace by @aleckhoury in #110
- Load each MLflow conversation as one trace by @aleckhoury in #111
- Load each Langfuse conversation as one trace and build its turns by @aleckhoury in #112
- Merge LangSmith threads and build their turns by @aleckhoury in #113
- Build Braintrust run-root turns by @aleckhoury in #114
- Test the Gym and ATIF loaders on real data and fix what it exposed by @aleckhoury in #119
- Upgrade LiteLLM to fix CVE-2026-114612 by @nicot in #129
- Automate release candidates and publication from release branches by @callingmedic911 in #125
- Use version tags as GitHub release titles by @callingmedic911 in #131
- Remove outdated signal count from configuration guide by @callingmedic911 in #132
- Bring forward-port automation to release/0.2.1 by @callingmedic911 in #136
- Fix repository link in results example by @callingmedic911 in #137
Full Changelog: v0.2.0...v0.2.1
v0.2.0
Compass 0.2.0 improves tool and prompt-cache evidence in traces, validates candidate problems against ETHOS.md and source code, and adds concurrent remote sentiment embeddings.
Breaking changes and migration
Move the ETHOS path to the run configuration
Move compass_signals.ethos_divergence.ethos_path to the top-level ethos_path:
# Before
compass_signals:
ethos_divergence:
ethos_path: path/to/ETHOS.md# After
ethos_path: path/to/ETHOS.mdFor CLI overrides, replace --compass-signals.ethos-divergence.ethos-path with --ethos-path.
Compass now discovers ETHOS.md (or ethos.md) in the working directory. Explicitly enabling ethos divergence requires an available, nonempty document.
The document also informs candidate problem validation, even when the ethos divergence signal is disabled. This can add model calls and filter findings. Inconclusive candidates are retained. See configuration.
Other improvements
- Handle unknown token counts
- Trace loaders preserve recorded tool definitions, tool results, model request parameters, agent IDs, and supported provider token usage.
- Remote sentiment embeddings support configurable batching, concurrency, retries, and timeouts. Defaults are 64 messages per batch, four concurrent requests, three retries, and a 60-second request timeout.
- Execution telemetry adds clearer phase summaries, trace source details, and optional LangSmith tags through
COMPASS_TELEMETRY_LANGSMITH_TAGS.
All changes
What's Changed
- Use nemo-compass for the Python distribution and releases by @callingmedic911 in #64
- docs: clarify ethos divergence setup by @haggs in #44
- Hoist ETHOS path to run configuration by @haggs in #54
- Make Compass telemetry traces easier to understand and use by @haggs in #62
- Install Compass from PyPI in user guides by @callingmedic911 in #68
- docs: standardize ETHOS.md naming by @haggs in #69
- Define Compass behavior and success criteria in ETHOS.md by @callingmedic911 in #49
- Add configurable LangSmith tags to Compass telemetry by @haggs in #82
- Type tool definitions and results across trace loaders by @aleckhoury in #71
- Validate candidate problems against ETHOS and source code by @haggs in #67
- Add concurrency and retries for user sentiment embeddings by @haggs in #77
- ci: stage Compass release wheels in NGC by @svvarom in #91
- Preserve recorded tool definitions across loaders by @callingmedic911 in #90
- Read prompt-cache token usage from trace sources by @xdieu-nv in #81
- Prepare Compass 0.2.0 by @callingmedic911 in #93
New Contributors
- @aleckhoury made their first contribution in #71
- @svvarom made their first contribution in #91
- @xdieu-nv made their first contribution in #81
Full Changelog: v0.1.0...v0.2.0
v0.1.0
What's Changed
- Improve trace integration docs and analysis progress feedback by @haggs in #1
- feat: add embedding and user complaint classification system by @nicot in #2
- feat: add ATIF JSONL trace loader by @nicot in #3
- Show a CLI quick start and keep full help discoverable by @callingmedic911 in #5
- Fail early with clear CLI environment setup errors by @callingmedic911 in #6
- Require at least two trace references per Insight by @shanaiabuggy in #8
- Enable evidence streams by default and clarify CLI results by @callingmedic911 in #7
- feat: filter intake traces by experiment by @nicot in #11
- fix: add OSRB-requested LICENSE spacing by @shanaiabuggy in #12
- Simplify user docs and connect CLI guidance by @callingmedic911 in #14
- Add Braintrust trace loader by @shanaiabuggy in #13
- Make local sentiment embeddings opt-in by @callingmedic911 in #16
- fix: update root LICENSE copyright year for OSRB by @shanaiabuggy in #17
- Extract reusable trace ingestion package by @callingmedic911 in #15
- fix: isolate provider endpoints and translate Anthropic parameters by @nicot in #18
- docs: rename checks to evidence streams by @nicot in #20
- docs: explain analyst architecture for partners by @nicot in #21
- feat(trace-ingest): support Gym trajectory exports by @asutermo in #19
- fix: upgrade Transformers to prevent unconsented module downloads by @shanaiabuggy in #23
- Document analyzing traces from unsupported stores by @callingmedic911 in #22
- docs: add security policy by @nicot in #25
- Preserve storage IDs when reconciling insights by @shanaiabuggy in #26
- feat: link insights to source traces by @shanaiabuggy in #24
- fix: upgrade cryptography to address PKCS7 decryption oracle by @BrianNewsom in #29
- feat: record when a trace was last added to an insight by @rrhyne in #32
- feat: link insights to supporting spans by @shanaiabuggy in #34
- Preserve candidates and check compiler evidence-completion predicates by @callingmedic911 in #31
- Rename product branding to NeMo Compass by @callingmedic911 in #38
- Simplify terminal insight reports by @callingmedic911 in #39
- docs: clarify NeMo Compass research preview and contribution policy by @nicot in #27
- Update README.md by @cairnsim in #41
- Comment out all assignments in .env.example by @haggs in #43
- Rename evidence streams to Compass Signals and evaluation failures to Grader failures by @nicot in #45
- Assess insight severity by default and confidence on demand by @rrhyne in #37
- Replace outdated Trace Analyst references by @callingmedic911 in #48
- Record Compass executions in LangSmith by @callingmedic911 in #47
- Refactor Langfuse loader into focused modules by @haggs in #50
- Support Langfuse v4 online loading alongside v3 by @haggs in #51
- Document recommended Compass models by @shanaiabuggy in #52
- Support offline Langfuse v4 exports by @haggs in #53
- Bundle trace ingestion into the Compass distribution by @callingmedic911 in #55
- feat: add reasons to severity ratings by @mdcox in #33
- Recommend NVIDIA Nemotron 3.5 Super VL by @shanaiabuggy in #57
- Stop copying input traces into Compass telemetry by @haggs in #60
- Add links to ethos skills by @rrhyne in #61
- Rename insight-agent to compass by @callingmedic911 in #63
- Prepare Compass releases from GitHub Actions by @callingmedic911 in #56
New Contributors
- @nicot made their first contribution in #2
- @shanaiabuggy made their first contribution in #8
- @asutermo made their first contribution in #19
- @BrianNewsom made their first contribution in #29
- @rrhyne made their first contribution in #32
- @cairnsim made their first contribution in #41
- @mdcox made their first contribution in #33
Full Changelog: https://github.com/NVIDIA-NeMo/nemo-compass/commits/v0.1.0