Polish learning summary CLI experience#98
Merged
jbarnes850 merged 5 commits intomainfrom Oct 30, 2025
Merged
Conversation
- Cherry-pick rationale display from PR #97 (console.py) - Simplify Recent Candidates to single line (run.py) - Filter token deltas < 50 in playbook entries (run.py) - Refactor quickstart.py to use shared _render_learning_summary - Fix test_runtime_rejects_stale_metadata with ATLAS_DISCOVERY_VALIDATE=1 - Fix module naming test assertions (atlas_generated_factories) - Fix wrapper_only_project fixture and synthesis test assertions All tests passing: 9/9 test_env_discovery.py, 3/3 test_run_summary.py 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
Contributor
There was a problem hiding this comment.
Pull Request Overview
This PR enhances the Atlas SDK's CLI and telemetry capabilities by introducing comprehensive learning summary rendering, live execution streaming, and improved test coverage. The changes focus on making the runtime experience more transparent and user-friendly while refactoring configuration discovery for better flexibility.
Key Changes
- Added a new learning summary rendering system with support for reward stats, token usage, playbook entries, and learning notes
- Introduced live streaming support (
--streamflag) for CLI runs with real-time execution event monitoring - Refactored test fixtures to better represent non-Atlas-compatible projects and updated discovery validation logic
Reviewed Changes
Copilot reviewed 9 out of 9 changed files in this pull request and generated 6 comments.
Show a summary per file
| File | Description |
|---|---|
| tests/unit/cli/test_run_summary.py | New comprehensive test suite for _render_learning_summary function covering rich metadata, missing sections, and stream mode |
| tests/test_env_discovery.py | Updated test assertions for more flexible discovery validation and env_vars configuration |
| tests/conftest.py | Simplified wrapper_only_project fixture to better represent projects without Atlas-compatible classes |
| examples/quickstart.py | Refactored quickstart script with improved error handling, API key validation, and integration of learning summary rendering |
| atlas/sdk/wrappers.py | Enhanced error handling to catch both AttributeError and TypeError in optional method calls |
| atlas/runtime/telemetry/console.py | Extended reward rationale display logic and updated learning highlight collection to support new metadata keys |
| atlas/cli/run.py | Added 500+ lines implementing learning summary rendering, stream monitoring, and enhanced CLI functionality |
| atlas/cli/env.py | Made capabilities and runtime_metadata parameters optional with defaults and updated config composition logic |
| README.md | Streamlined documentation by removing verbose Docker instructions and focusing on core quickstart workflow |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Testing