Skip to content

v0.1.16: Zero-Friction Onboarding and KV Cache Optimization

Latest

Choose a tag to compare

@jbarnes850 jbarnes850 released this 22 Nov 23:11
· 1 commit to main since this release

Overview

This release delivers major improvements to developer experience and performance optimization. The onboarding time drops from 30+ minutes to under 3 minutes with zero manual interventions, and new playbook injection modes enable KV cache optimization for reduced latency and token costs.

Zero-Friction Onboarding (PR #146)

Complete refactor of atlas env init to achieve "one API key to training data in 5 minutes."

What Changed

LLM-Driven Agent Selection

  • Intelligent candidate selection using Claude Haiku 4.5
  • Auto-selects with confidence > 0.85 (no user prompts required)
  • Shows reasoning for lower confidence selections
  • Graceful fallback to heuristic ranking if API unavailable

Anthropic-Only Defaults

  • Student: Claude Haiku 4.5 (claude-haiku-4-5-20251001)
  • Teacher: Claude Sonnet 4.5 (claude-sonnet-4-5-20250929)
  • Based on runtime evaluation showing 0.989 reward score, 20.08s latency
  • Learning features enabled by default (few-shot prompting, playbook injection)

Integrated Storage Setup

  • Folds atlas init into env init flow
  • Auto-detects running PostgreSQL with connection validation
  • Prompts to start Docker Compose if not running
  • Validates database connectivity before claiming success

Improved Developer Experience

  • Database connection validation prevents cryptic first-run errors
  • Error messages follow Fix/Debug/Learn more pattern
  • Positive framing emphasizes what works vs what is missing
  • All documentation links verified working

Results

Metric Target Actual
Time to first run < 5 min ~3 min
Manual interventions 0 0
Learning enabled 100% 100%

New Files

  • atlas/cli/candidate_selection.py - LLM-based agent selection with fallback
  • atlas/cli/config_defaults.py - Anthropic configuration templates
  • atlas/cli/progress.py - Output formatting utilities
  • atlas/cli/education.py - Mental model education (not yet integrated)
  • tests/integration/test_env_init_anthropic.py - Integration tests

KV Cache Optimization (PR #144)

Configurable playbook injection modes optimize LLM provider KV cache usage for improved latency and reduced costs.

What Changed

Simplified Injection API

  • Removed confusing separate_message mode
  • Two clear modes:
    • prefix (default): Playbook injected before system prompt
    • suffix: Playbook injected after system prompt (enables KV cache reuse)

Critical Bug Fixes

  • Fixed learning persistence bug where empty dict blocked persistence
  • Disabled actionability gate in evaluation configs to allow cognitive learnings

Performance Benefits

  • Suffix mode preserves static system prompt for KV cache reuse
  • Reduced latency for subsequent requests (cached prefix not reprocessed)
  • Lower token costs (providers charge less for cached tokens)

Testing

Unit test suite added with 13 tests covering:

  • Prefix/suffix injection modes
  • Few-shot example extraction and formatting
  • Redaction pattern validation

End-to-end verification with OpenAI GPT-4o-mini:

  • First run: Generated 7 playbook entries (1,076 chars)
  • Second run: Loaded and injected learning (+3,126 prompt tokens from playbook)

Dependencies

  • Added anthropic>=0.74.1 for LLM-based candidate selection

Breaking Changes

None. All changes are backward compatible:

  • Heuristic fallback preserves original env init behavior
  • Default playbook injection mode remains prefix
  • Existing flags and options preserved

Installation

pip install --upgrade arc-atlas

Documentation

  • Updated README.md with new quickstart flow
  • Updated docs/sdk/quickstart.mdx and docs/guides/introduction.mdx
  • Updated docs/sdk/learning_tracking.md with injection mode documentation

Contributors

Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com