Repository navigation
What's new in v0.2.0
Pipeline mode
Optimize prompts that live inside multi-step agent pipelines — classify → retrieve → generate — not just single LLM calls. Standard mode scores a string against an ideal; pipeline mode re-runs your full agent on every candidate prompt and scores the complete execution trace.
How it works: wrap your existing agent in a pipeline_fn(prompt, input) -> AgentTrace function — your pipeline code doesn't change. Mark the node being optimized with optimize=True; everything else is passed to the judge as grounding context.
AgentTraceandTraceNodetypes for structured trace recordingset_pipeline()+set_inputs()Python API--pipeline-file+--inputs-fileCLI flagsAgentTrace.tokensfield for tracking pipeline token usage alongside judge tokens- Per-sample timeout with graceful 0.0 scoring on context-window overflow
- All four strategies work in pipeline mode, including PDO
CLI
aevyra-reflex optimize prompt.md \
--pipeline-file pipeline.py \
--inputs-file inputs.json \
--reasoning-model openrouter/qwen/qwen3-8b \
--judge openrouter/qwen/qwen3-30b-a3b \
--judge-criteria criteria.mdLanguage detection
Reflex now detects the dominant language of the training set at run start using Unicode character-range heuristics. The reasoning model writes prompt revisions and diagnostic explanations in the same language as the dataset — preventing multilingual models from silently switching languages mid-optimization. A 15% threshold guards against mislabelling English text that contains quoted foreign terms.
Dashboard fix
Fixed an unterminated string literal in the empty-state UI that caused the dashboard to show a blank loading screen instead of the run list.
Docs
- New Modes guide — when to use standard mode vs pipeline mode
- New Pipeline mode tutorial — optimizing a tool-calling developer assistant end-to-end with real run logs
Install
pip install aevyra-reflex==0.2.0