Skip to content

v0.1.0

Choose a tag to compare

@agunapal agunapal released this 14 Apr 15:56
· 5 commits to main since this release
f2a616c

aevyra-reflex is an agentic prompt optimizer that iterates on your prompt until it hits the target score.

What's included in v0.1.0

Optimization engine

  • Iterative prompt optimization with train/val/test split and early stopping on val plateau
  • Mini-batch sampling for faster iterations
  • Statistical significance testing across multi-run evals
  • Resume interrupted runs from last checkpoint

Strategies

  • Iterative rewriting with diagnosis of eval failures
  • Structural transforms (reorder, rephrase, expand, compress) with transform history
  • Adaptive multi-ranker fusion with learned method weights (PDO)
  • Label-free aware diagnosis and refinement

Providers

  • OpenAI, Anthropic, Google Gemini, OpenRouter
  • Local models via any OpenAI-compatible API (Ollama, vLLM)
  • --source-model flag for model migration context

Integrations

  • MLflow: per-iteration score tracking (train/val/test), best prompt logging
  • W&B: per-iteration charts with score_train, score_val, score_test series

CLI

  • aevyra-reflex optimize — run prompt optimization
  • --mlflow / --wandb flags for experiment tracking
  • --judge-criteria flag for custom eval criteria
  • Dashboard for run history and analysis

Docs

Install

pip install aevyra-reflex