Skip to content

v0.7.0 — Execution Optimization

Choose a tag to compare

@lacrous lacrous released this 23 Aug 06:33
· 13 commits to main since this release

v0.7.0 — Execution Optimization

🧠 Execution Plan

New plan() method returns the full execution decision:

const plan = client.plan({ task: "coding", messages, policy: { allowFallback: true } });
console.log(plan.primary.model);        // Best model
console.log(plan.estimatedTotalCost);    // Primary + retry + repair estimate
console.log(plan.fallbacks);             // Alternative models

📊 9-Dimension Scoring

Enhanced explainability with detailed score breakdown:

result.scoreBreakdown = {
  capabilityFit: 83,    taskFit: 95,     contextFit: 80,
  costEfficiency: 70,   latency: 65,     budgetAlignment: 75,
  providerPreference: 5, structuredOutputFit: 0, toolFit: 10,
  finalScore: 82.4
}

⬇️ Automatic Fallback

Policy-driven model fallback on failure:

await client.complete({
  task: "coding",
  messages,
  policy: { allowFallback: true, maxCost: 0.05 },
});

Fallback respects all constraints — capabilities, cost, budget, context.

📡 Fallback Observability

client.on("fallback.started", (event) => {
  console.log(`Falling back: ${event.originalModel}${event.fallbackModel}`);
});

422 Tests Passing

31 new tests covering execution plan, scoring, fallback, determinism, and adversarial inputs.


Changelog: https://github.com/Hilbras/Hilbras-ai-sdk/blob/main/CHANGELOG.md