Skip to content

docs(cookbook): Falcon AI, Agent Command Center, MCP, and Evaluation cookbooks#632

Merged
SuhaniNagpal7 merged 10 commits into
devfrom
cookbook/falcon-ai-pages
May 5, 2026
Merged

docs(cookbook): Falcon AI, Agent Command Center, MCP, and Evaluation cookbooks#632
SuhaniNagpal7 merged 10 commits into
devfrom
cookbook/falcon-ai-pages

Conversation

@SuhaniNagpal7
Copy link
Copy Markdown
Contributor

Summary

Adds six new cookbook pages covering Falcon AI workflows, Agent Command Center features, MCP-based trace debugging from the IDE, and a domain-calibrated eval workflow. Adds three new cookbook navigation groups (Falcon AI, Agent Command Center, MCP Server, Evaluation) under the existing cookbook tab.

New pages:

  • cookbook/falcon-ai/end-to-end - full Falcon AI lifecycle (trace, debug, evaluate, dataset, fix) in one chat
  • cookbook/falcon-ai/context-aware-debugging - paste-ready prompt fix in three Falcon AI turns
  • cookbook/falcon-ai/eval-datasets-from-traces - curate eval datasets from production traces
  • cookbook/command-center/fallback-and-weighted-routing - weighted routing + provider failover via agentcc.GatewayConfig
  • cookbook/command-center/semantic-caching - exact and semantic caching at the gateway
  • cookbook/mcp/debug-traces-from-ide - connect FAGI MCP server to Cursor/Claude Code/VS Code/etc.
  • cookbook/evaluation/eval-correction-loop - teach an evaluator domain rules via custom eval + few-shot corrections

Verified each cookbook's code against the actual SDK source (agentcc gateway, ai-evaluation, futureagi MCP tools registry) and against the live dashboard for screenshots.

Test plan

  • Build the docs site locally and confirm new pages render
  • Verify cookbook nav shows the four new groups
  • Spot-check at least one screenshot loads from the S3 CDN
  • Click through internal links (/docs/cookbook/quickstart/manual-tracing, /docs/command-center/features/*) for 404s

🤖 Generated with Claude Code

Copy link
Copy Markdown
Contributor

@NVJKKartik NVJKKartik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Content Looks Good, Please test the code before publishing

config = agentcc.GatewayConfig(
load_balance=agentcc.LoadBalanceConfig(
strategy="weighted",
targets=[
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use latest models not these

import agentcc
from openai import OpenAI

config = agentcc.GatewayConfig(
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are you sure this is possible and correct code, please test.... This feature can be displayed in UI

agentcc.LoadBalanceTarget(model="claude-3-5-sonnet-20241022", provider="anthropic", weight=0.3),
],
),
fallback=agentcc.FallbackConfig(
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

explain the concepts what is fallback, load_balance etc like one liner and maybe refer to docs

response = client.chat.completions.with_raw_response.create(
model="gpt-4o-mini",
messages=[{"role": "user", "content": "Hello"}],
)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This code looks wrong as you are using openai client, maybe replace it with curl


r = client.chat.completions.with_raw_response.create(
model="gpt-4o-mini",
messages=[{"role": "user", "content": "What is your return policy?"}],
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same as before change the model names, also code looks wrong again....

"config": {"model": "turing_flash"},
},
)
print(resp.json()) # {"eval_template_id": "...", "name": "support_reply_quality_v1"}
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

describe what the response wil look like

Suhani Nagpal added 2 commits May 5, 2026 14:43
- semantic-caching: add Install intro line, remove em/en dashes
- mcp/debug-traces-from-ide: remove em dashes
- evaluation/eval-correction-loop: document full create_custom_evals response shape
- astro.config.mjs: add server.allowedHosts so ngrok/cloudflare/localtunnel domains work in dev
- nav: drop fallback-and-weighted-routing entry; remove the page from this PR (kept locally for later)
@SuhaniNagpal7 SuhaniNagpal7 merged commit b5d9d7a into dev May 5, 2026
1 check passed
@SuhaniNagpal7 SuhaniNagpal7 deleted the cookbook/falcon-ai-pages branch May 5, 2026 10:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants