Skip to content

Add Clarvia AEO tool for pre-flight API quality validation in flows #4102

@digitamaz

Description

@digitamaz

Add Clarvia AEO Tool for PromptFlow Tool Quality Validation

What is Clarvia?

Clarvia provides AEO (Agent Experience Optimization) scores for 27,000+ tools and APIs. It helps PromptFlow users identify which tools are properly documented and reliable for LLM orchestration.

PromptFlow Integration

from promptflow.core import tool
import requests

@tool
def clarvia_check(tool_name: str, min_score: int = 60) -> dict:
    """
    Check tool quality before use in a PromptFlow DAG.
    
    Inputs:
    - tool_name: Name of the API or tool to check
    - min_score: Minimum acceptable AEO score
    
    Output:
    - score, grade, is_ready, recommendations
    """
    resp = requests.get(f"https://clarvia-api.onrender.com/v1/check/{tool_name}")
    data = resp.json()
    return {
        "score": data.get("score", 0),
        "grade": data.get("grade", "Unknown"),
        "is_ready": data.get("score", 0) >= min_score,
        "tools_count": data.get("tools_count", 0)
    }

Use Case

In a PromptFlow workflow that calls external APIs, add a Clarvia pre-check node:

  1. Pass the API name to Clarvia
  2. Route based on is_ready flag
  3. Fallback path for low-score tools

API: https://clarvia-api.onrender.com
npm: 714 weekly downloads
GitHub: https://github.com/clarvia-project/clarvia-mcp-server

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions