generated from amazon-archives/__template_Apache-2.0
-
Notifications
You must be signed in to change notification settings - Fork 83
Closed
Description
Bug Description
StrandsEvalsAgentCoreEvaluator.__init__() creates a boto3 client with service name agentcore-evaluation-dataplane, which does not exist in botocore. The Evaluate API lives on the bedrock-agentcore service.
File: bedrock_agentcore/evaluation/integrations/strands_agents_evals/evaluator.py, line 101
self.client = boto3.client("agentcore-evaluation-dataplane", region_name=region, config=client_config)Expected Behavior
Should use bedrock-agentcore:
self.client = boto3.client("bedrock-agentcore", region_name=region, config=client_config)Steps to Reproduce
from bedrock_agentcore.evaluation.integrations.strands_agents_evals import create_strands_evaluator
evaluator = create_strands_evaluator("Builtin.Correctness")
# Raises: botocore.exceptions.UnknownServiceError: Unknown service: 'agentcore-evaluation-dataplane'Environment
bedrock-agentcore==1.3.0(latest)botocore==1.42.47boto3==1.42.47
Related
The same bug exists in the agentcore-samples repo and is being fixed in awslabs/amazon-bedrock-agentcore-samples#784.
Suggested Fix
Change "agentcore-evaluation-dataplane" to "bedrock-agentcore" in evaluator.py line 101. Alternatively, allow users to inject a pre-built boto3 client (like the samples' EvaluationClient does with its boto_client parameter).
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels