Skip to content

Commit 6345f0c

Browse files
TimeToBuildBobTest User
andauthored
fix(eval): fix reflection model used in GEPA optimizer (#814)
* fix(eval): update reflection model to claude-sonnet-4-5 Claude 3.5 Sonnet was retired on October 22, 2025. Update GEPA optimizer to use claude-sonnet-4-5 with provider prefix. Fixes model 404 errors in GEPA optimization runs. Co-authored-by: Bob <bob@superuserlabs.org> * fix --------- Co-authored-by: Test User <test@example.com>
1 parent 644eadd commit 6345f0c

File tree

1 file changed

+2
-8
lines changed

1 file changed

+2
-8
lines changed

gptme/eval/dspy/prompt_optimizer.py

Lines changed: 2 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -46,15 +46,9 @@ def to_dspy_format(gptme_model: str) -> str:
4646
def get_reflection_model(base_model: str) -> str:
4747
"""Get a more powerful model for reflection tasks."""
4848
if base_model.startswith("anthropic/"):
49-
if "haiku" in base_model.lower():
50-
return "claude-3-5-sonnet-20241022"
51-
else:
52-
return "claude-3-5-sonnet-20241022"
49+
return "claude-sonnet-4-5"
5350
elif base_model.startswith("openai/"):
54-
if "gpt-3.5" in base_model.lower() or "gpt-4o-mini" in base_model.lower():
55-
return "gpt-4o"
56-
else:
57-
return "gpt-4o"
51+
return "gpt-5"
5852
else:
5953
return ModelNameMapper.to_dspy_format(base_model)
6054

0 commit comments

Comments
 (0)