Sort models per provider based on reasonable heuristics to avoid random default model #121
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes #117
This finally resolves a long-standing issue where the default model chosen for a provider would be sort of "random", or rather the first model returned by the provider's API listings.
The solution is to implement model sorting per provider via reasonable heuristics, without getting too opinionated:
Keep in mind that the sorting is per provider. There is no issue with this in terms of favoring any specific provider, the sorting is just for their models internally.
For easy testing of the sorted model IDs per provider, do this:
var_dump($modelId);for each$modelIditerated over inPromptBuilder::generateMapFromCandidates(e.g. line 1216).--providerId(with each "anthropic", "google", "openai").