Provider registry doesn't work with model IDs that have a colon

[Christopher-Hayes]

Description

I'm testing out the experimental "provider registry" and I've found if the model ID has a : in it, this package will remove everything before the LAST :, which sends the wrong model ID to the LLM API.

Code example

I'm using the OpenAI provider in compatible mode, to allow me to run ollama.

const modelID = 'phi3:medium'
const config = {
  apiKey: '',
  organization: '',
  baseURL: 'http://localhost:11434/v1', // Running ollama locally.
  compatibility: 'compatible', // In 'compatible' mode to use local ollama model.
}
const providerRegistry = createProviderRegistry({
  openai: createOpenAI(config),
})

// Provider registry expects `openai:` if the openai provider is being used.
const { text } = await generateText({
  model: this.providerRegistry.languageModel(`openai:${modelID}`}), // Result: openai:phi3:medium
  // Additional options omitted
})

This will error, because the request to ollama has the model ID, medium, not phi3:medium. Could the registry use the FIRST colon to extract the provider ID, instead of the LAST colon?

Additional context

Alternatively, I can just run

const modelID = 'phi3:medium'
const config = {
  apiKey: '',
  organization: '',
  baseURL: 'http://localhost:11434/v1', // Running ollama locally.
  compatibility: 'compatible', // In 'compatible' mode to use local ollama model.
}
const provider = createOpenAI(config)

const { text } = await generateText({
  model: provider.languageModel(modelID),
  // Additional options omitted
})

and this works fine. So, it's definitely a problem with how the registry decides which provider to use.

[lgrammel]

#2057

[lgrammel]

https://github.com/vercel/ai/releases/tag/ai%403.2.5

[Christopher-Hayes]

That was quick! Thank you.