New provider for Meta

[VistritPandey]

Description

Now that Meta has its own standalone API enpoint and service, a seperate provider for Meta would be really helpful. Thanks!

Docs: https://llama.developer.meta.com/docs/overview/

[AmrEmad0]

Description

Now that Meta has its own standalone API enpoint and service, a seperate provider for Meta would be really helpful. Thanks!

Docs: https://llama.developer.meta.com/docs/overview/

I use it like this in my workflow and it's working well:

import { createOpenAICompatible } from '@ai-sdk/openai-compatible'

const llama = createOpenAICompatible({
  name: 'Llama',
  baseURL: `https://api.llama.com/compat/v1`, // OpenAI compatibility
  apiKey: '',
});

export const myProvider = customProvider({ 
  languageModels: {
    'chat-model-llama-4-Maverick': wrapLanguageModel({
      model: llama('Llama-4-Maverick-17B-128E-Instruct-FP8'),
      middleware: [
        defaultSettingsMiddleware({
          settings: {
            temperature: 0.6,
            providerMetadata: { 
              openai: {} satisfies OpenAIResponsesProviderOptions,
            },
          },
        }),
        cacheMiddleware
      ],
    }),
    'chat-model-llama-4-Scout': wrapLanguageModel({
      model: llama('Llama-4-Scout-17B-16E-Instruct-FP8'),
      middleware: [
        defaultSettingsMiddleware({
          settings: {
            temperature: 0.6,
            providerMetadata: { 
              openai: {} satisfies OpenAIResponsesProviderOptions,
            },
          },
        }),
        cacheMiddleware
      ],
    }),
  } 
})

[VistritPandey]

Thanks! Yeah I am using the same for now!

[AmrEmad0]

Thanks! Yeah I am using the same for now!

did u solve the problem in the tool calling in llama parallel tool calls i don't think it supported if model will call 1 tool will work but more than this will write tool calls in the response

[VistritPandey]

unfortunately nope. I haven't tried it yet. But if I am not wrong, I did not see any mentions of Llama 4 supporting multiple tool calls at once. Correct me if I am wrong

[lgrammel]

if someone creates a 3rd party package with a provider for the meta api, we can add it to the community providers section