feat: add support for managed identity for Azure OpenAI

[manekinekko]

This PR adds support for Managed Identity in Azure OpenAI.

Here is what the new LlamaIndex settings look like, when using Managed Identity:

import {
  DefaultAzureCredential,
  getBearerTokenProvider,
} from "@azure/identity";

async function initAzureOpenAI() {
  const credential = new DefaultAzureCredential();
  const azureADTokenProvider = getBearerTokenProvider(
    credential,
    "https://cognitiveservices.azure.com/.default",
  );

  const azure = {
    azureADTokenProvider,
    deployment: process.env.AZURE_OPENAI_DEPLOYMENT ?? "gpt-35-turbo",
  };

  // configure LLM model
  Settings.llm = new OpenAI({
    azure,
  }) as any;

  // configure embedding model
  azure.deployment = process.env.EMBEDDING_MODEL as string;
  Settings.embedModel = new OpenAIEmbedding({
    azure,
    model: process.env.EMBEDDING_MODEL,
    dimensions: process.env.EMBEDDING_DIM
      ? parseInt(process.env.EMBEDDING_DIM)
      : undefined,
  });
}

Related issue #921

[changeset-bot]

🦋 Changeset detected

Latest commit: c9fde31

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 10 packages

Name	Type
llamaindex	Patch
docs	Patch
@llamaindex/community	Patch
@llamaindex/experimental	Patch
@llamaindex/cloudflare-worker-agent-test	Patch
@llamaindex/next-agent-test	Patch
@llamaindex/nextjs-edge-runtime-test	Patch
@llamaindex/waku-query-engine-test	Patch
@llamaindex/autotool-01-node-example	Patch
@llamaindex/autotool-02-next-example	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
llama-index-ts-docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jun 11, 2024 8:28pm