Skip to content

Add supported model configuration and llm matrix in docs #596

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Aug 23, 2024
Merged

Add supported model configuration and llm matrix in docs #596

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
7f94ac6
Add supported model configuration and llm matrix in docs
MaedahBatool Aug 23, 2024
1227cb0
Update docs/cody/clients/enable-cody-enterprise.mdx
MaedahBatool Aug 23, 2024
3b4b4dc
Update docs/cody/clients/enable-cody-enterprise.mdx
MaedahBatool Aug 23, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 25 additions & 0 deletions docs/cody/clients/enable-cody-enterprise.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -72,3 +72,28 @@ Cody Enterprise supports searching up to 10 repositories to find relevant contex
Sourcegraph Enterprise supports many different LLM providers and models. You can use state of the art code completion models such as Anthropic's Claude or OpenAI's ChatGPT by adjusting your Sourcegraph instance's configuration.

Refer to the [Model Configuration](/cody/clients/model-configuration) or [Supported Models](/cody/capabilities/supported-models) sections for more information.
Use the drop-down menu to make your desired selection and get a detailed breakdown of the supported LLM models for each provider on Cody Enterprise.

<FeatureParity type='ent' />
For the supported LLM models listed above refer to the following notes:

1. Microsoft Azure is planning to deprecate the APIs used in SG version less than `5.3.3` on July 1, 2024 [Source](https://learn.microsoft.com/en-us/azure/ai-services/openai/api-version-deprecation)
2. Claude 2.1 is not recommended
3. Sourcegraph doesn't recommend GPT-4 non-turbo, Claude 1 or 2 models
4. Only supported through legacy completions API
5. BYOK with managed services are only supported for Self-hosted Sourcegraph instances
6. GPT-4 and GPT-4o for completions has a bug that is resulting in many failed completions

### Supported model configuration

Use the drop-down menu to make your desired selection and get a detailed breakdown of the supported model configuration for each provider on Cody Enterprise. This is an on-site configuration. Admins should pick a value from the table for `chatModel` to configure their chat model.

<FeatureParity type='configuration' />

For the supported LLM model configuration listed above refer to the following notes:

1. Microsoft Azure is planning to deprecate the APIs used in SG version less than `5.3.3` on July 1, 2024 [Source](https://learn.microsoft.com/en-us/azure/ai-services/openai/api-version-deprecation)
2. Claude 2.1 is not recommended
3. Sourcegraph doesn't recommend GPT-4 non-turbo, Claude 1 or 2 models
4. Only supported through legacy completions API
5. BYOK with managed services are only supported for Self-hosted Sourcegraph instances