Skip to content

feat(genapi): update supported models status #5055

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Jun 4, 2025
Merged

feat(genapi): update supported models status #5055

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
ef6c01f
feat(genapi): update supported models status
fpagny Jun 3, 2025
71de209
feat(genapi): update end of life models
fpagny Jun 3, 2025
453cf63
fix(genapi): update typos
fpagny Jun 3, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 11 additions & 7 deletions pages/generative-apis/reference-content/supported-models.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ Our API supports the most popular models for [Chat](/generative-apis/how-to/quer
| Provider | Model string | Context window (Tokens) | Maximum output (Tokens)| License | Model card |
|-----------------|-----------------|-----------------|-----------------|-----------------|-----------------|
| Google (Preview) | `gemma-3-27b-it` | 40k | 8192 | [Gemma](https://ai.google.dev/gemma/terms) | [HF](https://huggingface.co/google/gemma-3-27b-it) |
| Mistral (Preview) | `mistral-small-3.1-24b-instruct-2503` | 128k | 8192 | [Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0) | [HF](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503) |
| Mistral | `mistral-small-3.1-24b-instruct-2503` | 128k | 8192 | [Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0) | [HF](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503) |

## Chat models

Expand All @@ -29,7 +29,7 @@ Our API supports the most popular models for [Chat](/generative-apis/how-to/quer
| Mistral | `mistral-nemo-instruct-2407` | 128k | 8192 | [Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0) | [HF](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407) |
| Qwen | `qwen2.5-coder-32b-instruct` | 32k | 8192 | [Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0) | [HF](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct) |
| DeepSeek (Preview) | `deepseek-r1` | 20k | 4096 | [MIT](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md) | [HF](https://huggingface.co/deepseek-ai/DeepSeek-R1) |
| DeepSeek (Preview) | `deepseek-r1-distill-llama-70b` | 32k | 4096 | [MIT](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md) | [HF](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-70B) |
| DeepSeek | `deepseek-r1-distill-llama-70b` | 32k | 4096 | [MIT](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/mit.md) | [HF](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-70B) |

<Message type="note">
DeepSeek-R1 is currently under maintenance and therefore not available on Generative APIs anymore.
Expand Down Expand Up @@ -63,18 +63,22 @@ Our [Embeddings API](/generative-apis/how-to/query-embedding-models) provides bu

## Deprecated models

Scaleway's model lifecyle is introduced on our [dedicated documentation page](/generative-apis/reference-content/model-lifecycle/).
These models can still be accessed in Generative APIs, but their End of Life (EOL) is planned according to our [model lifecyle policy](/generative-apis/reference-content/model-lifecycle/).
Deprecated models should not be queried anymore. We recommend to use newer models available in Generative APIs or to deploy these models in dedicated [Managed Inference](https://console.scaleway.com/inference/deployments) deployments.

| Provider | Model string | EOL date
| Provider | Model string | End of Life (EOL) date
|-----------------|-----------------|-----------------|
| Meta | `llama-3.1-70b-instruct` | 25th May, 2025 |
| SBERT | `sentence-t5-xxl` | 26 February, 2025 |

<Message type="note">
Llama 3.1 70B is now deprecated. The new Llama 3.3 70B is available with similar or better performance in most use cases.
After May 25th 2025, your requests to Llama 3.1 70B will be redirected automatically to Llama 3.3 70B. Llama 3.1 8B is not affected by this change and remains supported.
</Message>

## EOL models
## End of Life (EOL) models

These models are not accessible anymore from Generative APIs. They can still however be deployed on dedicated [Managed Inference](https://console.scaleway.com/inference/deployments) deployments.

This section will list models that are retired and no longer accessible for use.
| Provider | Model string | EOL date
|-----------------|-----------------|-----------------|
| SBERT | `sentence-t5-xxl` | 26 February, 2025 |