Skip to content

Add Vultr#321

Merged
rekram1-node merged 7 commits into
anomalyco:devfrom
cyberofficial:vultr
Oct 22, 2025
Merged

Add Vultr#321
rekram1-node merged 7 commits into
anomalyco:devfrom
cyberofficial:vultr

Conversation

@cyberofficial

Copy link
Copy Markdown
Contributor

This pull request adds support for several new AI models and a new provider configuration for Vultr. The main changes include the addition of five model configuration files, each describing a different model's capabilities, costs, and limits, as well as the introduction of the provider configuration for Vultr.

New Model Configurations

  • Added configuration for DeepSeek R1 Distill Llama 70B with detailed capabilities, cost, and limits in deepseek-r1-distill-llama-70b.toml.
  • Added configuration for DeepSeek R1 Distill Qwen 32B in deepseek-r1-distill-qwen-32b.toml.
  • Added configuration for GPT OSS 120B in gpt-oss-120b.toml.
  • Added configuration for Kimi K2 Instruct in kimi-k2-instruct.toml.
  • Added configuration for Qwen2.5 Coder 32B Instruct in qwen2.5-coder-32b-instruct.toml.

All models include pricing at $0.20 per million tokens for input/output.

Provider Configuration

  • Introduced the Vultr provider configuration in provider.toml, specifying API endpoint, npm package, environment variable, and documentation link.
  • Added Vultr provider logo in logo.svg.

@cyberofficial
cyberofficial marked this pull request as draft October 22, 2025 11:33
@cyberofficial

cyberofficial commented Oct 22, 2025

Copy link
Copy Markdown
Contributor Author

Converted to draft, I've put in a ticket with vultr support to get the token limits for the models, I believe they might have a different system in place, but think the numbers are correct from testing. But they are openai compatible since i've been using RooCode with it via OpenAi compat api

@cyberofficial
cyberofficial marked this pull request as ready for review October 22, 2025 12:50
@cyberofficial

Copy link
Copy Markdown
Contributor Author

Got the exact numbers from support 👍

Comment thread providers/vultr/logo.svg Outdated
@@ -0,0 +1 @@
<svg id="sygnet__on-white" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 42 36.09"><defs><style>.cls-1{fill:#c9f4ff;}.cls-2{fill:#51b9ff;}.cls-3{fill:#007bfc;}</style></defs><title>sygnet__on-white</title><path class="cls-1" d="M14.63,4a2.09,2.09,0,0,0-1.77-1H2.1A2.1,2.1,0,0,0,0,5.1,2.12,2.12,0,0,0,.32,6.22l2.77,4.07,13.85-3Z" transform="translate(0 -3)"/><path class="cls-2" d="M17,7.37a2.11,2.11,0,0,0-1.78-1H4.5A2.09,2.09,0,0,0,2.66,9.61l3.09,4.9,14.31-2.24Z" transform="translate(0 -3)"/><path class="cls-3" d="M5.62,14.31a2.14,2.14,0,0,1-.19-1.88,2.11,2.11,0,0,1,2-1.34H18.15a2.1,2.1,0,0,1,1.78,1l9.63,15.27a2.12,2.12,0,0,1,.32,1.12,2.15,2.15,0,0,1-.32,1.12l-5.38,8.53a2.11,2.11,0,0,1-3.56,0Z" transform="translate(0 -3)"/><path class="cls-3" d="M32.74,19.19a2.11,2.11,0,0,0,3.56,0l1.85-2.93,3.53-5.6A2.12,2.12,0,0,0,42,9.54a2.15,2.15,0,0,0-.32-1.12L38.88,4A2.11,2.11,0,0,0,37.1,3H26.34a2.1,2.1,0,0,0-2.1,2.1,2,2,0,0,0,.33,1.12Z" transform="translate(0 -3)"/></svg> No newline at end of file

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can u make this square?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@rekram1-node

Copy link
Copy Markdown
Collaborator

open_weights is required field for the models too btw :)

Thanks for PR!

Added the open_weights property for deepseek-r1-distill-llama-70b, deepseek-r1-distill-qwen-32b, gpt-oss-120b, kimi-k2-instruct, and qwen2.5-coder-32b-instruct models. Also updated Vultr logo.svg viewBox from 36.09 to 42 to be square
@cyberofficial

Copy link
Copy Markdown
Contributor Author

open_weights is required field for the models too btw :)

Thanks for PR!

I believe that should fix right?

@rekram1-node

Copy link
Copy Markdown
Collaborator

lgtm thanks!

@rekram1-node
rekram1-node merged commit a8b3e08 into anomalyco:dev Oct 22, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants