Allow users to specify the LLM endpoint (APIs) for other models

[nmcbride]

Discord username (optional)

No response

Describe the solution you'd like?

Allow us to specify the LLM endpoint to use for local models or other online ones.

Would like to point warp to an alternative online LLM or OpenRouter

Is your feature request related to a problem? Please describe.

No response

Additional context

No response

How important is this feature to you?

3 (Fairly important)

Warp Internal (ignore) - linear-label:39cc6478-1249-4ee7-950b-c428edfeecd1

None

[dannyneira]

Hi @nmcbride Thanks for submitting this feature request!

To anyone else interested in this feature, please add a 👍 to the original post at the top to signal that you want this feature, and subscribe if you'd like to be notified.

Note, we are tracking Bring Your Own API Key (BYOK) here: #7422
and Local LLM support here: #7182

[sintaxx]

I already have subscriptions to Claude and ChatGPT and would love to be able to plug them in to warp.

[dwSun]

As a commercial company, paid AI usage is Warp's profit model. So Warp may not have much motivation to do this on its own. However, considering that deploying an LLM model is already a highly technical behavior. Having this function can be another gimmick for promoting products. In comparison, Warp's market share may further increase. Therefore, please consider providing this function and use it to promote products.

[drakzonbm]

I'd love to see this feature and I don't think it would interfere that much with the commercial nature of WARP local LLM's will always be a little behind when it comes to intelligence plenty of people will want to use a commercial LLM at times even if this is an option I think

[thezacharytaylor]

I'd love to plug Mistral's new Devstral into Warp and try it out so this would be great if we could do this and specify the model as well via a text field.