Skip to content

Add Scaleway Generative APIs LLM provider #6165

Description

@paolobarbolini

What do you want to change?

I'd like to add Scaleway Generative APIs as a provider in Pi.

Why?

Scaleway is a French company that hosts Open Weight models in the EU, with zero data retention https://www.scaleway.com/en/docs/generative-apis/reference-content/data-privacy/.

I think adding them would promote the option of using Open Weight models for companies in the EU that needs a Data Protection Agreement.

Honestly their service could be better. The biggest issue is that right now they don't implement caching, so a model like GLM 5.2 can cost tens of euros in very little time. The feature request for that is at https://feature-request.scaleway.com/posts/1251/prompt-caching-to-reduce-input-tokens-cost. In a way I'm also hoping for this move to get them to realize the many opportunities they are missing given the lack of caching and prioritize getting it implemented.

How? (optional)

Their API follows the openai-completion style. I've already tested adding them locally. The only thing I haven't looked into yet is making prices appear with the euro symbol instead of dollars in npm:@qmxme/pi-stats. That may require a bit more investigation if Pi, the website and the extensions all expect prices to be in USD.

Metadata

Metadata

Assignees

No one assigned

    Labels

    no-actionThis issue has been rejected after triage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions