.Net: New Feature: .Net - OpenRouter Connector

[tntwist]

---

name: OpenRouter connector
about: Add a connector to open router

---

Hi there,
it would be nice to have a connector for OpenRouter.
OpenRouter makes it really easy to use multiple ai providers with a single unified api.
From their docs their should be compatible with the OpenAI SDK (see here: https://openrouter.ai/docs/quickstart)

I also played around using the exiting Connector for OpenAi and changed the Endpoint to "https://openrouter.ai/api/v1" like this:

  kernelBuilder.AddOpenAIChatCompletion(
      modelId: model.ProviderIdentifier,
      apiKey: settings.OpenRouterSettings.ApiKey!,
      endpoint: new("https://openrouter.ai/api/v1")
  );

Chat completion does work with this when the response of OpenRouter is successfull.
If there is an error providerwise that is not perfectly handled since open router returns a 200 status code with some error message like this:

{
    "error": {
        "message": "Provider returned error",
        "code": 400,
        "metadata": {
            "raw": "{\n  \"error\": {\n    \"code\": 400,\n    \"message\": \"Invalid JSON payload received. Unknown name \\\"additionalProperties\\\" at 'generation_config.response_schema.properties[0].value.items': Cannot find field.\",\n    \"status\": \"INVALID_ARGUMENT\",\n    \"details\": [\n      {\n        \"@type\": \"type.googleapis.com/google.rpc.BadRequest\",\n        \"fieldViolations\": [\n          {\n            \"field\": \"generation_config.response_schema.properties[0].value.items\",\n            \"description\": \"Invalid JSON payload received. Unknown name \\\"additionalProperties\\\" at 'generation_config.response_schema.properties[0].value.items': Cannot find field.\"\n          }\n        ]\n      }\n    ]\n  }\n}\n",
            "provider_name": "Google AI Studio"
        }
    },
    "user_id": "*******"
}

Using the OpenAi connector we get a null pointer exception since there is no real response.

So best would be to have a real OpenRouter connector that handles this correctly rather than using the OpenAI connector.

[samimejri]

  kernelBuilder.AddOpenAIChatCompletion(
      modelId: model.ProviderIdentifier,
      apiKey: settings.OpenRouterSettings.ApiKey!,
      endpoint: new("https://openrouter.ai/api/v1")
  );

This does not work for me. I get "401 Unauthorized". My API key doesn't seem to be taken into consideration.

Edit:
Never mind, I made it work like this:

OpenAIClient client = new OpenAIClient(new(apiKey), new() { Endpoint = new Uri(endpoint)});

var kernel = Kernel.CreateBuilder()
    .AddOpenAIChatCompletion(
      model,
      client)
    .Build();

Sorry for polluting this discussion!

[Lanayx]

Dedicated openrouter support won't be required if SemanticKernel could allow passing arbitrary parameters to the request (see https://openrouter.ai/docs/api-reference/parameters). As far as I understand currently it's not supported

[tntwist]

We still need a dedicated connector since provider errors are returned as 200ers from openrouter with a custom error json object. the open ai connector cannot handle this. 😅

the open ai connector will simply fail returning the response with a null reference exception.

[markwallace-microsoft]

@tntwist thanks for creating this issue. Rather than building a new connector to work around issues in OpenRouter our preferred option would be to fix the problems in their responses. A 200 OK response isn't strictly correct for an error case. Can you create an issue with the OpenRouter team to get them to make a fix on their side.

[tntwist]

@markwallace-microsoft It seems someone already created a request for this:
OpenRouterTeam/openrouter-examples#14

I will link this issue there and provide some informations to the OpenRouter Team.