Open Router deepseek/deepseek-r1-distill-llama-70b:free not showing as free

[hannesrudolph]

Which version of the app are you using?

3.7.11

Which API Provider are you using?

OpenRouter

Which Model are you using?

deepseek/deepseek-r1-distill-llama-70b:free

What happened?

Steps to reproduce

Use above model :)

Relevant API REQUEST output

Additional context

No response

[Jdo300]

I'll look into this one

[Jdo300]

OK, I found the bug! The issue is here in this switch statement on line 257 in openrouter.ts:

// NOTE: this needs to be synced with api.ts/openrouter default model info.
switch (true) {
	case rawModel.id.startsWith("anthropic/claude-3.7-sonnet"):
		modelInfo.supportsComputerUse = true
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 3.75
		modelInfo.cacheReadsPrice = 0.3
		modelInfo.maxTokens = rawModel.id === "anthropic/claude-3.7-sonnet:thinking" ? 128_000 : 16_384
		break
	case rawModel.id.startsWith("anthropic/claude-3.5-sonnet-20240620"):
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 3.75
		modelInfo.cacheReadsPrice = 0.3
		modelInfo.maxTokens = 8192
		break
	case rawModel.id.startsWith("anthropic/claude-3.5-sonnet"):
		modelInfo.supportsComputerUse = true
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 3.75
		modelInfo.cacheReadsPrice = 0.3
		modelInfo.maxTokens = 8192
		break
	case rawModel.id.startsWith("anthropic/claude-3-5-haiku"):
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 1.25
		modelInfo.cacheReadsPrice = 0.1
		modelInfo.maxTokens = 8192
		break
	case rawModel.id.startsWith("anthropic/claude-3-opus"):
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 18.75
		modelInfo.cacheReadsPrice = 1.5
		modelInfo.maxTokens = 8192
		break
	case rawModel.id.startsWith("anthropic/claude-3-haiku"):
	default:
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 0.3
		modelInfo.cacheReadsPrice = 0.03
		modelInfo.maxTokens = 8192
		break
}

It always uses the hard-coded values under the default case for any of the models other than anthropic. I propose the following update to correct the issue:

// NOTE: this needs to be synced with api.ts/openrouter default model info.
switch (true) {
	case rawModel.id.startsWith("anthropic/claude-3.7-sonnet"):
		modelInfo.supportsComputerUse = true
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 3.75
		modelInfo.cacheReadsPrice = 0.3
		modelInfo.maxTokens = rawModel.id === "anthropic/claude-3.7-sonnet:thinking" ? 128_000 : 16_384
		break
	case rawModel.id.startsWith("anthropic/claude-3.5-sonnet-20240620"):
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 3.75
		modelInfo.cacheReadsPrice = 0.3
		modelInfo.maxTokens = 8192
		break
	case rawModel.id.startsWith("anthropic/claude-3.5-sonnet"):
		modelInfo.supportsComputerUse = true
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 3.75
		modelInfo.cacheReadsPrice = 0.3
		modelInfo.maxTokens = 8192
		break
	case rawModel.id.startsWith("anthropic/claude-3-5-haiku"):
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 1.25
		modelInfo.cacheReadsPrice = 0.1
		modelInfo.maxTokens = 8192
		break
	case rawModel.id.startsWith("anthropic/claude-3-opus"):
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 18.75
		modelInfo.cacheReadsPrice = 1.5
		modelInfo.maxTokens = 8192
		break
	case rawModel.id.startsWith("anthropic/claude-3-haiku"):
		modelInfo.supportsPromptCache = true
		modelInfo.cacheWritesPrice = 0.3
		modelInfo.cacheReadsPrice = 0.03
		modelInfo.maxTokens = 8192
		break
	default:
		break
}

I tested this update and confirmed that no model pricing shows for this (or any other free models) for OpenRouter now.
I'll submit a PR for this change.