Skip to content

Commit

Permalink
feat: Add Cohere Command R / R+ model support (langgenius#3333)
Browse files Browse the repository at this point in the history
  • Loading branch information
takatost authored and Gzn committed Apr 15, 2024
1 parent bc71741 commit a83ddb7
Show file tree
Hide file tree
Showing 16 changed files with 404 additions and 128 deletions.
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
- command-r
- command-r-plus
- command-chat
- command-light-chat
- command-nightly-chat
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ parameter_rules:
max: 500
- name: max_tokens
use_template: max_tokens
default: 256
default: 1024
max: 4096
- name: preamble_override
label:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ parameter_rules:
max: 500
- name: max_tokens
use_template: max_tokens
default: 256
default: 1024
max: 4096
- name: preamble_override
label:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ parameter_rules:
max: 500
- name: max_tokens
use_template: max_tokens
default: 256
default: 1024
max: 4096
- name: preamble_override
label:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ parameter_rules:
use_template: frequency_penalty
- name: max_tokens
use_template: max_tokens
default: 256
default: 1024
max: 4096
pricing:
input: '0.3'
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ parameter_rules:
use_template: frequency_penalty
- name: max_tokens
use_template: max_tokens
default: 256
default: 1024
max: 4096
pricing:
input: '0.3'
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ parameter_rules:
max: 500
- name: max_tokens
use_template: max_tokens
default: 256
default: 1024
max: 4096
- name: preamble_override
label:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ parameter_rules:
use_template: frequency_penalty
- name: max_tokens
use_template: max_tokens
default: 256
default: 1024
max: 4096
pricing:
input: '1.0'
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@
model: command-r-plus
label:
en_US: command-r-plus
model_type: llm
features:
- multi-tool-call
- agent-thought
- stream-tool-call
model_properties:
mode: chat
context_size: 128000
parameter_rules:
- name: temperature
use_template: temperature
max: 5.0
- name: p
use_template: top_p
default: 0.75
min: 0.01
max: 0.99
- name: k
label:
zh_Hans: 取样数量
en_US: Top k
type: int
help:
zh_Hans: 仅从每个后续标记的前 K 个选项中采样。
en_US: Only sample from the top K options for each subsequent token.
required: false
default: 0
min: 0
max: 500
- name: presence_penalty
use_template: presence_penalty
- name: frequency_penalty
use_template: frequency_penalty
- name: max_tokens
use_template: max_tokens
default: 1024
max: 4096
pricing:
input: '3'
output: '15'
unit: '0.000001'
currency: USD
45 changes: 45 additions & 0 deletions api/core/model_runtime/model_providers/cohere/llm/command-r.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@
model: command-r
label:
en_US: command-r
model_type: llm
features:
- multi-tool-call
- agent-thought
- stream-tool-call
model_properties:
mode: chat
context_size: 128000
parameter_rules:
- name: temperature
use_template: temperature
max: 5.0
- name: p
use_template: top_p
default: 0.75
min: 0.01
max: 0.99
- name: k
label:
zh_Hans: 取样数量
en_US: Top k
type: int
help:
zh_Hans: 仅从每个后续标记的前 K 个选项中采样。
en_US: Only sample from the top K options for each subsequent token.
required: false
default: 0
min: 0
max: 500
- name: presence_penalty
use_template: presence_penalty
- name: frequency_penalty
use_template: frequency_penalty
- name: max_tokens
use_template: max_tokens
default: 1024
max: 4096
pricing:
input: '0.5'
output: '1.5'
unit: '0.000001'
currency: USD
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ parameter_rules:
use_template: frequency_penalty
- name: max_tokens
use_template: max_tokens
default: 256
default: 1024
max: 4096
pricing:
input: '1.0'
Expand Down
Loading

0 comments on commit a83ddb7

Please sign in to comment.