Skip to content

Commit

Permalink
feat: update model configurations and API links
Browse files Browse the repository at this point in the history
- Update the link to Groq API Service
- Add a new model configuration for OpenAI
- Update the model names for LLaMA2-70b and Mixtral-8x7b-Instruct-v0.1

Signed-off-by: appleboy <appleboy.tw@gmail.com>
  • Loading branch information
appleboy committed Mar 22, 2024
1 parent b3d2950 commit b36bf4b
Showing 1 changed file with 5 additions and 3 deletions.
8 changes: 5 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -115,22 +115,24 @@ codegpt config set openai.api_key xxxxxxxxxxxxxxxx
codegpt config set openai.model_name xxxxx-gpt-35-turbo
```

### How to change to Groq API Service
### How to change to [Groq][30] API Service

Please get the `API key` from Groq API Service, please vist [here][31]. Update the `base_url` and `api_key` in your config file.

```sh
codegpt config set openai.provider openai
codegpt config set openai.base_url https://api.groq.com/openai/v1
codegpt config set openai.api_key gsk_xxxxxxxxxxxxxx
codegpt config set openai.model LLaMA2-70b-chat
```

Support the [following models][32]:

1. LLaMA2-70b (Meta) **recommended**
2. Mixtral-8x7b (Mistral)
1. LLaMA2-70b-chat (Meta) **recommended**
2. Mixtral-8x7b-Instruct-v0.1 (Mistral)
3. Gemma-7b-it (Google)

[30]: https://groq.com/
[31]: https://console.groq.com/keys
[32]: https://console.groq.com/docs/models

Expand Down

0 comments on commit b36bf4b

Please sign in to comment.