Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

V0.26 #155

Merged
merged 38 commits into from
Mar 6, 2024
Merged

V0.26 #155

merged 38 commits into from
Mar 6, 2024

Conversation

hverlind
Copy link
Contributor

@hverlind hverlind commented Mar 6, 2024

  • Add support for Mistral AI (Small, Large)
  • Add support for Anthropic Claude 3 (Sonnet, Opus)
  • Add support for system prompt in Anthropic models
  • Add support for Mistral embedding model (mistral-embed)

Role is 'function' for OpenAI but 'tool' for Mistral.
All of this logic could be reused really.
Needs a bit more cleanup by factoring out some common functionality between OpenAI and Mistral.
This includes all the logic to deal with streamed JSON functions.
This is the bit that is different between OpenAI and Mistral.
This avoids showing "(unavailable)" in usage graph (maybe elsewhere too).
This is only needed when the cell is inactive because otherwise we have a proper editor.
This feels better than only using the space needed, because the height doesn't change dynamically when you add more rows or expand a cell with a lot of content.
There is a bug in the client library (with open but unmerged pull request) that causes Gemini to fail because it replaces the global implementation of node fetch.
Doing this implicitly feels ok given it's a minor version update (i.e. we can consider the major version to always point to the last minor version). Required to be able to switch to the new messages API.
Doing this implicitly feels ok given it's a minor version update (i.e. we can consider the major version to always point to the last minor version). Required to be able to switch to the new messages API.
This is more elegant than the old hardcoded string prefixes (and more in line with other providers). Also required for the Claude 3 models.
We can't really call Claude 2 Anthropic's most powerful model anymore now that we're adding Claude 3 models.
This can be used to detect abuse (similar to OpenAI).
@hverlind hverlind merged commit 6eb9b28 into main Mar 6, 2024
2 checks passed
@hverlind hverlind deleted the v0.26 branch April 24, 2024 10:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant