Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Together AI Client #2919

Merged
merged 22 commits into from
Jun 21, 2024
Merged

Together AI Client #2919

merged 22 commits into from
Jun 21, 2024

Conversation

marklysze
Copy link
Collaborator

@marklysze marklysze commented Jun 11, 2024

This is a Together AI Client that provides a way to use the Together AI cloud inference service, which provides options to use many LLMs, such as Google's Gemma, Meta's Llama 2/3, Qwen, Mistral.AI's Mistral, and Mixtral, NousResearch's Hermes models.

This client supports text generation and function/tool calling (when using certain models as noted by Together AI).

Token costs are also implemented.

Will be used in the upcoming blog post #2965.

Related issue number

Can be used for #2916.

Checks

@marklysze marklysze self-assigned this Jun 11, 2024
@marklysze marklysze added the alt-models Pertains to using alternate, non-GPT, models (e.g., local models, llama, etc.) label Jun 11, 2024
@sonichi sonichi enabled auto-merge June 21, 2024 17:10
@sonichi sonichi added this pull request to the merge queue Jun 21, 2024
Merged via the queue into main with commit b1ec3ae Jun 21, 2024
117 of 131 checks passed
@sonichi sonichi deleted the togetherai_client branch June 21, 2024 17:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
alt-models Pertains to using alternate, non-GPT, models (e.g., local models, llama, etc.)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants