Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: Chat completion functions #588

Closed
mudler opened this issue Jun 13, 2023 · 2 comments · Fixed by #726
Closed

feature: Chat completion functions #588

mudler opened this issue Jun 13, 2023 · 2 comments · Fixed by #726
Assignees
Labels
enhancement New feature or request

Comments

@mudler
Copy link
Owner

mudler commented Jun 13, 2023

Have a feature that mimics OpenAI functions: https://openai.com/blog/function-calling-and-other-api-updates.

From the documentation, it seems OpenAI trained the model to respond to the system prompt.

For LocalAI, I think there should be a minimum viable implementation that should work across models. While custom models could be trained to reflect a specific prompt that is injected, that would limit this functionalities to restricted models.

@mudler mudler added the enhancement New feature or request label Jun 13, 2023
@mudler mudler self-assigned this Jun 13, 2023
@mudler
Copy link
Owner Author

mudler commented Jun 15, 2023

likely depending on #354

@mudler
Copy link
Owner Author

mudler commented Jul 2, 2023

I've posted my updates on the upstream PR: ggerganov/llama.cpp#1773 (comment) to give early feedback on the feature

This depends on: ggerganov/llama.cpp#1773

@mudler mudler mentioned this issue Jul 6, 2023
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant