Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor the llama.cpp integration #779

Closed
rlouf opened this issue Apr 1, 2024 · 0 comments · Fixed by #782
Closed

Refactor the llama.cpp integration #779

rlouf opened this issue Apr 1, 2024 · 0 comments · Fixed by #782
Labels
enhancement llama.cpp Related to the `llama.cpp` integration

Comments

@rlouf
Copy link
Member

rlouf commented Apr 1, 2024

We should refactor the llama.cpp integration to follow vLLM's integration in #442
@rlouf rlouf added enhancement llama.cpp Related to the `llama.cpp` integration labels Apr 1, 2024
@rlouf rlouf linked a pull request Apr 10, 2024 that will close this issue
Update the llama.cpp integration #782
Merged
9 tasks
@rlouf rlouf closed this as completed Apr 10, 2024
@rlouf rlouf mentioned this issue Apr 10, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement llama.cpp Related to the `llama.cpp` integration
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Update the llama.cpp integration outlines-dev/outlines
1 participant
@rlouf