Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update the llama.cpp integration #782

Merged
merged 2 commits into from
Apr 10, 2024
Merged

Update the llama.cpp integration #782

merged 2 commits into from
Apr 10, 2024

Conversation

rlouf
Copy link
Member

@rlouf rlouf commented Apr 1, 2024 •
edited
Loading

  • stream API
  • Documentation
  • Integration test for generate.regex
  • Integration test for generate.json
  • Integration test for generate.format
  • Integration test for generate.choice
  • Integration test for generate.cfg
  • Load LoRA adapters
  • Add more integration tests for vLLM

@rlouf rlouf added enhancement llama.cpp Related to the `llama.cpp` integration labels Apr 1, 2024
@rlouf rlouf force-pushed the llama-cpp-refactor-integration branch 3 times, most recently from 849d0b6 to 675fde5 Compare April 1, 2024 13:58
@rlouf rlouf force-pushed the llama-cpp-refactor-integration branch 6 times, most recently from 037d3b7 to 08ebb81 Compare April 10, 2024 09:29
@rlouf rlouf force-pushed the llama-cpp-refactor-integration branch 2 times, most recently from 027f4e3 to 7cb8f51 Compare April 10, 2024 10:19
@rlouf rlouf merged commit ae9ae50 into main Apr 10, 2024
5 checks passed
@rlouf rlouf deleted the llama-cpp-refactor-integration branch April 10, 2024 10:30
This was linked to issues Apr 10, 2024
Docs for initializing from LlamaCpp incorrect #730
Closed
stop_at doesn't stop generation early when using Exllamav2 #750
Open
Refactor the llama.cpp integration #779
Closed
@rlouf rlouf removed a link to an issue Apr 10, 2024
stop_at doesn't stop generation early when using Exllamav2 #750
Open
This was referenced Apr 12, 2024
Open
Open
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
enhancement llama.cpp Related to the `llama.cpp` integration
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Refactor the llama.cpp integration Docs for initializing from LlamaCpp incorrect
1 participant
@rlouf