Skip to content

lora adapter with vllm#541

Closed
sixsixcoder wants to merge 3 commits intozai-org:mainfrom
sixsixcoder:main
Closed

lora adapter with vllm#541
sixsixcoder wants to merge 3 commits intozai-org:mainfrom
sixsixcoder:main

Conversation

@sixsixcoder
Copy link
Collaborator

@sixsixcoder sixsixcoder commented Sep 4, 2024

Added demo code for using vLLM with LoRA adapter on the GLM-4-9B-Chat model

@sixsixcoder sixsixcoder closed this Sep 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant