Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Inference][vLLM] Integrate vLLM for CPU #2

Closed
xwu99 opened this issue Dec 9, 2023 · 0 comments · Fixed by #20
Closed

[Inference][vLLM] Integrate vLLM for CPU #2

xwu99 opened this issue Dec 9, 2023 · 0 comments · Fixed by #20
Assignees
@xwu99
Labels
inference

Comments

@xwu99
Copy link
Contributor

xwu99 commented Dec 9, 2023 •
edited
Loading

carsonwang pushed a commit to carsonwang/llm-on-ray that referenced this issue Dec 21, 2023
@susu-noob
Merge pull request intel#2 from zhangjian94cn/dev/rlhf
740a2aa 
[rlhf] enable reward model training
@xwu99 xwu99 mentioned this issue Jan 4, 2024
Merged
@xwu99 xwu99 added the inference label Jan 5, 2024
@xwu99 xwu99 self-assigned this Jan 10, 2024
@xwu99 xwu99 changed the title [vLLM] Integrate vLLM for CPU [Inference][vLLM] Integrate vLLM for CPU Jan 17, 2024
@xwu99 xwu99 closed this as completed in #20 Jan 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@xwu99 xwu99

Labels
inference
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add vllm Predictor xwu99/llm-on-ray
1 participant
@xwu99