Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fastchat serving embeddings? #10915

Closed
lnguyen opened this issue Apr 29, 2024 · 4 comments
Closed

Fastchat serving embeddings? #10915

lnguyen opened this issue Apr 29, 2024 · 4 comments
Assignees
@glorysdj
Labels
user issue

Comments

@lnguyen
Copy link

lnguyen commented Apr 29, 2024

Is it possible to support embeddings with BigDL-LLM fastchat worker?
@gc-fu
Copy link
Contributor

gc-fu commented Apr 30, 2024

Hi, I am working on this issue. We will see if we can support this API

@lnguyen
Copy link
Author

lnguyen commented Apr 30, 2024

awesome!

@gc-fu gc-fu mentioned this issue May 6, 2024
Merged
4 tasks
@gc-fu
Copy link
Contributor

gc-fu commented May 7, 2024

Hi, the embedding API has been added to the ipex_llm_worker. You can try this when the next nightly release is available~

@gc-fu gc-fu closed this as completed May 7, 2024
@gc-fu gc-fu reopened this May 7, 2024
@lnguyen
Copy link
Author

lnguyen commented May 8, 2024

I've tried this and it works! thank you

@lnguyen lnguyen closed this as completed May 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@glorysdj glorysdj

Labels
user issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@lnguyen @glorysdj @qiuxin2012 @gc-fu