Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Support for Running Your Own HF Pipeline Locally #354

Closed
sam-h-bean opened this issue Dec 16, 2022 · 0 comments
Closed

Add Support for Running Your Own HF Pipeline Locally #354

sam-h-bean opened this issue Dec 16, 2022 · 0 comments

Comments

@sam-h-bean
Copy link
Contributor

Add support for running your own HF pipeline locally. This would allow you to get a lot more dynamic with what HF features and models you support since you wouldn't be beholden to what is hosted in HF hub. You could also do stuff with HF Optimum to quantize your models and stuff to get pretty fast inference even running on a laptop.

Let me know if you want this code and I will clean it up.
@sam-h-bean sam-h-bean mentioned this issue Dec 16, 2022
Merged
hwchase17 pushed a commit that referenced this issue Dec 17, 2022
@sam-h-bean
Add HuggingFacePipeline LLM (#353)
fe6695b 
#354

Add support for running your own HF pipeline locally. This would allow
you to get a lot more dynamic with what HF features and models you
support since you wouldn't be beholden to what is hosted in HF hub. You
could also do stuff with HF Optimum to quantize your models and stuff to
get pretty fast inference even running on a laptop.
mikeknoop pushed a commit to zapier/langchain-nla-util that referenced this issue Mar 9, 2023
@sam-h-bean
Add HuggingFacePipeline LLM (#353)
4ff88a7 
langchain-ai/langchain#354

Add support for running your own HF pipeline locally. This would allow
you to get a lot more dynamic with what HF features and models you
support since you wouldn't be beholden to what is hosted in HF hub. You
could also do stuff with HF Optimum to quantize your models and stuff to
get pretty fast inference even running on a laptop.
ZinedineDumas added a commit to ZinedineDumas/React-Python that referenced this issue Jul 17, 2023
@ZinedineDumas @dashesy
Add HuggingFacePipeline LLM (#353)
667fec5 
langchain-ai/langchain#354

Add support for running your own HF pipeline locally. This would allow
you to get a lot more dynamic with what HF features and models you
support since you wouldn't be beholden to what is hosted in HF hub. You
could also do stuff with HF Optimum to quantize your models and stuff to
get pretty fast inference even running on a laptop.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hwchase17 @sam-h-bean