Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for remote embeddings providers, additional fixes #39

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

hgueorguiev
Copy link

  • Add support to configure if embeddings are local or use remote service to gen.
  • Add support for HuggingFace inference endpoints for embedding generation
  • Fix missing torch lib wheel that poetry fails to install on linux, this allows us to build a working docker container image again
  • Fix missing weaviate dependency by adding to project requirements
  • File preview route to be more forgiving of files it fails to generate a preview for load whatever files it is able to support

- Add support to configure if embeddings are local or use remote service to gen.
- Add support for HuggingFace inference endpoints for embedding generation
- Fix missing torch lib wheel that poetry fails to install on linux,
  this allows us to build a working docker container image again
- File preview route to be more forgiving of files it fails to generate a preview for
  load whatever files it is able to support
@vercel
Copy link

vercel bot commented Aug 31, 2023

Someone is attempting to deploy a commit to the Sidekick-ai Team on Vercel.

A member of the Team first needs to authorize it.

@hgueorguiev
Copy link
Author

@Ayan-Bandyopadhyay Let me know how you feel about these changes, mainly abstracting embeddings providers so that they can be processed remotely on gpu hardware, first use case HuggingFace inference points. But also some fixes for issues I was running into.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant