Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug Fix] Fix issue related to using embedding model from huggingface #1242

Merged
merged 1 commit into from
Feb 6, 2024

Conversation

deshraj
Copy link
Collaborator

@deshraj deshraj commented Feb 6, 2024

Description

Fixes #1241

Type of change

  • Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?

  • Test Script (please provide)
from embedchain import App


app_config = {
    "app": {"config": {"id": "embedchain-demo-app"}},
    "llm": {
        "provider": "huggingface",
        "config": {
            "model": "mistralai/Mixtral-8x7B-Instruct-v0.1",
            "temperature": 0.1,
            "max_tokens": 250,
            "top_p": 0.1,
        },
    },
    "embedder": {"provider": "huggingface", "config": {"model": "sentence-transformers/all-mpnet-base-v2"}},
}

ec_app = App.from_config(config=app_config)


a = ec_app.query("What is the capital of France?")

print(a)

@dosubot dosubot bot added the size:XS This PR changes 0-9 lines, ignoring generated files. label Feb 6, 2024
@deshraj deshraj merged commit fa78c97 into main Feb 6, 2024
3 checks passed
@taranjeet taranjeet deleted the user/dyadav/fix-embedder branch February 7, 2024 00:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size:XS This PR changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Mistral llm not working
1 participant