Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Few-shot examples with energy conservation are used in prompts when chatting ungrounded with the models #766

Open
1 of 2 tasks
nhwkuhns opened this issue Jun 19, 2024 · 1 comment · Fixed by #774
Open
1 of 2 tasks
Assignees
Labels
bug Something isn't working
Milestone

Comments

@nhwkuhns
Copy link
Collaborator

Bug Details

When chatting ungrounded, directly with the model, it will occasionally give responses based on the few-shot examples used for the grounded chats.

Steps To Reproduce

  1. Start an ungrounded chat
  2. Send the prompt "test test"

What is the expected behavior?
The model would typically reply with something like "it appears you are trying to test something. If you give me more context I can help"

Screenshots
image

Information Assistant details

Please provide the following details. You can simply include a screenshot of your Info panel as well.

GitHub branch: main
main
Version or Latest commit:
v1.1.1 commit e60ed3e
What region is your Azure Open AI Service in?
EastUS
What ChatGPT model are you using?
gpt-4o
model name: (i.e. gpt-3.5-turbo, gpt-4)
gpt-4o
model version: (i.e. 0613)
2024-05-13
What embeddings model are you using?
BAAI/bge-small-env-v1.5

Additional context
Add any other context about the problem here.

If the bug is confirmed, would you be willing to submit a PR?

  • Yes
  • No
@dayland
Copy link
Contributor

dayland commented Jun 25, 2024

@nhwkuhns , I have put in a PR for this. It will get updated in our next release.

@dayland dayland added the bug Something isn't working label Jun 25, 2024
@dayland dayland added this to the 1.1.2 milestone Jun 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants