Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DashGPT: Use single prompt to generate title and descriptions #87924

Open
ivanortegaalba opened this issue May 15, 2024 · 0 comments
Open

DashGPT: Use single prompt to generate title and descriptions #87924

ivanortegaalba opened this issue May 15, 2024 · 0 comments
Assignees
Labels
area/dashgpt Issues related to the dashgpt project area/generativeAI for issues that involve generative AI internal for issues made by grafanistas team/grafana-dashboards Dashboards squad type/bug
Milestone

Comments

@ivanortegaalba
Copy link
Contributor

Not all DashGPT features work nicely with non-OpenAI models (in particular Dashboard title generation just returns the system prompt when used with Llama3)
The reason for that is that llama3 in particular (and maybe other LLMs) expect at most a single system prompt. In DashGPT we seem to be using a combination of
multiple system prompts + user prompts
multiple system prompts and no user prompt at all
Was wondering if we can update the structure prompts to have
1 single system prompt
1 single user prompt
As part of the blog post for ☝️, was planning to do some benchmarking so we could use that to check the impact on outputs, but changing just the structure and not the prompts itself should have minimal impact

@ivanortegaalba ivanortegaalba added type/bug internal for issues made by grafanistas area/dashgpt Issues related to the dashgpt project area/generativeAI for issues that involve generative AI labels May 15, 2024
@ivanortegaalba ivanortegaalba added this to the 11.1.x milestone May 15, 2024
@ivanortegaalba ivanortegaalba self-assigned this May 15, 2024
@grafanabot grafanabot added the team/grafana-dashboards Dashboards squad label May 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/dashgpt Issues related to the dashgpt project area/generativeAI for issues that involve generative AI internal for issues made by grafanistas team/grafana-dashboards Dashboards squad type/bug
Projects
Status: Planned
Development

No branches or pull requests

2 participants