Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow customization of initial system prompt #190

Closed
zanyatta opened this issue May 24, 2024 · 4 comments
Closed

Allow customization of initial system prompt #190

zanyatta opened this issue May 24, 2024 · 4 comments
Assignees
Labels
bug Something isn't working

Comments

@zanyatta
Copy link

Feature Proposal: Allow customization of initial system prompt

like #175

AutoDev is currently unable to work with LM Studio:
image

@zanyatta
Copy link
Author

It only seems to affect the "test llm connection"

@zanyatta
Copy link
Author

I post the successful experience of LM Studio here for others to reuse. Note: Since AutoDev currently only obtains content from the first message returned, SSE mode is not supported and "stream" in the body parameter should be set to false.

llm server: Custom
server: http://localhost:1234/v1/chat/completions
response(json path): $.choices[0].message.content
request body(json): {"customHeaders":{"Content-Type":"application/json"},"customFields":{"model":"lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF","temperature":0.7,"max_tokens":-1,"stream":false}}

phodal added a commit that referenced this issue May 24, 2024
Previously, the `prepareRequest` function checked if the messages list was empty before adding a system message. Now, it checks if the `systemPrompt` is not empty, which is a more accurate condition for determining when to add a system message.
@phodal phodal self-assigned this May 24, 2024
@phodal phodal added the bug Something isn't working label May 24, 2024
@phodal
Copy link
Member

phodal commented May 24, 2024

Already fix, after build finish you can download and test it: https://github.com/unit-mesh/auto-dev/actions/runs/9218399014

@zanyatta
Copy link
Author

nice

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants