Draft: add system message as the first part of next multi-parts mesaage #9336
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
| ): # Next message is a user or assistant message | ||
| # Merge system prompt into the next message | ||
| next_m["content"] = m["content"] + " " + next_m["content"] | ||
| if type(next_m['content']) is list: |
There was a problem hiding this comment.
can we have a separate helper util, which merges content messages, this will be more generally useful in the codebase
There was a problem hiding this comment.
the type of message should be AllMessageValues
There was a problem hiding this comment.
Checked the type system , I found it could be too complex to support merge any two kind of messages .
For example, how to merge ChatCompletionSystemMessage and ChatCompletionFunctionMessage ?
|
|
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
3 participants
Title
add system message as the first part of next multipart message
Relevant issues
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
tests/litellm/directory, Adding at least 1 test is a hard requirement - see detailsmake test-unit)[https://docs.litellm.ai/docs/extras/contributing_code]Type
🐛 Bug Fix
Changes