Skip to content

0.1.0 - Support context management

Choose a tag to compare

@zhongyu09 zhongyu09 released this 09 Oct 05:49
· 52 commits to main since this release

🚀 New Features

This release introduces enhanced context management for LLM. It truncates old tool messages and summarizes history to maintain relevant context, improving multi-turn responses while saving tokens and reducing redundant information.

What's Changed

  • fix: add tool message (if missing) right after AI message with tool call to prevent LLM error
  • feat: support context management(truncate old tool message, summarize history)
  • test: add and fix some unit test cases
  • fix: use pkuseg instead of jieba to fix the python3.12 compatible issue