Skip to content

[Feature Request]: Context window support #1080

@deerleo

Description

@deerleo

Is your feature request related to a problem? Please describe.

In a story writing context, it is important to maintain the context window so would not trigger max token limit.

Describe the solution you'd like

  1. In a long text generation scene the autogen can automatically handle the context window. Auto summarize it when it reaches the max token limitation.
  2. Provide functions to control which message should be kept in memories. Can defined the message priorities.

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    0.2Issues which are related to the pre 0.4 codebase

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions