Skip to content

ValueError: Prompt length of 3553 is longer than the maximum model length of 3072. #77

New issue
New issue
Closed
#161
Closed
ValueError: Prompt length of 3553 is longer than the maximum model length of 3072.#77
#161
Labels
bugSomething isn't working
@xming521

Description

@xming521
xming521
opened on May 15, 2025

vllm推理超过combine_msg_max_length
Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions