Skip to content

Repeating text generated when using VLLM with Llama #673

@js333031

Description

@js333031

When using llama models (llama 2, llama 3), a query results in repeating text. For example:
image

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions