Skip to content

change llm benchmark seqlen from 1024 to 256#6738

Merged
nihui merged 1 commit into
Tencent:masterfrom
nihui:benchmark-llm-2
May 22, 2026
Merged

change llm benchmark seqlen from 1024 to 256#6738
nihui merged 1 commit into
Tencent:masterfrom
nihui:benchmark-llm-2

Conversation

@nihui
Copy link
Copy Markdown
Member

@nihui nihui commented May 22, 2026

No description provided.

@tencent-adm
Copy link
Copy Markdown
Member

CLA assistant check
Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the LLM benchmarking harness to use a shorter prefill/past sequence length (256 instead of 1024), likely to reduce runtime and resource usage during benchmark runs.

Changes:

  • Switch decoder warmup/prefill benchmark sequence length from 1024 to 256.
  • Switch decode benchmark past sequence length from 1024 to 256.
  • Update benchmark case name suffixes from 1k to 256 for clearer output labeling.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread benchmark/benchncnn_llm.cpp
@nihui nihui merged commit 619ea8e into Tencent:master May 22, 2026
40 of 42 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants