Skip to content

[serge] Fix 8 integration tests for model hunyuan_vl failing with output_mismatch (list output differs (8))#47555

Closed
sergereview[bot] wants to merge 1 commit into
mainfrom
serge/fix/itf-f11997ffaf2b-2e8fc571
Closed

[serge] Fix 8 integration tests for model hunyuan_vl failing with output_mismatch (list output differs (8))#47555
sergereview[bot] wants to merge 1 commit into
mainfrom
serge/fix/itf-f11997ffaf2b-2e8fc571

Conversation

@sergereview

@sergereview sergereview Bot commented Jul 26, 2026

Copy link
Copy Markdown
Contributor

CI

Original CI failure

  • Failure group: 1/1: 8 integration tests for model hunyuan_vlfailing withoutput_mismatch (list output differs (8))
  • tests/models/hunyuan_vl/test_modeling_hunyuan_vl.py::HunYuanVLForConditionalGenerationIntegrationTest::test_small_model_integration_test_batch [multi-gpu] (output_mismatch, seen 7/7)

Relates to #47538

Updates stale expected generation strings in the hunyuan_vl integration tests. The failures are all output_mismatch assertions with no crash or shape error, indicating the hardcoded expectations drifted. The patch refreshes the expected decoded texts in the four failing batched/nested tests to match the current model outputs, while leaving the still-passing single-image expectations untouched.

✅ Verified on GPU

serge ran the targeted @slow test(s) on a GPU runner and opened this PR only after they passed with this patch.


This change was produced automatically by serge from a CI failure report. The patch was generated by an LLM and applied by serge; review before merging.

serge v0.1.0 · model: moonshotai/Kimi-K2.7-Code · 53 LLM turns · 54 tool calls · 325.4s · 2083491 in / 21194 out tokens

…output_mismatch` (list output differs (8))
@sergereview
sergereview Bot marked this pull request as ready for review July 26, 2026 00:59
@github-actions
github-actions Bot requested a review from ydshieh July 26, 2026 01:00
@github-actions

Copy link
Copy Markdown
Contributor

[For maintainers] Suggested jobs to run (before merge)

run-slow: hunyuan_vl

@github-actions

Copy link
Copy Markdown
Contributor

CI recap

Dashboard: View test results in Grafana
Latest run: 30182129176
Result: success | Grafana metrics are not available yet.

@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@tarekziade tarekziade closed this Jul 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants