Skip to content

Conversation

@rasmith
Copy link
Contributor

@rasmith rasmith commented Nov 19, 2025

This PR removes the @pytest.mark.skip_global_cleanup decorators for the tests that use the GPU. The decorator was created for tests that do not need GPU cleanup in order to improve CI performance. However, these tests do use the GPU and when one of the tests in this file fails, this causes the GPU to OOM when subsequent tests run, preventing the rest of the test suite to complete.

This has been observed by others as well: #27844 (comment)

Signed-off-by: Randall Smith <ransmith@amd.com>
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request correctly removes the @pytest.mark.skip_global_cleanup decorator from several tests in test_struct_output_generate.py. As you've noted, these tests instantiate LLM objects and therefore utilize the GPU. By removing the decorator, you are ensuring that proper GPU cleanup occurs after these tests run, which will prevent the out-of-memory errors that were destabilizing the CI pipeline. This is a necessary and well-justified fix. The changes look good.

@gshtras gshtras enabled auto-merge (squash) November 20, 2025 19:58
@github-actions github-actions bot added the ready ONLY add when PR is ready to merge/full CI is needed label Nov 20, 2025
@gshtras gshtras merged commit c7a29d2 into vllm-project:main Nov 20, 2025
24 of 25 checks passed
LuminolT pushed a commit to LuminolT/vllm that referenced this pull request Nov 21, 2025
…py (vllm-project#29022)

Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Signed-off-by: LuminolT <lumischen01@gmail.com>
ywang96 pushed a commit to ywang96/vllm that referenced this pull request Nov 23, 2025
…py (vllm-project#29022)

Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
lpapavassiliou pushed a commit to lpapavassiliou/vllm that referenced this pull request Nov 24, 2025
…py (vllm-project#29022)

Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
RunkaiTao pushed a commit to RunkaiTao/vllm that referenced this pull request Nov 24, 2025
…py (vllm-project#29022)

Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
bringlein pushed a commit to bringlein/vllm that referenced this pull request Nov 26, 2025
…py (vllm-project#29022)

Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
devpatelio pushed a commit to SumanthRH/vllm that referenced this pull request Nov 29, 2025
…py (vllm-project#29022)

Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready ONLY add when PR is ready to merge/full CI is needed structured-output v1

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

4 participants