-
-
Notifications
You must be signed in to change notification settings - Fork 11.6k
[CI/Build] Remove skip global cleanup in test_struct_output_generate.py #29022
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CI/Build] Remove skip global cleanup in test_struct_output_generate.py #29022
Conversation
Signed-off-by: Randall Smith <ransmith@amd.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request correctly removes the @pytest.mark.skip_global_cleanup decorator from several tests in test_struct_output_generate.py. As you've noted, these tests instantiate LLM objects and therefore utilize the GPU. By removing the decorator, you are ensuring that proper GPU cleanup occurs after these tests run, which will prevent the out-of-memory errors that were destabilizing the CI pipeline. This is a necessary and well-justified fix. The changes look good.
…py (vllm-project#29022) Signed-off-by: Randall Smith <ransmith@amd.com> Co-authored-by: Randall Smith <ransmith@amd.com> Signed-off-by: LuminolT <lumischen01@gmail.com>
…py (vllm-project#29022) Signed-off-by: Randall Smith <ransmith@amd.com> Co-authored-by: Randall Smith <ransmith@amd.com>
…py (vllm-project#29022) Signed-off-by: Randall Smith <ransmith@amd.com> Co-authored-by: Randall Smith <ransmith@amd.com>
…py (vllm-project#29022) Signed-off-by: Randall Smith <ransmith@amd.com> Co-authored-by: Randall Smith <ransmith@amd.com> Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
…py (vllm-project#29022) Signed-off-by: Randall Smith <ransmith@amd.com> Co-authored-by: Randall Smith <ransmith@amd.com>
…py (vllm-project#29022) Signed-off-by: Randall Smith <ransmith@amd.com> Co-authored-by: Randall Smith <ransmith@amd.com>
This PR removes the @pytest.mark.skip_global_cleanup decorators for the tests that use the GPU. The decorator was created for tests that do not need GPU cleanup in order to improve CI performance. However, these tests do use the GPU and when one of the tests in this file fails, this causes the GPU to OOM when subsequent tests run, preventing the rest of the test suite to complete.
This has been observed by others as well: #27844 (comment)