-
Notifications
You must be signed in to change notification settings - Fork 321
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CI] Fix variable initializations used in test case declarations #1775
Conversation
I will review this PR after #1770 gets merged. |
Would you mind rebasing with the master branch? Thanks! |
cca0147
to
786b5c3
Compare
tests/compatibility-test.py
Outdated
@@ -150,18 +153,15 @@ def test_ray_serve(self): | |||
show_cluster_info(RayFTTestCase.ray_cluster_ns) | |||
self.fail(f"Fail to execute test_ray_serve_2.py. The exit code is {exit_code}.") | |||
|
|||
@unittest.skipIf( | |||
ray_version == '2.8.0' or ray_version == 'nightly', |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why do we need to skip nightly
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks. That was a mistake. We don’t need to skip nightly anymore.
tests/compatibility-test.py
Outdated
@@ -150,18 +153,15 @@ def test_ray_serve(self): | |||
show_cluster_info(RayFTTestCase.ray_cluster_ns) | |||
self.fail(f"Fail to execute test_ray_serve_2.py. The exit code is {exit_code}.") | |||
|
|||
@unittest.skipIf( | |||
ray_version == '2.8.0' or ray_version == 'nightly', | |||
'test_detached_actor is too flaky with Ray 2.8.0 due to' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
'test_detached_actor is too flaky with Ray 2.8.0 due to' | |
'test_detached_actor is too flaky with Ray 2.8.0 due to ' |
tests/compatibility-test.py
Outdated
@unittest.skipIf( | ||
ray_version == '2.8.0' or ray_version == 'nightly', | ||
'test_detached_actor is too flaky with Ray 2.8.0 due to' | ||
'https://github.com/ray-project/ray/issues/41343.' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
'https://github.com/ray-project/ray/issues/41343.' | |
'https://github.com/ray-project/ray/issues/41343. ' |
Signed-off-by: Rueian <rueiancsie@gmail.com>
These global variables
ray_image
,ray_version
, andkuberay_operator_image
are heavily used in test case declarations. But currently, their value will be changed in theif __name__ == '__main__'
block which runs after test case declarations.Therefore, it causes undesired evaluations in some cases, such as
kuberay/tests/compatibility-test.py
Lines 153 to 154 in 59503c6
where it always evaluates the
ray_version
to the initial default value, instead of the value we inject via the env later.See more details: #1770 (comment)
This PR fixes their values at the beginning of the test script and does not change them after initialization.
Related issue number
#1773
Checks