[Data] Jail unstructured_data_ingestion release test#63236
Conversation
…test Signed-off-by: Goutam <goutam@anyscale.com>
There was a problem hiding this comment.
Code Review
This pull request increases the timeout for a release test in release/release_tests.yaml from 3600 to 5000 seconds. Feedback indicates that this increase might be masking a root cause issue, specifically an invalid pandas version dependency in an associated script that could be causing the test to fail or hang.
|
|
||
| run: | ||
| timeout: 3600 | ||
| timeout: 5000 |
There was a problem hiding this comment.
Increasing the timeout to 5000 seconds might be masking an underlying issue. I noticed that the associated BYOD script release/ray_release/byod/byod_unstructured_data_ingestion.sh (line 11) attempts to install pandas==2.3.3, which is not a valid version (the latest stable version is 2.2.3). If the test is failing or hanging due to environment setup issues caused by this invalid dependency, increasing the timeout will not resolve the root cause. Please verify the dependencies in the BYOD script to ensure the test isn't failing for reasons other than execution time.
Move the unstructured data ingestion release test to manual while the throughput issue is investigated. Signed-off-by: Goutam <goutam@anyscale.com> Co-authored-by: Cursor <cursoragent@cursor.com>
Restore the unstructured data ingestion release test timeout to 3600 seconds now that the test is manual. Signed-off-by: Goutam <goutam@anyscale.com> Co-authored-by: Cursor <cursoragent@cursor.com>
bveeramani
left a comment
There was a problem hiding this comment.
Can you add a comment why we're disabling this?
## Description Move the `unstructured_data_ingestion` release test from `weekly` to `manual` while the poor throughput / CPU utilization issue is investigated. The previous timeout bump could mask the underlying runtime behavior, so this change removes the test from scheduled release runs instead of extending its runtime budget. Jailing test because the current CPU utilization is too low and the test needs to be rewritten. ## Test plan - Verified `release/release_tests.yaml` parses and `unstructured_data_ingestion` resolves to `frequency: manual`. - Commit hooks passed for the staged change. --------- Signed-off-by: Goutam <goutam@anyscale.com> Co-authored-by: Cursor <cursoragent@cursor.com>
## Description Move the `unstructured_data_ingestion` release test from `weekly` to `manual` while the poor throughput / CPU utilization issue is investigated. The previous timeout bump could mask the underlying runtime behavior, so this change removes the test from scheduled release runs instead of extending its runtime budget. Jailing test because the current CPU utilization is too low and the test needs to be rewritten. ## Test plan - Verified `release/release_tests.yaml` parses and `unstructured_data_ingestion` resolves to `frequency: manual`. - Commit hooks passed for the staged change. --------- Signed-off-by: Goutam <goutam@anyscale.com> Co-authored-by: Cursor <cursoragent@cursor.com>
## Description Move the `unstructured_data_ingestion` release test from `weekly` to `manual` while the poor throughput / CPU utilization issue is investigated. The previous timeout bump could mask the underlying runtime behavior, so this change removes the test from scheduled release runs instead of extending its runtime budget. Jailing test because the current CPU utilization is too low and the test needs to be rewritten. ## Test plan - Verified `release/release_tests.yaml` parses and `unstructured_data_ingestion` resolves to `frequency: manual`. - Commit hooks passed for the staged change. --------- Signed-off-by: Goutam <goutam@anyscale.com> Co-authored-by: Cursor <cursoragent@cursor.com> Signed-off-by: anindyam1969 <amukherjee@kinetica.com>
## Description Move the `unstructured_data_ingestion` release test from `weekly` to `manual` while the poor throughput / CPU utilization issue is investigated. The previous timeout bump could mask the underlying runtime behavior, so this change removes the test from scheduled release runs instead of extending its runtime budget. Jailing test because the current CPU utilization is too low and the test needs to be rewritten. ## Test plan - Verified `release/release_tests.yaml` parses and `unstructured_data_ingestion` resolves to `frequency: manual`. - Commit hooks passed for the staged change. --------- Signed-off-by: Goutam <goutam@anyscale.com> Co-authored-by: Cursor <cursoragent@cursor.com>
Description
Move the
unstructured_data_ingestionrelease test fromweeklytomanualwhile the poor throughput / CPU utilization issue is investigated.The previous timeout bump could mask the underlying runtime behavior, so this change removes the test from scheduled release runs instead of extending its runtime budget.
Jailing test because the current CPU utilization is too low and the test needs to be rewritten.
Test plan
release/release_tests.yamlparses andunstructured_data_ingestionresolves tofrequency: manual.