Skip to content

[Data] Separate test_limit_operator.py with integration and unit tests#62882

Merged
bveeramani merged 4 commits intoray-project:masterfrom
Hyunoh-Yeo:in-progress-61125-6
Apr 24, 2026
Merged

[Data] Separate test_limit_operator.py with integration and unit tests#62882
bveeramani merged 4 commits intoray-project:masterfrom
Hyunoh-Yeo:in-progress-61125-6

Conversation

@Hyunoh-Yeo
Copy link
Copy Markdown
Contributor

Description

Splits test_limit_operator.py into unit and integration test files.

  • test_per_block_limit_fn

Remain in integration file (3 tests):

  • test_limit_operator (uses ray_start_regular_shared)
  • test_limit_operator_memory_leak_fix (uses ray_start_regular_shared, ray.data.read_parquet, StreamingExecutor, ray.get)
  • test_limit_estimated_num_output_bundles (uses ray_start_regular_sharedmake_ref_bundles internally calls ray.put)

test_per_block_limit_fn exercises _per_block_limit_fn directly with hand-constructed pandas DataFrames and a TaskContext — no Ray cluster involved. Imports in both files were trimmed to only what each file actually uses.

Related issues

Related to #61125

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>
Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>
Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>
Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request reorganizes the LimitOperator tests by moving the test_per_block_limit_fn function to a new dedicated unit test file and adding the ray_start_regular_shared fixture to test_limit_estimated_num_output_bundles to ensure a Ray cluster is available for integration testing. I have no feedback to provide.

@Hyunoh-Yeo Hyunoh-Yeo marked this pull request as ready for review April 23, 2026 17:48
@Hyunoh-Yeo Hyunoh-Yeo requested a review from a team as a code owner April 23, 2026 17:48
@ray-gardener ray-gardener Bot added data Ray Data-related issues community-contribution Contributed by the community labels Apr 23, 2026
@bveeramani bveeramani enabled auto-merge (squash) April 24, 2026 19:10
@github-actions github-actions Bot added the go add ONLY when ready to merge, run all tests label Apr 24, 2026
@bveeramani bveeramani merged commit 40fbf0c into ray-project:master Apr 24, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-contribution Contributed by the community data Ray Data-related issues go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants