Skip to content

[Data] Add control for block-size in rows - #61381

Open
WinkerDu wants to merge 7 commits into
ray-project:masterfrom
WinkerDu:github-master-target_max_block_rows
Open

[Data] Add control for block-size in rows#61381
WinkerDu wants to merge 7 commits into
ray-project:masterfrom
WinkerDu:github-master-target_max_block_rows

Conversation

@WinkerDu

Copy link
Copy Markdown

Description

To solve issue #56247

Introduce the DataContext.target_max_block_rows to control block sizes based on # of rows.

Related issues

Close #56247

Change-Id: Ib4bb24c38af7b2413cecb74243075fdcf9239632
@WinkerDu
WinkerDu requested a review from a team as a code owner February 27, 2026 13:27
@gemini-code-assist

Copy link
Copy Markdown
Contributor

Warning

Gemini is experiencing higher than usual traffic and was unable to create the review. Please try again in a few hours by commenting /gemini review.

Change-Id: I75d435fed674da10c6f4fd183109d9a972e94aa2
Change-Id: Ia8417082b2b841473c74df42e61fc106113e3093
@ray-gardener ray-gardener Bot added data Ray Data-related issues community-contribution Contributed by the community labels Feb 27, 2026
Change-Id: I72a47e06511fc8cef5fefab85f322c28340f09e4

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Comment thread python/ray/data/_internal/execution/operators/map_operator.py Outdated
WinkerDu added 2 commits March 9, 2026 17:10
Change-Id: I93f643e641d77330dfcdaddfbd4a2878b227fadb
Change-Id: I5cc41e883cc5710457d301c982076eaee63ce7b5
@WinkerDu

WinkerDu commented Mar 9, 2026

Copy link
Copy Markdown
Author

@alexeykudinkin please take a review, thx :)

Change-Id: I6679dfa1e84ddbe57656168c9c2b823ee6dc69cf
@github-actions

Copy link
Copy Markdown

This pull request has been automatically marked as stale because it has not had
any activity for 14 days. It will be closed in another 14 days if no further activity occurs.
Thank you for your contributions.

You can always ask for help on our discussion forum or Ray's public slack channel.

If you'd like to keep this open, just leave any comment, and the stale label will be removed.

@github-actions github-actions Bot added the stale The issue is stale. It will be closed within 7 days unless there are further conversation label Mar 23, 2026
@WinkerDu

Copy link
Copy Markdown
Author

No one can review this?

@github-actions github-actions Bot added unstale A PR that has been marked unstale. It will not get marked stale again if this label is on it. and removed stale The issue is stale. It will be closed within 7 days unless there are further conversation labels Mar 24, 2026
@bveeramani bveeramani added this to the Data issue and PR backlog milestone Aug 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-contribution Contributed by the community data Ray Data-related issues unstale A PR that has been marked unstale. It will not get marked stale again if this label is on it.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Data] Add control for block-size in rows

2 participants