Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Data] Remove deprecated do_write #40422

Merged
merged 3 commits into from
Oct 19, 2023

Conversation

bveeramani
Copy link
Member

@bveeramani bveeramani commented Oct 17, 2023

Depends on:

Why are these changes needed?

do_write has been deprecated since Ray 2.4. This PR removes it.

Related issue number

Towards #40296

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
    • I've added any new APIs to the API Reference. For example, if I added a
      method in Tune, I've added it in doc/source/tune/api/ under the
      corresponding .rst file.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

Signed-off-by: Balaji Veeramani <balaji@anyscale.com>
@Zandew
Copy link
Contributor

Zandew commented Oct 17, 2023

lgtm, i also see do_write used in custom_datasource.py, is that removed in another PR?

…ve-do-write3

Signed-off-by: Balaji Veeramani <balaji@anyscale.com>
Signed-off-by: Balaji Veeramani <balaji@anyscale.com>
@bveeramani
Copy link
Member Author

lgtm, i also see do_write used in custom_datasource.py, is that removed in another PR?

Ah, good catch. Should've be removed in #40127.

Rather than opening up a new PR and waiting for CI to run, I'm including it in this PR.

Comment on lines -3486 to -3494
progress = ProgressBar("Write Progress", len(write_results))
try:
progress.block_until_complete(write_results)
datasource.on_write_complete(ray.get(write_results))
except Exception as e:
datasource.on_write_failed(write_results, e)
raise
finally:
progress.close()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

did we keep this progress bar logic elsewhere? or now it is just managed by Write operator?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, it's just handled by the operator (e.g, ReadRange->Write)

@bveeramani bveeramani merged commit f3bc522 into ray-project:master Oct 19, 2023
35 of 38 checks passed
jonathan-anyscale pushed a commit to jonathan-anyscale/ray that referenced this pull request Oct 26, 2023
do_write has been deprecated since Ray 2.4. This PR removes it.

---------

Signed-off-by: Balaji Veeramani <balaji@anyscale.com>
jonathan-anyscale pushed a commit to jonathan-anyscale/ray that referenced this pull request Oct 26, 2023
do_write has been deprecated since Ray 2.4. This PR removes it.

---------

Signed-off-by: Balaji Veeramani <balaji@anyscale.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants