-
Notifications
You must be signed in to change notification settings - Fork 5.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[data] Enable per-op resource reservation #43171
Merged
raulchen
merged 83 commits into
ray-project:master
from
raulchen:enable-memory-reservation
Feb 27, 2024
Merged
Changes from 75 commits
Commits
Show all changes
83 commits
Select commit
Hold shift + click to select a range
a454087
integrate streaming output backpressure
raulchen a90c82d
integrate scheduling
raulchen 45aace2
default streaming gen buffer
raulchen ac4ee7a
fix remote args
raulchen c8e8235
enable
raulchen 7eef1c3
fix
raulchen 0c57088
streaming backpressure based on size
raulchen d2b16cd
fix
raulchen 276c7c6
comment out
raulchen 21e80d0
reduce streaming gen buffer to 2 blocks
raulchen b00f347
fix obj_store_mem_max_pending_output_per_task
raulchen 35d0e24
increase default obj memory to 50%
raulchen 3a05243
print usage in progress bar
raulchen 6e69a89
separate budgets
raulchen df2e4be
simplify
raulchen a380f72
refine code
raulchen 8fab9b7
Merge branch 'master' into enable-memory-reservation
raulchen cbf29fd
only assign running tasks
raulchen d555014
fix
raulchen 85eec48
handle fractional remaining
raulchen 99d778f
Reserve enough memory for GPU actor tasks
bveeramani 56256fb
minor fix
raulchen 922440d
clean up debug logging
raulchen 0a536b7
refine implementation & add comment
raulchen fe6e822
rename
raulchen 0c0c4b0
remove StreamingOutputBackpressurePolicy
raulchen a492da7
Merge branch 'master' into enable-memory-reservation
raulchen 70a75b3
fix merge
raulchen c756713
clean up max_bytes_to_read
raulchen 04fdc30
refine resource usage string
raulchen b39a741
refine comments
raulchen 18744ab
fix
raulchen d9af986
clear reservation when op finishes
raulchen 4b6139c
do not consider autoscaling
raulchen 29ef8ea
fix
raulchen 081f501
comment
raulchen 217b546
comment
raulchen a122f29
remove use_runtime_metrics_scheduling
raulchen 186aa62
minor renames
raulchen e431d31
Merge branch 'master' into enable-memory-reservation
raulchen 678bf23
remove python/ray/data/tests/test_runtime_metrics_scheduling.py
raulchen 1e60ea9
lint
raulchen 4c04e8d
refine
raulchen 5cc517f
debug usage_str
raulchen c3e39c7
remove streaming output backpressure test
raulchen 0018462
fix deadlock when global limit not enough
raulchen 15a9892
idle detection
raulchen 5636ff8
refine e2e tests
raulchen 790b400
lint
raulchen df3b003
refine
raulchen c9d0b68
refine
raulchen 135c6d0
fix process_completed_tasks
raulchen bb5273c
fix tests
raulchen d1b0857
comments
raulchen 837575c
fix python/ray/data/tests/test_executor_resource_management.py
raulchen bbbc9be
update TestResourceManager
raulchen cbd76f6
rename
raulchen 97024cb
fix
raulchen 1a6af68
rename
raulchen be2e93e
fix
raulchen f5199ac
test reserve min
raulchen 39a13b0
util func for mock map op
raulchen 1c2b777
lint
raulchen 3c93338
refactor idle detection
raulchen 7745bff
add table explanation
raulchen b7fbd18
lint
raulchen 47e121e
comment
raulchen a372102
comment
raulchen a3aba51
fix test_size_estimation.py
raulchen 2f8c77d
fix
raulchen 8c13be9
account non-map downstream ops to upstream map op
raulchen 125506d
refine
raulchen 73efa2b
fix
raulchen 1ffab5d
comment
raulchen 92a515d
resnet test
raulchen bae892e
update comments
raulchen 5358ff5
reserve min memory
raulchen 699e711
lint
raulchen 6c72db1
move e2e tests
raulchen bef8277
loosen condition
raulchen a45edd9
lint
raulchen 275ab66
lint
raulchen e2c2bdd
fix
raulchen File filter
Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
143 changes: 0 additions & 143 deletions
143
.../ray/data/_internal/execution/backpressure_policy/streaming_output_backpressure_policy.py
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.