Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[train] New persistence mode cleanup: Remove legacy checkpoint management internals #40069

Merged
merged 56 commits into from
Oct 5, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
a9f6548
remove old path in base trainer
justinvyu Sep 27, 2023
0ce34b4
remove usage in data parallel trainer
justinvyu Sep 27, 2023
3300274
remove in backend exec
justinvyu Sep 27, 2023
9de4fc9
remove unused code in training iterator
justinvyu Sep 27, 2023
8fe7e87
remove unused train ckpt manager usage
justinvyu Sep 27, 2023
c13021d
remove train._internal.checkpoint
justinvyu Sep 27, 2023
9610db9
fix lint
justinvyu Sep 27, 2023
8fbb1ed
cleanup session
justinvyu Sep 27, 2023
c6ab523
remove old TrainingResult
justinvyu Sep 27, 2023
44271be
finish removing training result
justinvyu Sep 27, 2023
c4176bb
remove ckpt config as an arg of backend exec
justinvyu Sep 27, 2023
8583076
fix lint
justinvyu Sep 27, 2023
07f0154
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Sep 27, 2023
c1e1b0f
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Sep 28, 2023
45db383
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Sep 28, 2023
457297e
remove deprecated arg
justinvyu Sep 28, 2023
3b24621
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Sep 29, 2023
7b7088d
fix missing arg
justinvyu Sep 29, 2023
ac8beee
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Sep 29, 2023
0c317cf
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Oct 3, 2023
9cacfaa
remove lazy ckpt constant
justinvyu Oct 3, 2023
78655bb
remove air.Checkpoint
justinvyu Oct 3, 2023
bc53837
remove legacy air framework ckpts
justinvyu Oct 3, 2023
909c330
update horovod trainer docstring
justinvyu Oct 3, 2023
9a743a8
remove some air.checkpoint usage
justinvyu Oct 3, 2023
528b024
remove air.checkpoint usage in fn traianble + label some code to remove
justinvyu Oct 3, 2023
0814cf4
remove air integrations from serve
justinvyu Oct 3, 2023
1d89c19
remove air dict ckpt dependency from trainable
justinvyu Oct 3, 2023
6d7f391
remove more ray.air ckpt related imports
justinvyu Oct 3, 2023
ea2c853
fix lint
justinvyu Oct 3, 2023
7b283fd
remove air ckpt manager
justinvyu Oct 3, 2023
51cd7cd
remove correpsonding test
justinvyu Oct 3, 2023
9aebffb
remove tune ckpt manager
justinvyu Oct 3, 2023
78a018c
remove memory checkpoint storage from tune controller
justinvyu Oct 3, 2023
3b75f16
remove old ckpt manager from trial
justinvyu Oct 3, 2023
2e5708e
remove ckpt storage deps from trial
justinvyu Oct 3, 2023
7f16696
remove dep in output
justinvyu Oct 3, 2023
d78c0a8
remove dep in pbt
justinvyu Oct 3, 2023
0eb9a8d
remove unused test utils
justinvyu Oct 3, 2023
1481a89
remove pbt test that doesn't apply anymore
justinvyu Oct 3, 2023
80bd54d
clear up pbt + fix mock trial checkpoint
justinvyu Oct 3, 2023
734824c
remove legacy checkpoint remainders
justinvyu Oct 3, 2023
71988db
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Oct 3, 2023
6fcbff2
Merge branch 'cleanup_old_codepath2' into cleanup_old_codepath3
justinvyu Oct 3, 2023
26cf9b9
remove refs to legacy ckpts in notebooks
justinvyu Oct 3, 2023
fca67c3
remove missing tests from build files
justinvyu Oct 3, 2023
98a7b28
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Oct 3, 2023
7151479
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Oct 4, 2023
c795441
fix test_huggingface
justinvyu Oct 4, 2023
f4923cb
fix hf text classification
justinvyu Oct 4, 2023
89f56b8
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Oct 4, 2023
16b0a4c
Merge branch 'cleanup_old_codepath2' into cleanup_old_codepath3
justinvyu Oct 4, 2023
e8b8ce8
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Oct 5, 2023
5e8e058
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Oct 5, 2023
3214e4a
Merge branch 'cleanup_old_codepath2' into cleanup_old_codepath3
justinvyu Oct 5, 2023
2d8cfdd
Merge branch 'master' of https://github.com/ray-project/ray into clea…
justinvyu Oct 5, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 0 additions & 8 deletions python/ray/air/BUILD
Original file line number Diff line number Diff line change
Expand Up @@ -49,14 +49,6 @@ py_test(
deps = [":ml_lib"]
)

py_test(
name = "test_checkpoint_manager",
size = "small",
srcs = ["tests/test_checkpoint_manager.py"],
tags = ["team:ml", "exclusive"],
deps = [":ml_lib"]
)

py_test(
name = "test_configs",
size = "small",
Expand Down
Loading
Loading