Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[tune] Async restores and S3/GCP-capable trial FT #6376

Merged
merged 54 commits into from Jan 3, 2020
Merged

[tune] Async restores and S3/GCP-capable trial FT #6376

merged 54 commits into from Jan 3, 2020

Commits on Dec 13, 2019

  1. Initial commit for asynchronous save/restore

    @ujvl
    ujvl committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    e9b641e View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2019

  1. Set stage for cloud checkpointable trainable.

    @ujvl
    ujvl committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    102bc30 View commit details
    Browse the repository at this point in the history

  2. Refactor log_sync and sync_client.

    @ujvl
    ujvl committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    8a31dea View commit details
    Browse the repository at this point in the history

  3. Add durable trainable impl.

    @ujvl
    ujvl committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    d0a6dbb View commit details
    Browse the repository at this point in the history

  4. Support delete in cmd based client

    @ujvl
    ujvl committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    4641f0e View commit details
    Browse the repository at this point in the history

  5. Fix some tests and such

    @ujvl
    ujvl committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    a3d4bfc View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into tune-async-save-restore

    @ujvl
    ujvl committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    95a3d13 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2019

  1. Cleanup, comments.

    @ujvl
    ujvl committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    028876b View commit details
    Browse the repository at this point in the history

  2. Use upload_dir instead.

    @ujvl
    ujvl committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    50cd2c1 View commit details
    Browse the repository at this point in the history

  3. Revert files belonging to other PR in split.

    @ujvl
    ujvl committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    859baa1 View commit details
    Browse the repository at this point in the history

  4. Pass upload_dir into trainable init.

    @ujvl
    ujvl committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    b84be48 View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2019

  1. Merge branch 'master' into tune-async-save-restore

    @ujvl
    ujvl committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    abeb20f View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2019

  1. Pickle checkpoint at driver, more robust checkpoint_dir discovery.

    @ujvl
    ujvl committed Dec 18, 2019
    Configuration menu
    Copy the full SHA
    9c29355 View commit details
    Browse the repository at this point in the history

  2. Merge with master

    @ujvl
    ujvl committed Dec 18, 2019
    Configuration menu
    Copy the full SHA
    7a6ebb9 View commit details
    Browse the repository at this point in the history

  3. Cleanup trainable helper functions, fix tests.

    @ujvl
    ujvl committed Dec 18, 2019
    Configuration menu
    Copy the full SHA
    a633575 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2019

  1. Addressed comments.

    @ujvl
    ujvl committed Dec 20, 2019
    Configuration menu
    Copy the full SHA
    5467f5a View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2019

  1. Fix bugs from cluster testing, add parameterized cluster tests.

    @ujvl
    ujvl committed Dec 21, 2019
    Configuration menu
    Copy the full SHA
    65b4058 View commit details
    Browse the repository at this point in the history

  2. Add trainable util test

    @ujvl
    ujvl committed Dec 21, 2019
    Configuration menu
    Copy the full SHA
    c8aaab7 View commit details
    Browse the repository at this point in the history

Commits on Dec 25, 2019

  1. Merge branch 'master' into tune-async-save-restore

    @richardliaw
    richardliaw committed Dec 25, 2019
    Configuration menu
    Copy the full SHA
    9df308b View commit details
    Browse the repository at this point in the history

  2. package_ref

    @richardliaw
    richardliaw committed Dec 25, 2019
    Configuration menu
    Copy the full SHA
    6ebd06b View commit details
    Browse the repository at this point in the history

  3. pbt_address

    @richardliaw
    richardliaw committed Dec 25, 2019
    Configuration menu
    Copy the full SHA
    b3ccdec View commit details
    Browse the repository at this point in the history

  4. Fix bug after running pbt example (_save returning dir).

    @ujvl
    ujvl committed Dec 25, 2019
    Configuration menu
    Copy the full SHA
    ed40f43 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'tune-async-save-restore' of github.com:ujvl/ray into tu… 

    …ne-async-save-restore
    @ujvl
    ujvl committed Dec 25, 2019
    Configuration menu
    Copy the full SHA
    ac5fda4 View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2019

  1. Merge master

    @ujvl
    ujvl committed Dec 27, 2019
    Configuration menu
    Copy the full SHA
    422e109 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2019

  1. get cluster tests running, other bug fixes.

    @ujvl
    ujvl committed Dec 28, 2019
    Configuration menu
    Copy the full SHA
    ecd85db View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into tune-async-save-restore

    @richardliaw
    richardliaw committed Dec 28, 2019
    Configuration menu
    Copy the full SHA
    e6a4e14 View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2019

  1. raise_errors

    @richardliaw
    richardliaw committed Dec 29, 2019
    Configuration menu
    Copy the full SHA
    b42facb View commit details
    Browse the repository at this point in the history

  2. Fix deleter bug, add durable trainable example.

    @ujvl
    ujvl committed Dec 29, 2019
    Configuration menu
    Copy the full SHA
    8457dbc View commit details
    Browse the repository at this point in the history

  3. Merge branch 'tune-async-save-restore' of github.com:ujvl/ray into tu… 

    …ne-async-save-restore
    @ujvl
    ujvl committed Dec 29, 2019
    Configuration menu
    Copy the full SHA
    e2ae66e View commit details
    Browse the repository at this point in the history

  4. Fix cluster test bugs.

    @ujvl
    ujvl committed Dec 29, 2019
    Configuration menu
    Copy the full SHA
    71ec225 View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2019

  1. filelock

    @richardliaw
    richardliaw committed Dec 30, 2019
    Configuration menu
    Copy the full SHA
    76e97ca View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2019

  1. save/restore bug fixes

    @ujvl
    ujvl committed Dec 31, 2019
    Configuration menu
    Copy the full SHA
    c17ea1d View commit details
    Browse the repository at this point in the history

  2. .

    @ujvl
    ujvl committed Dec 31, 2019
    Configuration menu
    Copy the full SHA
    ddb50a8 View commit details
    Browse the repository at this point in the history

  3. Working cluster tests.

    @ujvl
    ujvl committed Dec 31, 2019
    Configuration menu
    Copy the full SHA
    17ce1c6 View commit details
    Browse the repository at this point in the history

  4. Lint, revert to tracking memory checkpoints.

    @ujvl
    ujvl committed Dec 31, 2019
    Configuration menu
    Copy the full SHA
    82703e6 View commit details
    Browse the repository at this point in the history

  5. Documentation, cleanup

    @ujvl
    ujvl committed Dec 31, 2019
    Configuration menu
    Copy the full SHA
    90b0d45 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into tune-async-save-restore

    @ujvl
    ujvl committed Dec 31, 2019
    Configuration menu
    Copy the full SHA
    bdbe96b View commit details
    Browse the repository at this point in the history

Commits on Jan 1, 2020

  1. fixinitialsync

    @richardliaw
    richardliaw committed Jan 1, 2020
    Configuration menu
    Copy the full SHA
    d81cdf6 View commit details
    Browse the repository at this point in the history

  2. fix_one_test

    @richardliaw
    richardliaw committed Jan 1, 2020
    Configuration menu
    Copy the full SHA
    db18bf2 View commit details
    Browse the repository at this point in the history

  3. Merge master

    @ujvl
    ujvl committed Jan 1, 2020
    Configuration menu
    Copy the full SHA
    964af81 View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2020

  1. Fix cluster test bug

    @ujvl
    ujvl committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    642fe61 View commit details
    Browse the repository at this point in the history

  2. nit

    @richardliaw
    richardliaw committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    6532432 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'tune-async-save-restore' of github.com:ujvl/ray into tu… 

    …ne-async-save-restore
    @richardliaw
    richardliaw committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    dd3321f View commit details
    Browse the repository at this point in the history

  4. lint

    @richardliaw
    richardliaw committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    e324725 View commit details
    Browse the repository at this point in the history

  5. Revert tune md change

    @ujvl
    ujvl committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    c37ae41 View commit details
    Browse the repository at this point in the history

  6. Fix basename bug for directories.

    @ujvl
    ujvl committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    edc1cea View commit details
    Browse the repository at this point in the history

  7. lint

    @ujvl
    ujvl committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    03b2fe2 View commit details
    Browse the repository at this point in the history

  8. fix_tests

    @richardliaw
    richardliaw committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    507c885 View commit details
    Browse the repository at this point in the history

  9. nit_fix

    @richardliaw
    richardliaw committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    a3ebf67 View commit details
    Browse the repository at this point in the history

  10. Add __init__ file.

    @ujvl
    ujvl committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    e74e960 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'tune-async-save-restore' of github.com:ujvl/ray into tu… 

    …ne-async-save-restore
    @ujvl
    ujvl committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    2153d1e View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2020

  1. Move to utils package

    @ujvl
    ujvl committed Jan 3, 2020
    Configuration menu
    Copy the full SHA
    113494f View commit details
    Browse the repository at this point in the history

  2. Merge with master

    @ujvl
    ujvl committed Jan 3, 2020
    Configuration menu
    Copy the full SHA
    152a0ce View commit details
    Browse the repository at this point in the history

  3. Fix merge conflicts

    @ujvl
    ujvl committed Jan 3, 2020
    Configuration menu
    Copy the full SHA
    ee78765 View commit details
    Browse the repository at this point in the history