Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Initial ray autoscaler support #661

Merged
merged 25 commits into from Jun 8, 2019
Merged

Initial ray autoscaler support #661

merged 25 commits into from Jun 8, 2019

Commits on Jun 4, 2019

  1. Add initial cluster script

    @williamma12
    williamma12 committed Jun 4, 2019
    Copy the full SHA
    d9572ec View commit details
    Browse the repository at this point in the history

  2. Try having modin take in environment variable with the redis address

    @williamma12
    williamma12 committed Jun 4, 2019
    Copy the full SHA
    0847ba6 View commit details
    Browse the repository at this point in the history

  3. print redis address

    @williamma12
    williamma12 committed Jun 4, 2019
    Copy the full SHA
    c93a66f View commit details
    Browse the repository at this point in the history

  4. remove object store memory when redis address is given

    @williamma12
    williamma12 committed Jun 4, 2019
    Copy the full SHA
    03146c1 View commit details
    Browse the repository at this point in the history

  5. Temporarily hardcode num partitions

    @williamma12
    williamma12 committed Jun 4, 2019
    Copy the full SHA
    7892d17 View commit details
    Browse the repository at this point in the history

  6. decrease partitions

    @williamma12
    williamma12 committed Jun 4, 2019
    Copy the full SHA
    087bfad View commit details
    Browse the repository at this point in the history

  7. Increase partitions back to 16

    @williamma12
    williamma12 committed Jun 4, 2019
    Copy the full SHA
    978ef14 View commit details
    Browse the repository at this point in the history

  8. Update redix max memory

    @williamma12
    williamma12 committed Jun 4, 2019
    Copy the full SHA
    aa52044 View commit details
    Browse the repository at this point in the history

  9. Remove redis max memory

    @williamma12
    williamma12 committed Jun 4, 2019
    Copy the full SHA
    9b6a666 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2019

  1. Only start a ray process on head node

    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    f01b801 View commit details
    Browse the repository at this point in the history

  2. Debug cluster initializing multiple ray instances

    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    86dbd0e View commit details
    Browse the repository at this point in the history

  3. Do not iniditalize ray in modin

    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    0a10226 View commit details
    Browse the repository at this point in the history

  4. Change which lines are commented to avoid having ray initialized in m… 

    …odin
    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    11c7d97 View commit details
    Browse the repository at this point in the history

  5. Update to initialize ray only in the head node

    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    a58899d View commit details
    Browse the repository at this point in the history

  6. Change env var name

    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    e011b37 View commit details
    Browse the repository at this point in the history

  7. Update how sum and prod is calculated

    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    c725159 View commit details
    Browse the repository at this point in the history

  8. Print logging statements

    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    935b1cf View commit details
    Browse the repository at this point in the history

  9. Add diffeerent debug print statementsg

    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    48450c8 View commit details
    Browse the repository at this point in the history

  10. change debug message to time

    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    5eca0cb View commit details
    Browse the repository at this point in the history

  11. Change debug message

    @williamma12
    williamma12 committed Jun 5, 2019
    Copy the full SHA
    d4ea63b View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2019

  1. Change debug to to_pandas

    @williamma12
    williamma12 committed Jun 6, 2019
    Copy the full SHA
    db8a412 View commit details
    Browse the repository at this point in the history

  2. Remove debugging and move initialization of ray

    @williamma12
    williamma12 committed Jun 6, 2019
    Copy the full SHA
    07fa670 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2019

  1. Update script and init

    @williamma12
    williamma12 committed Jun 7, 2019
    Copy the full SHA
    a31254a View commit details
    Browse the repository at this point in the history

  2. linting

    @williamma12
    williamma12 committed Jun 7, 2019
    Copy the full SHA
    5ac8622 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2019

  1. add documentation

    @williamma12
    williamma12 committed Jun 8, 2019
    Copy the full SHA
    5748825 View commit details
    Browse the repository at this point in the history