Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add MPI-capable tasks #9

Merged
merged 61 commits into from
May 29, 2019
Merged

Add MPI-capable tasks #9

merged 61 commits into from
May 29, 2019

Commits on May 20, 2019

  1. Add proof of concept for tasks with MPI capabilities (in the same nam… 

    …espace)
    Alan O'Cais committed May 20, 2019
    Configuration menu
    Copy the full SHA
    120be38 View commit details
    Browse the repository at this point in the history

  2. Tidy up a bit

    Alan O'Cais committed May 20, 2019
    Configuration menu
    Copy the full SHA
    e9ca2bc View commit details
    Browse the repository at this point in the history

  3. Carfeul about (ab)using globals

    Alan O'Cais committed May 20, 2019
    Configuration menu
    Copy the full SHA
    e22b42b View commit details
    Browse the repository at this point in the history

  4. Make script executable

    Alan O'Cais committed May 20, 2019
    Configuration menu
    Copy the full SHA
    091fd1e View commit details
    Browse the repository at this point in the history

  5. Fix spelling error

    Alan O'Cais committed May 20, 2019
    Configuration menu
    Copy the full SHA
    6c2b8b7 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'mpi_enabled_tasks' of github.com:E-CAM/jobqueue_feature… 

    …s into mpi_enabled_tasks
    Alan O'Cais committed May 20, 2019
    Configuration menu
    Copy the full SHA
    8fa6bce View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' into mpi_enabled_tasks

    Alan O'Cais committed May 20, 2019
    Configuration menu
    Copy the full SHA
    78bdffd View commit details
    Browse the repository at this point in the history

  8. Start incorporating the necessary code

    Alan O'Cais committed May 20, 2019
    Configuration menu
    Copy the full SHA
    978176a View commit details
    Browse the repository at this point in the history

  9. Only import MPI if I need to

    Alan O'Cais committed May 20, 2019
    Configuration menu
    Copy the full SHA
    b00e9c0 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2019

  1. Add some error checking

    Alan O'Cais committed May 21, 2019
    Configuration menu
    Copy the full SHA
    5c2715b View commit details
    Browse the repository at this point in the history

  2. Move some more functions to the module, improve errors

    Alan O'Cais committed May 21, 2019
    Configuration menu
    Copy the full SHA
    356ea7e View commit details
    Browse the repository at this point in the history

  3. Add the wrapper script for dask_worker

    Alan O'Cais committed May 21, 2019
    Configuration menu
    Copy the full SHA
    e147ba4 View commit details
    Browse the repository at this point in the history

  4. Simplify

    Alan O'Cais committed May 21, 2019
    Configuration menu
    Copy the full SHA
    af3a043 View commit details
    Browse the repository at this point in the history

  5. Prepare for wrapping mpi_dask_worker.py call

    Alan O'Cais committed May 21, 2019
    Configuration menu
    Copy the full SHA
    7939481 View commit details
    Browse the repository at this point in the history

  6. Add dask mpi launcher

    Alan O'Cais committed May 21, 2019
    Configuration menu
    Copy the full SHA
    7046a87 View commit details
    Browse the repository at this point in the history

  7. Run black

    Alan O'Cais committed May 21, 2019
    Configuration menu
    Copy the full SHA
    4745140 View commit details
    Browse the repository at this point in the history

  8. Provide traceback when aborting

    Alan O'Cais committed May 21, 2019
    Configuration menu
    Copy the full SHA
    11fcb70 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2019

  1. Enable switch for forking MPI programs

    Alan O'Cais committed May 22, 2019
    Configuration menu
    Copy the full SHA
    4b1c8fa View commit details
    Browse the repository at this point in the history

  2. Run black on codebase

    Alan O'Cais committed May 22, 2019
    2 Configuration menu
    Copy the full SHA
    6317d56 View commit details
    Browse the repository at this point in the history

  3. Add default MPI launcher to tests

    Alan O'Cais committed May 22, 2019
    Configuration menu
    Copy the full SHA
    d0eebce View commit details
    Browse the repository at this point in the history

  4. Restore state in tests

    Alan O'Cais committed May 22, 2019
    Configuration menu
    Copy the full SHA
    7ac93a4 View commit details
    Browse the repository at this point in the history

  5. Prepare for more tests

    Alan O'Cais committed May 22, 2019
    Configuration menu
    Copy the full SHA
    628e94b View commit details
    Browse the repository at this point in the history

  6. Correct warning string

    Alan O'Cais committed May 22, 2019
    Configuration menu
    Copy the full SHA
    6a14b26 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2019

  1. Correct warning string

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    aec9be0 View commit details
    Browse the repository at this point in the history

  2. Correct warning string

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    f7b4fa9 View commit details
    Browse the repository at this point in the history

  3. Imports done incorrectly

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    145556c View commit details
    Browse the repository at this point in the history

  4. Add an example to test MPI functionality

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    4b5d6d3 View commit details
    Browse the repository at this point in the history

  5. Add launcher to example

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    d6f81a8 View commit details
    Browse the repository at this point in the history

  6. Use trivial queue

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    0e2e83d View commit details
    Browse the repository at this point in the history

  7. Fix typo

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    e372d0c View commit details
    Browse the repository at this point in the history

  8. Only add additional kwargs if they are needed

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    0b5ea90 View commit details
    Browse the repository at this point in the history

  9. No forking other processes when using MPI to launch dask

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    7597b80 View commit details
    Browse the repository at this point in the history

  10. Add missing kwargs

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    09d5cf8 View commit details
    Browse the repository at this point in the history

  11. Use simple queues in example

    Alan O'Cais committed May 23, 2019
    Configuration menu
    Copy the full SHA
    1b9d8b8 View commit details
    Browse the repository at this point in the history

  12. Move requirements in CI

    ocaisa committed May 23, 2019
    Configuration menu
    Copy the full SHA
    4552e29 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2019

  1. Only do the dask worker import where it is needed

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    e2f0aaf View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/mpi_enabled_tasks' into mpi_enab… 

    …led_tasks
    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    8c830cd View commit details
    Browse the repository at this point in the history

  3. Debugging

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    1ce44a6 View commit details
    Browse the repository at this point in the history

  4. Debugging

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    14f5e5d View commit details
    Browse the repository at this point in the history

  5. Serialize before submitting the task

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    6a7168a View commit details
    Browse the repository at this point in the history

  6. Serialize before submitting the task

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    0bf2dd1 View commit details
    Browse the repository at this point in the history

  7. Serialize before submitting the task

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    73450af View commit details
    Browse the repository at this point in the history

  8. Be more careful with args and kwargs

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    af29b1f View commit details
    Browse the repository at this point in the history

  9. Get rid of a warning

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    85be2ba View commit details
    Browse the repository at this point in the history

  10. Remove unnecessary print statements

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    040fd7a View commit details
    Browse the repository at this point in the history

  11. Make sure we can run multiple tasks

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    55b3da0 View commit details
    Browse the repository at this point in the history

  12. Make sure we can run multiple tasks

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    60048dc View commit details
    Browse the repository at this point in the history

  13. Make sure we can run multiple tasks

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    f3543a7 View commit details
    Browse the repository at this point in the history

  14. Flush strings

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    84a5d25 View commit details
    Browse the repository at this point in the history

  15. REmove bad print command

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    32a7e86 View commit details
    Browse the repository at this point in the history

  16. See if nanny works

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    7bf1799 View commit details
    Browse the repository at this point in the history

  17. Only do import when we need to

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    a6c171e View commit details
    Browse the repository at this point in the history

  18. Only do import when we need to

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    1788b86 View commit details
    Browse the repository at this point in the history

  19. Revert last commit

    Alan O'Cais committed May 24, 2019
    Configuration menu
    Copy the full SHA
    707a4f0 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2019

  1. Address comment

    Alan O'Cais committed May 29, 2019
    Configuration menu
    Copy the full SHA
    db6f089 View commit details
    Browse the repository at this point in the history

  2. Tidy up before adding additional tests

    Alan O'Cais committed May 29, 2019
    Configuration menu
    Copy the full SHA
    584c33e View commit details
    Browse the repository at this point in the history

  3. Remove dask worker directories

    Alan O'Cais committed May 29, 2019
    Configuration menu
    Copy the full SHA
    4f0aace View commit details
    Browse the repository at this point in the history

  4. Add initial set of new tests

    Alan O'Cais committed May 29, 2019
    Configuration menu
    Copy the full SHA
    e59b5a7 View commit details
    Browse the repository at this point in the history

  5. Additional tests

    Alan O'Cais committed May 29, 2019
    Configuration menu
    Copy the full SHA
    d48d54e View commit details
    Browse the repository at this point in the history

  6. Final additional tests

    Alan O'Cais committed May 29, 2019
    Configuration menu
    Copy the full SHA
    b586dc9 View commit details
    Browse the repository at this point in the history

  7. Make sure Py2 is also passing

    Alan O'Cais committed May 29, 2019
    Configuration menu
    Copy the full SHA
    6d3c6ea View commit details
    Browse the repository at this point in the history