Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pmix: init at 3.1.5, add support to slurm, openmpi #92048

Merged
merged 4 commits into from Jul 9, 2020

Conversation

@markuskowa
Copy link
Member

markuskowa commented Jul 2, 2020

Motivation for this change

Unlock the full potential of Slurm. By adding PMIx, Slurm now fully supports running MPI binaries with srun instead of mpirun.

Addresses also ideas from #79771

Things done
  • init pmix
  • build slurm with PMIx support
  • build openmpi against PMIx support
  • add a PMIx test case to nixos/tests/slurm.nix
  • Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
  • Built on platform(s)
    • NixOS
    • macOS
    • other Linux distributions
  • Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
  • Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
  • Tested execution of all binary files (usually in ./result/bin/)
  • Determined the impact on package closure size (by running nix path-info -S before and after)
  • Ensured that relevant documentation is up to date
  • Fits CONTRIBUTING.md.
markuskowa added 4 commits Jul 1, 2020
* use tmpfiles to create key for munge
* add mpitest source
* add a subtest for PMIx/MPI startup
@markuskowa markuskowa merged commit 6ce0442 into NixOS:master Jul 9, 2020
17 checks passed
17 checks passed
openmpi, openmpi.passthru.tests, pmix, pmix.passthru.tests, slurm, slurm.passthru.tests on aarch64-linux Timed out, unknown build status
Details
Evaluation Performance Report Evaluator Performance Report
Details
grahamcofborg-eval ^.^!
Details
grahamcofborg-eval-check-maintainers matching changed paths to changed attrs...
Details
grahamcofborg-eval-check-meta config.nix: checkMeta = true
Details
grahamcofborg-eval-darwin nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="e6403d2"; rev="e6403d28e83d0c1f247eab72e1d7b84027f41ea2"; } ./pkgs/t
Details
grahamcofborg-eval-lib-tests nix-build --arg pkgs import ./. {} ./lib/tests/release.nix
Details
grahamcofborg-eval-nixos nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="e6403d2"; rev="e6403d28e83d0c1f247eab72e1d7b84027f41ea2"; } ./nixos/
Details
grahamcofborg-eval-nixos-manual nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="e6403d2"; rev="e6403d28e83d0c1f247eab72e1d7b84027f41ea2"; } ./nixos/
Details
grahamcofborg-eval-nixos-options nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="e6403d2"; rev="e6403d28e83d0c1f247eab72e1d7b84027f41ea2"; } ./nixos/
Details
grahamcofborg-eval-nixpkgs-manual nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="e6403d2"; rev="e6403d28e83d0c1f247eab72e1d7b84027f41ea2"; } ./pkgs/t
Details
grahamcofborg-eval-nixpkgs-tarball nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="e6403d2"; rev="e6403d28e83d0c1f247eab72e1d7b84027f41ea2"; } ./pkgs/t
Details
grahamcofborg-eval-nixpkgs-unstable-jobset nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="e6403d2"; rev="e6403d28e83d0c1f247eab72e1d7b84027f41ea2"; } ./pkgs/t
Details
grahamcofborg-eval-package-list nix-env -qa --json --file .
Details
grahamcofborg-eval-package-list-no-aliases nix-env -qa --json --file . --arg config { allowAliases = false; }
Details
openmpi, openmpi.passthru.tests, pmix, pmix.passthru.tests, slurm, slurm.passthru.tests on x86_64-darwin Success
Details
openmpi, openmpi.passthru.tests, pmix, pmix.passthru.tests, slurm, slurm.passthru.tests on x86_64-linux Success
Details
@markuskowa markuskowa deleted the markuskowa:add-pmix branch Jul 9, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

3 participants
You can’t perform that action at this time.