add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293

TopRichard · 2024-04-02T12:38:16Z

Sync NESSI software layer with EESSI software layer, EESSI PR473

…round bug + typos

nessi-bot · 2024-04-02T12:38:22Z

Instance Saga-NESSI is configured to build:

arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
arch x86_64/intel/broadwell for repo nessi-2023.06-cl
arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11
arch x86_64/generic for repo nessi-2023.06-cl
arch x86_64/generic for repo nessi-2023.06-swl-deb10
arch x86_64/generic for repo nessi-2023.06-swl-deb11

nessi-bot · 2024-04-02T12:38:22Z

Instance eX3-NESSI is configured to build:

arch x86_64/amd/zen2 for repo nessi-2023.06-cl
arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
arch aarch64/generic for repo nessi-2023.06-cl
arch aarch64/generic for repo nessi-2023.06-swl-deb10
arch aarch64/generic for repo nessi-2023.06-swl-deb11

nessi-bot · 2024-04-02T12:38:22Z

Instance Fram-NESSI is configured to build:

arch x86_64/generic for repo nessi-2023.06-cl
arch x86_64/generic for repo nessi-2023.06-swl-deb10
arch x86_64/generic for repo nessi-2023.06-swl-deb11
arch x86_64/intel/broadwell for repo nessi-2023.06-cl
arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11

trz42

Content-wise I think this looks ok.

As done in EESSI#473, we should build it for the different architectures and ingest it (because it changes the lmodrc.lua). EESSI#473 also documents nicely how it was tested (we should not see the same message though since we don't have a neoverse_v1 software subdirectory).

For the future, I think it would be good to make a clickable link, e.g., EESSI/software-layer PR473 instead of just putting in the plain number in the description.

A little suggestion would also be to apply the same commit as done in EESSI#473 This might be done via git cherry-pick ... (or some other command). Thus there is less doubt if the changes made here were identical or not to what was done in EESSI#473 Of course, this might not always be so easy in case of conflicts or more complex changes.

There are a number of other changes included here. They could be be done in a separate commit. Thus the commit adding the hook could be compared to the commit in EESSI#473.

create_lmodrc.py

…into EESSI-pr-473

trz42 · 2024-04-05T20:24:18Z

bot: build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell
bot: build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake
bot: build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:aarch64/generic
bot: build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:zen2
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic

nessi-bot · 2024-04-05T20:24:21Z

Updates by the bot instance AWS-MC-NESSI (click for details)

received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:zen2
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- no jobs were submitted
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- submitted job 9102, for details & status see add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293 (comment)

nessi-bot · 2024-04-05T20:24:21Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:zen2
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- no jobs were submitted
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- submitted job 162901, for details & status see add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293 (comment)
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- submitted job 162902, for details & status see add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293 (comment)
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-04-05T20:24:22Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:zen2
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- no jobs were submitted
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-04-05T20:24:22Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
received bot command build inst:eX3 repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:zen2
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- submitted job 11095871, for details & status see add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293 (comment)
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- submitted job 11095872, for details & status see add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293 (comment)
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:
- no jobs were submitted
handling command build instance:eX3 repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-04-05T20:24:26Z

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_293/162901

date	job status	comment
Apr 05 08:24:26 PM UTC 2024	submitted	job id `162901` awaits release by job manager
Apr 05 08:24:39 PM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 05 08:25:42 PM UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-162901.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-generic-1712348724.tar.gz` size: 0 MiB (255192 bytes) entries: 4 modules under 2023.06/software/linux/aarch64/generic/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/generic/software no software packages in tarball other under 2023.06/software/linux/aarch64/generic `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp` `.lmod/lmodrc.lua`
Apr 05 08:25:42 PM UTC 2024	test result	(no tests yet)
Apr 05 08:37:44 PM UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-generic-1712348724.tar.gz` to S3 bucket succeeded
Apr 05 08:45:30 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-aarch64-generic-1712348724.tar.gz` downloaded to Stratum-0
Apr 05 08:45:43 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/59 to approve ingest
Apr 05 08:48:24 PM UTC 2024	approved	👍 tarball `eessi-2023.06-software-linux-aarch64-generic-1712348724.tar.gz` approved, see PR https://github.com/NorESSI/2024-staging/pull/59
Apr 05 08:48:51 PM UTC 2024	ingested	🎉 tarball `eessi-2023.06-software-linux-aarch64-generic-1712348724.tar.gz` successfully ingested at `2023.06/software/linux/aarch64/generic/.lmod/`

nessi-bot · 2024-04-05T20:24:28Z

New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_293/9102

date	job status	comment
Apr 05 20:24:27 UTC 2024	submitted	job id `9102` awaits release by job manager
Apr 05 20:25:01 UTC 2024	released	job awaits launch by Slurm scheduler
Apr 05 20:29:03 UTC 2024	running	job `9102` is running
Apr 05 20:31:05 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-9102.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-generic-1712349015.tar.gz` size: 0 MiB (264378 bytes) entries: 4 modules under 2023.06/software/linux/x86_64/generic/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/generic/software no software packages in tarball other under 2023.06/software/linux/x86_64/generic `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp` `.lmod/lmodrc.lua`
Apr 05 20:31:05 UTC 2024	test result	(no tests yet)
Apr 05 20:36:14 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-generic-1712349015.tar.gz` to S3 bucket succeeded
Apr 05 08:45:35 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-x86_64-generic-1712349015.tar.gz` downloaded to Stratum-0
Apr 05 08:45:49 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/61 to approve ingest
Apr 05 08:48:28 PM UTC 2024	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-generic-1712349015.tar.gz` approved, see PR https://github.com/NorESSI/2024-staging/pull/61
Apr 05 08:49:26 PM UTC 2024	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-generic-1712349015.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/generic/.lmod/`

nessi-bot · 2024-04-05T20:24:30Z

New job on instance eX3-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_293/162902

date	job status	comment
Apr 05 08:24:29 PM UTC 2024	submitted	job id `162902` awaits release by job manager
Apr 05 08:24:41 PM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 05 08:25:44 PM UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-162902.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1712348729.tar.gz` size: 0 MiB (264480 bytes) entries: 4 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen2/software no software packages in tarball other under 2023.06/software/linux/x86_64/amd/zen2 `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp` `.lmod/lmodrc.lua`
Apr 05 08:25:44 PM UTC 2024	test result	(no tests yet)
Apr 05 08:40:34 PM UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-1712348729.tar.gz` to S3 bucket succeeded
Apr 05 08:45:33 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-x86_64-amd-zen2-1712348729.tar.gz` downloaded to Stratum-0
Apr 05 08:45:46 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/60 to approve ingest
Apr 05 08:48:26 PM UTC 2024	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-amd-zen2-1712348729.tar.gz` approved, see PR https://github.com/NorESSI/2024-staging/pull/60
Apr 05 08:49:08 PM UTC 2024	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-amd-zen2-1712348729.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/amd/zen2/.lmod/`

nessi-bot · 2024-04-05T20:24:38Z

New job on instance Saga-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_293/11095871

date	job status	comment
Apr 05 08:24:37 PM UTC 2024	submitted	job id `11095871` awaits release by job manager
Apr 05 08:24:45 PM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 05 08:34:51 PM UTC 2024	finished	🤷 UNKNOWN (click triangle for details) Job results file `_bot_job11095871.result` does not exist in job directory, or parsing it failed. No artefacts were found/reported.
Apr 05 08:34:51 PM UTC 2024	test result	🤷 UNKNOWN (click triangle for details) Job test file `_bot_job11095871.test` does not exist in job directory, or parsing it failed.

nessi-bot · 2024-04-05T20:24:50Z

New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_293/11095872

date	job status	comment
Apr 05 08:24:49 PM UTC 2024	submitted	job id `11095872` awaits release by job manager
Apr 05 08:25:47 PM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 05 08:26:48 PM UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-11095872.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712348788.tar.gz` size: 0 MiB (265019 bytes) entries: 4 modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software no software packages in tarball other under 2023.06/software/linux/x86_64/intel/skylake_avx512 `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp` `.lmod/lmodrc.lua`
Apr 05 08:26:48 PM UTC 2024	test result	(no tests yet)
Apr 05 08:36:21 PM UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712348788.tar.gz` to S3 bucket succeeded
Apr 05 08:45:39 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712348788.tar.gz` downloaded to Stratum-0
Apr 05 08:45:54 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/63 to approve ingest
Apr 05 08:48:33 PM UTC 2024	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712348788.tar.gz` approved, see PR https://github.com/NorESSI/2024-staging/pull/63
Apr 05 08:49:59 PM UTC 2024	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712348788.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/intel/skylake_avx512/.lmod/`

trz42 · 2024-04-05T20:30:19Z

Broadwell nodes on Saga are busy. Try Fram.

bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell

nessi-bot · 2024-04-05T20:30:22Z

Updates by the bot instance AWS-MC-NESSI (click for details)

received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted

nessi-bot · 2024-04-05T20:30:22Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted

nessi-bot · 2024-04-05T20:30:22Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- submitted job 5761588, for details & status see add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293 (comment)

nessi-bot · 2024-04-05T20:30:23Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted

nessi-bot · 2024-04-05T20:30:27Z

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_293/5761588

date	job status	comment
Apr 05 20:30:26 UTC 2024	submitted	job id `5761588` awaits release by job manager
Apr 05 20:30:57 UTC 2024	released	job awaits launch by Slurm scheduler
Apr 05 20:31:58 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-5761588.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712349077.tar.gz` size: 0 MiB (264808 bytes) entries: 4 modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/intel/broadwell/software no software packages in tarball other under 2023.06/software/linux/x86_64/intel/broadwell `.lmod/cache/spiderT.lua` `.lmod/cache/spiderT.luac_5.1` `.lmod/cache/timestamp` `.lmod/lmodrc.lua`
Apr 05 20:31:58 UTC 2024	test result	(no tests yet)
Apr 05 20:36:17 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712349077.tar.gz` to S3 bucket succeeded
Apr 05 08:45:37 PM UTC 2024	staged	tarball `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712349077.tar.gz` downloaded to Stratum-0
Apr 05 08:45:52 PM UTC 2024	pr_opened	merge PR https://github.com/NorESSI/2024-staging/pull/62 to approve ingest
Apr 05 08:48:31 PM UTC 2024	approved	👍 tarball `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712349077.tar.gz` approved, see PR https://github.com/NorESSI/2024-staging/pull/62
Apr 05 08:49:45 PM UTC 2024	ingested	🎉 tarball `eessi-2023.06-software-linux-x86_64-intel-broadwell-1712349077.tar.gz` successfully ingested at `2023.06/software/linux/x86_64/intel/broadwell/.lmod/`

trz42 · 2024-04-05T20:34:07Z

Builds for all architectures succeeded. Cancelling pending job on Saga.

trz42 · 2024-04-05T20:35:40Z

Checklist before starting deployment (setting bot:deploy label):

Check if the SPDX license identifier is provided
- not needed because no software was built (just updating an Lmod config script)
Check whether builds for all required architectures succeed (SUCCESS message + reasonably sized tarball)
Check if the PR is up-to-date with the target branch nessi.no-2023.06 in the repository (if not what are the differences)
Assess if all requested changes are sound (checking files changed on GitHub.com)
Verify that all easyconfig/s being built are included with the EB version used (if not why not)
- no easyconfigs were used
Review changes (if any) needed to get the build(s) succeed (common changes for all architectures, changes for a single architecture, changes because of build environment specifics, etc.)

trz42 · 2024-04-05T20:42:28Z

Target architectures

x86_64-intel-broadwell
x86_64-intel-skylake_avx512
x86_64-amd-zen2
x86_64-generic
aarch64-generic

Checklist for deployment/ingestion

at least one tarball for each architecture has been uploaded
at least one tarball for each architecture has been staged
for each staged tarball was a PR for approval/rejection opened
for each architecture one and only one tarball has been approved
for each architecture one and only one tarball was ingested
all tests in the CI have succeeded (rerun failed tests ~ 10 mins after last ingest)
- no rerun needed as CI is independent of changes to lmodrc.lua
has the package become available via CernVM-FS for all architectures ingested (for lmod cache updates pay attention to timestamp of files)
- file lmodrc.lua for cascadelake wasn't updated (which is fine); should remove software branch for this microarchitecture

command & log

command

cd /cvmfs/pilot.nessi.no/versions/2023.06/software/linux ; \
ls -l \
      x86_64/{generic,amd/zen2,intel/[bsc]*}/.lmod/lmodrc.lua \
      aarch64/generic/.lmod/lmodrc.lua

log

-rw-r--r--. 1 cvmfs cvmfs 5645 Apr  5 20:25 aarch64/generic/.lmod/lmodrc.lua
-rw-r--r--. 1 cvmfs cvmfs 5645 Apr  5 20:25 x86_64/amd/zen2/.lmod/lmodrc.lua
-rw-r--r--. 1 cvmfs cvmfs 5643 Apr  5 20:29 x86_64/generic/.lmod/lmodrc.lua
-rw-rw-r--. 1 cvmfs cvmfs 5659 Apr  5 20:31 x86_64/intel/broadwell/.lmod/lmodrc.lua
-rw-r--r--. 1 cvmfs cvmfs  283 Jun 18  2023 x86_64/intel/cascadelake/.lmod/lmodrc.lua
-rw-r--r--. 1 cvmfs cvmfs 5669 Apr  5 20:26 x86_64/intel/skylake_avx512/.lmod/lmodrc.lua

trz42

All fine. Updated files ingested.

add Lmod hook to set to ^smcuda when loading OpenMPI module to work a…

411a441

…round bug + typos

TopRichard added the NESSI/2023.06 label Apr 2, 2024

added hook.register(load, openmpi_load_hook)

c8d8002

TopRichard requested a review from trz42 April 2, 2024 12:44

TopRichard mentioned this pull request Apr 2, 2024

Syncing code-base and CVMFS repository with EESSI (April 2024) #294

Open

51 tasks

trz42 reviewed Apr 2, 2024

View reviewed changes

create_lmodrc.py Show resolved Hide resolved

Merge branch 'nessi.no-2023.06' of github-trz:NorESSI/software-layer …

296f00c

…into EESSI-pr-473

trz42 added the bot:deploy label Apr 5, 2024

trz42 approved these changes Apr 5, 2024

View reviewed changes

trz42 merged commit dbdf9ae into NorESSI:nessi.no-2023.06 Apr 5, 2024
25 checks passed

trz42 added ingested sync-with-EESSI labels Apr 5, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293

add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293

TopRichard commented Apr 2, 2024

nessi-bot bot commented Apr 2, 2024

nessi-bot bot commented Apr 2, 2024

nessi-bot bot commented Apr 2, 2024

trz42 left a comment

trz42 commented Apr 5, 2024

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 5, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 5, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited by trz42

Loading

trz42 commented Apr 5, 2024

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited by trz42

Loading

trz42 commented Apr 5, 2024

trz42 commented Apr 5, 2024

trz42 commented Apr 5, 2024 •

edited

Loading

trz42 left a comment

add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293

add Lmod hook to set to ^smcuda when loading OpenMPI module to work around bug + renaming #293

Conversation

TopRichard commented Apr 2, 2024

nessi-bot bot commented Apr 2, 2024

nessi-bot bot commented Apr 2, 2024

nessi-bot bot commented Apr 2, 2024

trz42 left a comment

Choose a reason for hiding this comment

trz42 commented Apr 5, 2024

nessi-bot bot commented Apr 5, 2024 • edited Loading

nessi-bot bot commented Apr 5, 2024 • edited Loading

nessi-bot bot commented Apr 5, 2024 • edited Loading

nessi-bot bot commented Apr 5, 2024 • edited Loading

nessi-bot bot commented Apr 5, 2024 • edited by trz42 Loading

nessi-bot bot commented Apr 5, 2024 • edited by trz42 Loading

nessi-bot bot commented Apr 5, 2024 • edited by trz42 Loading

nessi-bot bot commented Apr 5, 2024 • edited Loading

nessi-bot bot commented Apr 5, 2024 • edited by trz42 Loading

trz42 commented Apr 5, 2024

nessi-bot bot commented Apr 5, 2024 • edited Loading

nessi-bot bot commented Apr 5, 2024 • edited Loading

nessi-bot bot commented Apr 5, 2024 • edited Loading

nessi-bot bot commented Apr 5, 2024 • edited Loading

nessi-bot bot commented Apr 5, 2024 • edited by trz42 Loading

trz42 commented Apr 5, 2024

trz42 commented Apr 5, 2024

trz42 commented Apr 5, 2024 • edited Loading

trz42 left a comment

Choose a reason for hiding this comment

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 5, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 5, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited by trz42

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited

Loading

nessi-bot bot commented Apr 5, 2024 •

edited by trz42

Loading

trz42 commented Apr 5, 2024 •

edited

Loading