Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Always use LMOD_RC file, and make sure loading CUDA apps always works when building #307

Merged
merged 3 commits into from
Apr 7, 2024

Conversation

trz42
Copy link
Collaborator

@trz42 trz42 commented Apr 7, 2024

Simply uses the commit in EESSI#475

Need the following changes to create_tarball.sh (they were introduced in EESSI#496 and thus used in #306; the latter will be reduced after merging #307) or changes to init scripts won't be included in tarballs and those changes cannot be ingested via the standard procedure.

diff --git a/create_tarball.sh b/create_tarball.sh
index a619df9..2d77acf 100755
--- a/create_tarball.sh
+++ b/create_tarball.sh
@@ -51,6 +51,11 @@ if [ -d ${eessi_version}/scripts ]; then
     find ${eessi_version}/scripts -type f | grep -v '/\.wh\.' >> ${files_list}
 fi

+# also include init, which is also copied by install_scripts.sh
+if [ -d ${eessi_version}/init ]; then
+    find ${eessi_version}/init -type f | grep -v '/\.wh\.' >> ${files_list}
+fi
+
 if [ -d ${eessi_version}/software/${os}/${cpu_arch_subdir}/modules ]; then
     # module files
     find ${eessi_version}/software/${os}/${cpu_arch_subdir}/modules -type f | grep -v '/\.wh\.' >> ${files_list}

Need changes to install_scripts.sh as well. See commit ecb936e

Also need changes to ingest-tarball.sh on the Stratum 0 (see EESSI/filesystem-layer#186).

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Instance AWS-MC-NESSI is configured to build:

  • arch x86_64/generic for repo nessi-2022.11-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-cl
  • arch x86_64/generic for repo nessi-2023.06-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-swl-deb11
  • arch x86_64/intel/skylake_avx512 for repo nessi-2022.11-swl-deb10
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
  • arch x86_64/amd/zen2 for repo nessi-2022.11-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
  • arch aarch64/generic for repo nessi-2022.11-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-cl
  • arch aarch64/generic for repo nessi-2023.06-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-swl-deb11

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Instance eX3-NESSI is configured to build:

  • arch x86_64/amd/zen2 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
  • arch aarch64/generic for repo nessi-2023.06-cl
  • arch aarch64/generic for repo nessi-2023.06-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-swl-deb11

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Instance Fram-NESSI is configured to build:

  • arch x86_64/generic for repo nessi-2023.06-cl
  • arch x86_64/generic for repo nessi-2023.06-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-swl-deb11
  • arch x86_64/intel/broadwell for repo nessi-2023.06-cl
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Instance Saga-NESSI is configured to build:

  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
  • arch x86_64/intel/broadwell for repo nessi-2023.06-cl
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11
  • arch x86_64/generic for repo nessi-2023.06-cl
  • arch x86_64/generic for repo nessi-2023.06-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-swl-deb11

@trz42
Copy link
Collaborator Author

trz42 commented Apr 7, 2024

bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell
bot: build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake
bot: build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance AWS-MC-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance eX3-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance Fram-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance Saga-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_307/163325

date job status comment
Apr 07 09:25:25 AM UTC 2024 submitted job id 163325 awaits release by job manager
Apr 07 09:25:37 AM UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 09:26:38 AM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-163325.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1712481959.tar.gzsize: 0 MiB (253635 bytes)
entries: 3
modules under 2023.06/software/linux/aarch64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/aarch64/generic/software
no software packages in tarball
other under 2023.06/software/linux/aarch64/generic
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 09:26:38 AM UTC 2024 test result (no tests yet)

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/5762052

date job status comment
Apr 07 09:25:25 UTC 2024 submitted job id 5762052 awaits release by job manager
Apr 07 09:25:42 UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 09:26:43 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-5762052.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-broadwell-1712481954.tar.gzsize: 0 MiB (263046 bytes)
entries: 3
modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/broadwell/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/broadwell
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 09:26:43 UTC 2024 test result (no tests yet)

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9167

date job status comment
Apr 07 09:25:26 UTC 2024 submitted job id 9167 awaits release by job manager
Apr 07 09:25:59 UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 09:30:02 UTC 2024 running job 9167 is running
Apr 07 09:32:07 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9167.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1712482264.tar.gzsize: 0 MiB (262695 bytes)
entries: 3
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/amd/zen2/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 09:32:07 UTC 2024 test result (no tests yet)

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9168

date job status comment
Apr 07 09:25:30 UTC 2024 submitted job id 9168 awaits release by job manager
Apr 07 09:26:00 UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 09:30:04 UTC 2024 running job 9168 is running
Apr 07 09:32:09 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9168.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1712482264.tar.gzsize: 0 MiB (262569 bytes)
entries: 3
modules under 2023.06/software/linux/x86_64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/generic/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/generic
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 09:32:09 UTC 2024 test result (no tests yet)

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/11097008

date job status comment
Apr 07 09:25:47 AM UTC 2024 submitted job id 11097008 awaits release by job manager
Apr 07 09:26:33 AM UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 09:27:34 AM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-11097008.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712482009.tar.gzsize: 0 MiB (263291 bytes)
entries: 3
modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/skylake_avx512
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 09:27:34 AM UTC 2024 test result (no tests yet)

@trz42
Copy link
Collaborator Author

trz42 commented Apr 7, 2024

Rebuilding after modifying create_tarball.sh

bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell
bot: build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake
bot: build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance AWS-MC-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance eX3-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance Saga-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance Fram-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/5762074

date job status comment
Apr 07 09:47:48 UTC 2024 submitted job id 5762074 awaits release by job manager
Apr 07 09:48:47 UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 09:49:48 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-5762074.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-broadwell-1712483339.tar.gzsize: 0 MiB (263054 bytes)
entries: 3
modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/broadwell/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/broadwell
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 09:49:48 UTC 2024 test result (no tests yet)

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_307/163328

date job status comment
Apr 07 09:47:48 AM UTC 2024 submitted job id 163328 awaits release by job manager
Apr 07 09:48:42 AM UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 09:49:43 AM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-163328.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1712483345.tar.gzsize: 0 MiB (253637 bytes)
entries: 3
modules under 2023.06/software/linux/aarch64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/aarch64/generic/software
no software packages in tarball
other under 2023.06/software/linux/aarch64/generic
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 09:49:43 AM UTC 2024 test result (no tests yet)

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9169

date job status comment
Apr 07 09:47:49 UTC 2024 submitted job id 9169 awaits release by job manager
Apr 07 09:48:14 UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 09:49:17 UTC 2024 running job 9169 is running
Apr 07 09:50:20 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9169.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1712483356.tar.gzsize: 0 MiB (262696 bytes)
entries: 3
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/amd/zen2/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 09:50:20 UTC 2024 test result (no tests yet)

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9170

date job status comment
Apr 07 09:47:53 UTC 2024 submitted job id 9170 awaits release by job manager
Apr 07 09:48:15 UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 09:49:19 UTC 2024 running job 9170 is running
Apr 07 09:50:21 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9170.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1712483359.tar.gzsize: 0 MiB (262571 bytes)
entries: 3
modules under 2023.06/software/linux/x86_64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/generic/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/generic
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 09:50:21 UTC 2024 test result (no tests yet)

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/11097020

date job status comment
Apr 07 09:48:03 AM UTC 2024 submitted job id 11097020 awaits release by job manager
Apr 07 09:48:40 AM UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 09:49:41 AM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-11097020.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712483337.tar.gzsize: 0 MiB (263293 bytes)
entries: 3
modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/skylake_avx512
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 09:49:41 AM UTC 2024 test result (no tests yet)

@trz42
Copy link
Collaborator Author

trz42 commented Apr 7, 2024

Rebuilding after modifying install_scripts.sh

bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell
bot: build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake
bot: build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance AWS-MC-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance eX3-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance Fram-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

Updates by the bot instance Saga-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/5762085

date job status comment
Apr 07 10:00:50 UTC 2024 submitted job id 5762085 awaits release by job manager
Apr 07 10:01:53 UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 10:02:54 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-5762085.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-broadwell-1712484123.tar.gzsize: 0 MiB (264714 bytes)
entries: 4
modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/broadwell/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/broadwell
2023.06/init/eessi_environment_variables
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 10:02:54 UTC 2024 test result (no tests yet)
Apr 07 10:24:52 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-broadwell-1712484123.tar.gz to S3 bucket succeeded
Apr 07 10:29:59 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-broadwell-1712484123.tar.gz to S3 bucket succeeded
Apr 07 10:37:21 AM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1712484123.tar.gz downloaded to Stratum-0
Apr 07 10:37:35 AM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/72 to approve ingest
Apr 07 10:45:44 AM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1712484123.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/72
Apr 07 11:23:01 AM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1712484123.tar.gz successfully ingested at 2023.06/

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_307/163336

date job status comment
Apr 07 10:00:51 AM UTC 2024 submitted job id 163336 awaits release by job manager
Apr 07 10:01:48 AM UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 10:02:49 AM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-163336.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1712484135.tar.gzsize: 0 MiB (255251 bytes)
entries: 4
modules under 2023.06/software/linux/aarch64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/aarch64/generic/software
no software packages in tarball
other under 2023.06/software/linux/aarch64/generic
2023.06/init/eessi_environment_variables
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 10:02:49 AM UTC 2024 test result (no tests yet)
Apr 07 10:29:15 AM UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712484135.tar.gz to S3 bucket failed
Apr 07 10:35:32 AM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712484135.tar.gz to S3 bucket succeeded
Apr 07 10:37:15 AM UTC 2024 staged tarball eessi-2023.06-software-linux-aarch64-generic-1712484135.tar.gz downloaded to Stratum-0
Apr 07 10:37:27 AM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/69 to approve ingest
Apr 07 10:45:37 AM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-aarch64-generic-1712484135.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/69
Apr 07 11:22:08 AM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-aarch64-generic-1712484135.tar.gz successfully ingested at 2023.06/

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9171

date job status comment
Apr 07 10:00:52 UTC 2024 submitted job id 9171 awaits release by job manager
Apr 07 10:01:25 UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 10:02:29 UTC 2024 running job 9171 is running
Apr 07 10:03:32 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9171.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1712484149.tar.gzsize: 0 MiB (264348 bytes)
entries: 4
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/amd/zen2/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/amd/zen2
2023.06/init/eessi_environment_variables
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 10:03:32 UTC 2024 test result (no tests yet)
Apr 07 10:24:43 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1712484149.tar.gz to S3 bucket succeeded
Apr 07 10:30:00 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1712484149.tar.gz to S3 bucket succeeded
Apr 07 10:37:17 AM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1712484149.tar.gz downloaded to Stratum-0
Apr 07 10:37:30 AM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/70 to approve ingest
Apr 07 10:45:39 AM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1712484149.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/70
Apr 07 11:22:26 AM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1712484149.tar.gz successfully ingested at 2023.06/

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_307/9172

date job status comment
Apr 07 10:00:55 UTC 2024 submitted job id 9172 awaits release by job manager
Apr 07 10:01:27 UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 10:02:31 UTC 2024 running job 9172 is running
Apr 07 10:03:34 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9172.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1712484152.tar.gzsize: 0 MiB (264266 bytes)
entries: 4
modules under 2023.06/software/linux/x86_64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/generic/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/generic
2023.06/init/eessi_environment_variables
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 10:03:34 UTC 2024 test result (no tests yet)
Apr 07 10:25:02 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1712484152.tar.gz to S3 bucket succeeded
Apr 07 10:30:19 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1712484152.tar.gz to S3 bucket succeeded
Apr 07 10:37:19 AM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-generic-1712484152.tar.gz downloaded to Stratum-0
Apr 07 10:37:32 AM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/71 to approve ingest
Apr 07 10:45:42 AM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-generic-1712484152.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/71
Apr 07 11:22:43 AM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-generic-1712484152.tar.gz successfully ingested at 2023.06/

@nessi-bot
Copy link

nessi-bot bot commented Apr 7, 2024

New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_307/11097025

date job status comment
Apr 07 10:01:01 AM UTC 2024 submitted job id 11097025 awaits release by job manager
Apr 07 10:01:46 AM UTC 2024 released job awaits launch by Slurm scheduler
Apr 07 10:02:48 AM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-11097025.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712484122.tar.gzsize: 0 MiB (264956 bytes)
entries: 4
modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/skylake_avx512
2023.06/init/eessi_environment_variables
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Apr 07 10:02:48 AM UTC 2024 test result (no tests yet)
Apr 07 10:24:50 AM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712484122.tar.gz to S3 bucket succeeded
Apr 07 10:30:02 AM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712484122.tar.gz to S3 bucket succeeded
Apr 07 10:37:23 AM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712484122.tar.gz downloaded to Stratum-0
Apr 07 10:37:37 AM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/73 to approve ingest
Apr 07 10:45:46 AM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712484122.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/73
Apr 07 11:23:18 AM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712484122.tar.gz successfully ingested at 2023.06/

@trz42
Copy link
Collaborator Author

trz42 commented Apr 7, 2024

Checklist before starting deployment (setting bot:deploy label):

  • Check if the SPDX license identifier is provided
    • not needed, only internal script was updated
  • Check whether builds for all required architectures succeed (SUCCESS message + reasonably sized tarball)
  • Check if the PR is up-to-date with the target branch nessi.no-2023.06 in the repository (if not what are the differences)
  • Assess if all requested changes are sound (checking files changed on GitHub.com)
  • Verify that all easyconfig/s being built are included with the EB version used (if not why not)
    • no easyconfigs were used
  • Review changes (if any) needed to get the build(s) succeed (common changes for all architectures, changes for a single architecture, changes because of build environment specifics, etc.)

@trz42
Copy link
Collaborator Author

trz42 commented Apr 7, 2024

Target architectures

  • x86_64-intel-broadwell
  • x86_64-intel-skylake_avx512
  • x86_64-amd-zen2
  • x86_64-generic
  • aarch64-generic

Checklist for deployment/ingestion

  • NOTE, we would only need one tarball since it is for init which is architecture independent! We'll use all tarballs anyhow, because they also include updates to the Lmod cache.
  • at least one tarball for each architecture has been uploaded
  • at least one tarball for each architecture has been staged
  • for each staged tarball was a PR for approval/rejection opened
  • for each architecture one and only one tarball has been approved
  • for each architecture one and only one tarball was ingested
    • ingest failed with error
      �[31mERROR: no architecture directory found in the tarball!�[0m
      
  • all tests in the CI have succeeded (rerun failed tests ~ 10 mins after last ingest)
    • no need to rerun as all tests have passed
  • has the package become available via CernVM-FS for all architectures ingested (for lmod cache updates pay attention to timestamp of files)
command & log

command

cd /cvmfs/pilot.nessi.no/versions/2023.06 ; \
ls -l \
      init/eessi_env* \
      software/linux/*/generic/.lmod/cache/* \
      software/linux/x86_64/*/*/.lmod/cache/*

log

-rw-rw-r-- 1 cvmfs cvmfs    3891 Apr  7 12:01 init/eessi_environment_variables
-rw-r--r-- 1 cvmfs cvmfs 1382346 Apr  7 12:02 software/linux/aarch64/generic/.lmod/cache/spiderT.lua
-rw-r--r-- 1 cvmfs cvmfs  916127 Apr  7 12:02 software/linux/aarch64/generic/.lmod/cache/spiderT.luac_5.1
-rw-r--r-- 1 cvmfs cvmfs       0 Apr  7 12:02 software/linux/aarch64/generic/.lmod/cache/timestamp
-rw-r--r-- 1 cvmfs cvmfs 1443712 Apr  7 12:02 software/linux/x86_64/amd/zen2/.lmod/cache/spiderT.lua
-rw-r--r-- 1 cvmfs cvmfs  953119 Apr  7 12:02 software/linux/x86_64/amd/zen2/.lmod/cache/spiderT.luac_5.1
-rw-rw-r-- 1 cvmfs cvmfs       0 Apr  7 12:02 software/linux/x86_64/amd/zen2/.lmod/cache/timestamp
-rw-r--r-- 1 cvmfs cvmfs 1441339 Apr  7 12:02 software/linux/x86_64/generic/.lmod/cache/spiderT.lua
-rw-r--r-- 1 cvmfs cvmfs  951478 Apr  7 12:02 software/linux/x86_64/generic/.lmod/cache/spiderT.luac_5.1
-rw-rw-r-- 1 cvmfs cvmfs       0 Apr  7 12:02 software/linux/x86_64/generic/.lmod/cache/timestamp
-rw-r--r-- 1 cvmfs cvmfs 1460323 Apr  7 12:02 software/linux/x86_64/intel/broadwell/.lmod/cache/spiderT.lua
-rw-r--r-- 1 cvmfs cvmfs  964606 Apr  7 12:02 software/linux/x86_64/intel/broadwell/.lmod/cache/spiderT.luac_5.1
-rw-rw-r-- 1 cvmfs cvmfs       0 Apr  7 12:02 software/linux/x86_64/intel/broadwell/.lmod/cache/timestamp
-rw-r--r-- 1 cvmfs cvmfs  694693 Oct 10 14:55 software/linux/x86_64/intel/cascadelake/.lmod/cache/spiderT.lua
-rw-r--r-- 1 cvmfs cvmfs  490787 Oct 10 14:55 software/linux/x86_64/intel/cascadelake/.lmod/cache/spiderT.luac_5.1
-rw-r--r-- 1 cvmfs cvmfs       0 Oct 10 14:55 software/linux/x86_64/intel/cascadelake/.lmod/cache/timestamp
-rw-r--r-- 1 cvmfs cvmfs 1472188 Apr  7 12:02 software/linux/x86_64/intel/skylake_avx512/.lmod/cache/spiderT.lua
-rw-r--r-- 1 cvmfs cvmfs  972811 Apr  7 12:02 software/linux/x86_64/intel/skylake_avx512/.lmod/cache/spiderT.luac_5.1
-rw-rw-r-- 1 cvmfs cvmfs       0 Apr  7 12:01 software/linux/x86_64/intel/skylake_avx512/.lmod/cache/timestamp 

Copy link

@poksumdo poksumdo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All ingested. Ingestion was tricky.

@poksumdo poksumdo merged commit 5325fda into NorESSI:nessi.no-2023.06 Apr 7, 2024
25 checks passed
@trz42 trz42 mentioned this pull request Apr 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants