Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rebuild hatchling 1.18.0, Python 3.11.*, Python-bundle-PyPI-2023.* to solve setuptools_scm issue #546

Merged
merged 10 commits into from
Apr 30, 2024

Conversation

bedroge
Copy link
Collaborator

@bedroge bedroge commented Apr 19, 2024

During the installation of R-bundle-Bioconductor with EB 4.9.1 in #533, I ran into the same issue as reported in easybuilders/easybuild-easyconfigs#19849. In order to fix it, we have to apply the changes from easybuilders/easybuild-easyconfigs#19777, which involves a reinstallation of some modules.

Copy link

eessi-bot-aws bot commented Apr 19, 2024

Instance eessi-bot-mc-aws is configured to build:

  • arch x86_64/generic for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/generic for repo eessi-hpc.org-2023.06-software
  • arch x86_64/generic for repo eessi.io-2023.06-compat
  • arch x86_64/generic for repo eessi.io-2023.06-software
  • arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-software
  • arch x86_64/intel/haswell for repo eessi.io-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi.io-2023.06-software
  • arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-software
  • arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen2 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi.io-2023.06-software
  • arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen3 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi.io-2023.06-software
  • arch aarch64/generic for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/generic for repo eessi-hpc.org-2023.06-software
  • arch aarch64/generic for repo eessi.io-2023.06-compat
  • arch aarch64/generic for repo eessi.io-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-software
  • arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_v1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi.io-2023.06-software

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 19, 2024

bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3

Copy link

eessi-bot-aws bot commented Apr 19, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)

Copy link

eessi-bot-aws bot commented Apr 19, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/9641

date job status comment
Apr 19 12:03:36 UTC 2024 submitted job id 9641 awaits release by job manager
Apr 19 12:04:28 UTC 2024 released job awaits launch by Slurm scheduler
Apr 19 12:28:20 UTC 2024 running job 9641 is running
Apr 19 12:52:23 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-9641.out
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen3-1713530413.tar.gzsize: 110 MiB (115809448 bytes)
entries: 9972
modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all
Python/3.11.3-GCCcore-12.3.0.lua
software under 2023.06/software/linux/x86_64/amd/zen3/software
Python/3.11.3-GCCcore-12.3.0
other under 2023.06/software/linux/x86_64/amd/zen3
no other files in tarball
Apr 19 12:52:23 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-9641.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@boegel boegel added the 2023.06-software.eessi.io 2023.06 version of software.eessi.io label Apr 19, 2024
@bedroge
Copy link
Collaborator Author

bedroge commented Apr 19, 2024

Something really weird is going on here. Python was reinstalled without any issues, but the installation of hatchling fails due to:

Successfully built hatchling
Installing collected packages: hatchling
ERROR: Could not install packages due to an OSError.
Consider using the `--user` option or check the permissions.
Traceback (most recent call last):
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_internal/commands/install.py", line 449, in run
    installed = install_given_reqs(
                ^^^^^^^^^^^^^^^^^^^
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_internal/req/__init__.py", line 72, in install_given_reqs
    requirement.install(
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_internal/req/req_install.py", line 800, in install
    install_wheel(
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_internal/operations/install/wheel.py", line 731, in install_wheel
    _install_wheel(
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_internal/operations/install/wheel.py", line 648, in _install_wheel
    generated_console_scripts = maker.make_multiple(scripts_to_generate)
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_vendor/distlib/scripts.py", line 436, in make_multiple
    filenames.extend(self.make(specification, options))
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_internal/operations/install/wheel.py", line 429, in make
    return super().make(specification, options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_vendor/distlib/scripts.py", line 425, in make
    self._make_script(entry, filenames, options=options)
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_vendor/distlib/scripts.py", line 325, in _make_script
    self._write_script(scriptnames, shebang, script, filenames, ext)
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_vendor/distlib/scripts.py", line 293, in _write_script
    self._fileop.write_binary_file(outname, script_bytes)
  File "/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0/lib/python3.11/site-packages/pip/_vendor/distlib/util.py", line 555, in write_binary_file
    os.remove(path)
PermissionError: [Errno 13] Permission denied: '/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/hatchling/1.18.0-GCCcore-12.3.0/bin/hatchling'
 (at easybuild/tools/run.py:682 in parse_cmd_output)

I checked the tarball of the removal step, and this shows that the hatchling versions were removed correctly:

$ ls /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/hatchling/
$ 

Then I inspected the container resumed from the build step, and it shows:

$ ls /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/hatchling/
1.18.0-GCCcore-12.3.0
$ ls /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/hatchling/1.18.0-GCCcore-12.3.0/
lib
$ mkdir /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/hatchling/1.18.0-GCCcore-12.3.0/bin
mkdir: cannot create directory '/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/hatchling/1.18.0-GCCcore-12.3.0/bin': File exists
$ ls /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/hatchling/1.18.0-GCCcore-12.3.0/bin/
hatch-fancy-pypi-readme  hatchling

So it's not there, and it is there... 🤷‍♂️

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 19, 2024

bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1

Copy link

eessi-bot-aws bot commented Apr 19, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)

Copy link

eessi-bot-aws bot commented Apr 19, 2024

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/9643

date job status comment
Apr 19 17:41:37 UTC 2024 submitted job id 9643 awaits release by job manager
Apr 19 17:42:25 UTC 2024 released job awaits launch by Slurm scheduler
Apr 19 17:47:27 UTC 2024 running job 9643 is running
Apr 19 18:06:46 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-9643.out
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-neoverse_v1-1713549579.tar.gzsize: 109 MiB (114815172 bytes)
entries: 9972
modules under 2023.06/software/linux/aarch64/neoverse_v1/modules/all
Python/3.11.3-GCCcore-12.3.0.lua
software under 2023.06/software/linux/aarch64/neoverse_v1/software
Python/3.11.3-GCCcore-12.3.0
other under 2023.06/software/linux/aarch64/neoverse_v1
no other files in tarball
Apr 19 18:06:46 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-9643.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 19, 2024

Not a fluke, apparently...

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 22, 2024

bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3

Copy link

eessi-bot-aws bot commented Apr 22, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)

Copy link

eessi-bot-aws bot commented Apr 22, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3 resulted in:

    • no jobs were submitted

Copy link

eessi-bot-aws bot commented Apr 22, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/9762

date job status comment
Apr 22 14:41:03 UTC 2024 submitted job id 9762 awaits release by job manager
Apr 22 14:41:20 UTC 2024 released job awaits launch by Slurm scheduler
Apr 22 14:42:31 UTC 2024 running job 9762 is running
Apr 22 15:06:13 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-9762.out
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen3-1713797641.tar.gzsize: 110 MiB (115822302 bytes)
entries: 9972
modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all
Python/3.11.3-GCCcore-12.3.0.lua
software under 2023.06/software/linux/x86_64/amd/zen3/software
Python/3.11.3-GCCcore-12.3.0
other under 2023.06/software/linux/x86_64/amd/zen3
no other files in tarball
Apr 22 15:06:13 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-9762.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 22, 2024

bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3

Copy link

eessi-bot-aws bot commented Apr 22, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)

Copy link

eessi-bot-aws bot commented Apr 22, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3 resulted in:

    • no jobs were submitted

Copy link

eessi-bot-aws bot commented Apr 22, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/9764

date job status comment
Apr 22 15:14:05 UTC 2024 submitted job id 9764 awaits release by job manager
Apr 22 15:14:17 UTC 2024 released job awaits launch by Slurm scheduler
Apr 22 15:15:19 UTC 2024 running job 9764 is running
Apr 22 15:49:48 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-9764.out
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen3-1713800244.tar.gzsize: 222 MiB (232895616 bytes)
entries: 20562
modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/amd/zen3/software
hatchling/1.18.0-GCCcore-12.3.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/amd/zen3
no other files in tarball
Apr 22 15:49:48 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-9764.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 26, 2024

bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3

Copy link

eessi-bot-aws bot commented Apr 26, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)

Copy link

eessi-bot-aws bot commented Apr 26, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3 resulted in:

    • no jobs were submitted

Copy link

eessi-bot-aws bot commented Apr 26, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/9886

date job status comment
Apr 26 12:26:58 UTC 2024 submitted job id 9886 awaits release by job manager
Apr 26 12:27:05 UTC 2024 released job awaits launch by Slurm scheduler
Apr 26 12:28:07 UTC 2024 running job 9886 is running
Apr 26 12:51:31 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-9886.out
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen3-1714135170.tar.gzsize: 110 MiB (115806648 bytes)
entries: 9972
modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all
Python/3.11.3-GCCcore-12.3.0.lua
software under 2023.06/software/linux/x86_64/amd/zen3/software
Python/3.11.3-GCCcore-12.3.0
other under 2023.06/software/linux/x86_64/amd/zen3
no other files in tarball
Apr 26 12:51:31 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-9886.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 26, 2024

bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10019

date job status comment
Apr 30 13:15:40 UTC 2024 submitted job id 10019 awaits release by job manager
Apr 30 13:16:38 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 13:17:47 UTC 2024 running job 10019 is running
Apr 30 13:53:45 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-10019.out
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen3-1714484468.tar.gzsize: 222 MiB (233378943 bytes)
entries: 20913
modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/amd/zen3/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/amd/zen3
no other files in tarball
Apr 30 13:53:45 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10019.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-haswell for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10020

date job status comment
Apr 30 13:15:46 UTC 2024 submitted job id 10020 awaits release by job manager
Apr 30 13:16:43 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 13:23:16 UTC 2024 running job 10020 is running
Apr 30 14:12:40 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-10020.out
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-haswell-1714485380.tar.gzsize: 222 MiB (233445027 bytes)
entries: 20913
modules under 2023.06/software/linux/x86_64/intel/haswell/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/intel/haswell/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/intel/haswell
no other files in tarball
Apr 30 14:12:40 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10020.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10021

date job status comment
Apr 30 13:15:50 UTC 2024 submitted job id 10021 awaits release by job manager
Apr 30 13:16:45 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 13:23:18 UTC 2024 running job 10021 is running
Apr 30 14:09:27 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-10021.out
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1714485196.tar.gzsize: 222 MiB (233449199 bytes)
entries: 20913
modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/intel/skylake_avx512
no other files in tarball
Apr 30 14:09:27 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10021.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 30, 2024

I had added user write permissions to the hatchling directories on the Stratum 0, and that did solve the issue for hatchling, but now the same thing is also happening to PYthon-bundle-PyPI. So, Ive done the same for those directories, and will try again.

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 30, 2024

bot: build repo:eessi.io-2023.06-software arch:aarch64/generic
bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1
bot: build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1
bot: build repo:eessi.io-2023.06-software arch:x86_64/generic
bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2
bot: build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell
bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512

Copy link

eessi-bot-aws bot commented Apr 30, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)

Copy link

eessi-bot-aws bot commented Apr 30, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/generic from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/generic
  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_n1 from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1
  • received bot command build repo:eessi.io-2023.06-software arch:aarch64/neoverse_v1 from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/generic from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/generic
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen2 from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/amd/zen3 from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/haswell from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/skylake_avx512 from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512
  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_n1 resulted in:

    • no jobs were submitted
  • handling command build repository:eessi.io-2023.06-software architecture:aarch64/neoverse_v1 resulted in:

    • no jobs were submitted
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/generic resulted in:

    • no jobs were submitted
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen2 resulted in:

    • no jobs were submitted
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/amd/zen3 resulted in:

    • no jobs were submitted
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/haswell resulted in:

    • no jobs were submitted
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/skylake_avx512 resulted in:

    • no jobs were submitted

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture aarch64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10022

date job status comment
Apr 30 14:23:11 UTC 2024 submitted job id 10022 awaits release by job manager
Apr 30 14:23:43 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 14:25:02 UTC 2024 running job 10022 is running
Apr 30 15:44:58 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10022.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1714491188.tar.gzsize: 330 MiB (347030540 bytes)
entries: 44582
modules under 2023.06/software/linux/aarch64/generic/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
Python-bundle-PyPI/2023.06-GCCcore-12.3.0.lua
Python-bundle-PyPI/2023.10-GCCcore-13.2.0.lua
software under 2023.06/software/linux/aarch64/generic/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
Python-bundle-PyPI/2023.06-GCCcore-12.3.0
Python-bundle-PyPI/2023.10-GCCcore-13.2.0
other under 2023.06/software/linux/aarch64/generic
no other files in tarball
Apr 30 15:44:58 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10022.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Apr 30 18:49:12 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1714491188.tar.gz to S3 bucket succeeded

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_n1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10023

date job status comment
Apr 30 14:23:15 UTC 2024 submitted job id 10023 awaits release by job manager
Apr 30 14:23:46 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 14:25:05 UTC 2024 running job 10023 is running
Apr 30 15:44:59 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10023.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-neoverse_n1-1714491164.tar.gzsize: 331 MiB (347210496 bytes)
entries: 44582
modules under 2023.06/software/linux/aarch64/neoverse_n1/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
Python-bundle-PyPI/2023.06-GCCcore-12.3.0.lua
Python-bundle-PyPI/2023.10-GCCcore-13.2.0.lua
software under 2023.06/software/linux/aarch64/neoverse_n1/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
Python-bundle-PyPI/2023.06-GCCcore-12.3.0
Python-bundle-PyPI/2023.10-GCCcore-13.2.0
other under 2023.06/software/linux/aarch64/neoverse_n1
no other files in tarball
Apr 30 15:44:59 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10023.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Apr 30 18:49:34 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-neoverse_n1-1714491164.tar.gz to S3 bucket succeeded

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture aarch64-neoverse_v1 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10024

date job status comment
Apr 30 14:23:19 UTC 2024 submitted job id 10024 awaits release by job manager
Apr 30 14:23:48 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 14:25:07 UTC 2024 running job 10024 is running
Apr 30 15:21:58 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10024.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-neoverse_v1-1714490014.tar.gzsize: 331 MiB (347116638 bytes)
entries: 44582
modules under 2023.06/software/linux/aarch64/neoverse_v1/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
Python-bundle-PyPI/2023.06-GCCcore-12.3.0.lua
Python-bundle-PyPI/2023.10-GCCcore-13.2.0.lua
software under 2023.06/software/linux/aarch64/neoverse_v1/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
Python-bundle-PyPI/2023.06-GCCcore-12.3.0
Python-bundle-PyPI/2023.10-GCCcore-13.2.0
other under 2023.06/software/linux/aarch64/neoverse_v1
no other files in tarball
Apr 30 15:21:58 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10024.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Apr 30 18:49:57 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-neoverse_v1-1714490014.tar.gz to S3 bucket succeeded

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-generic for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10025

date job status comment
Apr 30 14:23:23 UTC 2024 submitted job id 10025 awaits release by job manager
Apr 30 14:23:55 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 14:25:14 UTC 2024 running job 10025 is running
Apr 30 15:50:27 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10025.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1714491255.tar.gzsize: 332 MiB (348712083 bytes)
entries: 44586
modules under 2023.06/software/linux/x86_64/generic/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
Python-bundle-PyPI/2023.06-GCCcore-12.3.0.lua
Python-bundle-PyPI/2023.10-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/generic/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
Python-bundle-PyPI/2023.06-GCCcore-12.3.0
Python-bundle-PyPI/2023.10-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/generic
no other files in tarball
Apr 30 15:50:27 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10025.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Apr 30 18:50:21 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1714491255.tar.gz to S3 bucket succeeded

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10026

date job status comment
Apr 30 14:23:27 UTC 2024 submitted job id 10026 awaits release by job manager
Apr 30 14:23:50 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 14:25:09 UTC 2024 running job 10026 is running
Apr 30 15:48:19 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10026.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1714490894.tar.gzsize: 333 MiB (349802829 bytes)
entries: 44586
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
Python-bundle-PyPI/2023.06-GCCcore-12.3.0.lua
Python-bundle-PyPI/2023.10-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
Python-bundle-PyPI/2023.06-GCCcore-12.3.0
Python-bundle-PyPI/2023.10-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/amd/zen2
no other files in tarball
Apr 30 15:48:19 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10026.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Apr 30 18:50:44 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1714490894.tar.gz to S3 bucket succeeded

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-amd-zen3 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10027

date job status comment
Apr 30 14:23:31 UTC 2024 submitted job id 10027 awaits release by job manager
Apr 30 14:23:53 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 14:25:12 UTC 2024 running job 10027 is running
Apr 30 15:28:58 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10027.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen3-1714490155.tar.gzsize: 333 MiB (349785972 bytes)
entries: 44586
modules under 2023.06/software/linux/x86_64/amd/zen3/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
Python-bundle-PyPI/2023.06-GCCcore-12.3.0.lua
Python-bundle-PyPI/2023.10-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/amd/zen3/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
Python-bundle-PyPI/2023.06-GCCcore-12.3.0
Python-bundle-PyPI/2023.10-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/amd/zen3
no other files in tarball
Apr 30 15:28:58 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10027.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Apr 30 18:51:07 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen3-1714490155.tar.gz to S3 bucket succeeded

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-haswell for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10028

date job status comment
Apr 30 14:23:35 UTC 2024 submitted job id 10028 awaits release by job manager
Apr 30 14:23:58 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 14:25:16 UTC 2024 running job 10028 is running
Apr 30 15:50:29 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10028.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-haswell-1714491212.tar.gzsize: 333 MiB (349914568 bytes)
entries: 44586
modules under 2023.06/software/linux/x86_64/intel/haswell/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
Python-bundle-PyPI/2023.06-GCCcore-12.3.0.lua
Python-bundle-PyPI/2023.10-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/intel/haswell/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
Python-bundle-PyPI/2023.06-GCCcore-12.3.0
Python-bundle-PyPI/2023.10-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/intel/haswell
no other files in tarball
Apr 30 15:50:29 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10028.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Apr 30 18:51:30 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-haswell-1714491212.tar.gz to S3 bucket succeeded

Copy link

eessi-bot-aws bot commented Apr 30, 2024

New job on instance eessi-bot-mc-aws for architecture x86_64-intel-skylake_avx512 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.04/pr_546/10029

date job status comment
Apr 30 14:23:39 UTC 2024 submitted job id 10029 awaits release by job manager
Apr 30 14:24:00 UTC 2024 released job awaits launch by Slurm scheduler
Apr 30 14:25:19 UTC 2024 running job 10029 is running
Apr 30 15:41:33 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10029.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1714490695.tar.gzsize: 333 MiB (349934433 bytes)
entries: 44586
modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all
hatchling/1.18.0-GCCcore-12.3.0.lua
hatchling/1.18.0-GCCcore-13.2.0.lua
Python/3.11.3-GCCcore-12.3.0.lua
Python/3.11.5-GCCcore-13.2.0.lua
Python-bundle-PyPI/2023.06-GCCcore-12.3.0.lua
Python-bundle-PyPI/2023.10-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software
hatchling/1.18.0-GCCcore-12.3.0
hatchling/1.18.0-GCCcore-13.2.0
Python/3.11.3-GCCcore-12.3.0
Python/3.11.5-GCCcore-13.2.0
Python-bundle-PyPI/2023.06-GCCcore-12.3.0
Python-bundle-PyPI/2023.10-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/intel/skylake_avx512
no other files in tarball
Apr 30 15:41:33 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10029.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Apr 30 18:51:54 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1714490695.tar.gz to S3 bucket succeeded

@boegel
Copy link
Contributor

boegel commented Apr 30, 2024

I had added user write permissions to the hatchling directories on the Stratum 0, and that did solve the issue for hatchling, but now the same thing is also happening to PYthon-bundle-PyPI. So, Ive done the same for those directories, and will try again.

@bedroge Can you open an issue where you write down some kind of conclusion from this? What you observed, what you tried to work around it, what worked in the end?
It doesn't seem like this is going to be a one-off case, but hopefully it's some kind of bug in fuse-overlayfs and hence the problem may be temporary?

Did you try doing a recursive chmod before doing the removal to trigger the rebuild?
Maybe doing a mv before rm would work too, not sure.

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 30, 2024

@bedroge Can you open an issue where you write down some kind of conclusion from this? What you observed, what you tried to work around it, what worked in the end?

It doesn't seem like this is going to be a one-off case, but hopefully it's some kind of bug in fuse-overlayfs and hence the problem may be temporary?

Did you try doing a recursive chmod before doing the removal to trigger the rebuild?

Maybe doing a mv before rm would work too, not sure.

Yep, I tried that as well (chmod and moving). I'll document it in an issue.

@boegel
Copy link
Contributor

boegel commented Apr 30, 2024

@bedroge Is this ready to deploy now?

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 30, 2024

@bedroge Is this ready to deploy now?

@boegel Yes it is, though it does require a manual ingestion, so the staging PRs should not be merged yet.

@boegel boegel added the bot:deploy Ask bot to deploy missing software installations to EESSI label Apr 30, 2024
@bedroge bedroge added ready-to-deploy Mark a PR as ready to deploy and removed bot:deploy Ask bot to deploy missing software installations to EESSI labels Apr 30, 2024
@bedroge
Copy link
Collaborator Author

bedroge commented Apr 30, 2024

@bedroge Can you open an issue where you write down some kind of conclusion from this? What you observed, what you tried to work around it, what worked in the end?

Done in #556.

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 30, 2024

Manual ingestion procedure:

rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/generic/software/hatchling/1.18.0-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/generic/software/hatchling/1.18.0-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_n1/software/hatchling/1.18.0-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_n1/software/hatchling/1.18.0-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_v1/software/hatchling/1.18.0-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_v1/software/hatchling/1.18.0-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/generic/software/hatchling/1.18.0-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/generic/software/hatchling/1.18.0-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/software/hatchling/1.18.0-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/software/hatchling/1.18.0-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/hatchling/1.18.0-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/hatchling/1.18.0-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software/hatchling/1.18.0-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software/hatchling/1.18.0-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/hatchling/1.18.0-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/hatchling/1.18.0-GCCcore-13.2.0

rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/generic/software/Python-bundle-PyPI/2023.06-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/generic/software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_n1/software/Python-bundle-PyPI/2023.06-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_n1/software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_v1/software/Python-bundle-PyPI/2023.06-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_v1/software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/generic/software/Python-bundle-PyPI/2023.06-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/generic/software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/software/Python-bundle-PyPI/2023.06-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python-bundle-PyPI/2023.06-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software/Python-bundle-PyPI/2023.06-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/Python-bundle-PyPI/2023.06-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/Python-bundle-PyPI/2023.10-GCCcore-13.2.0

rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/generic/software/Python/3.11.3-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/generic/software/Python/3.11.5-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_n1/software/Python/3.11.3-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_n1/software/Python/3.11.5-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_v1/software/Python/3.11.3-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/aarch64/neoverse_v1/software/Python/3.11.5-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/generic/software/Python/3.11.3-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/generic/software/Python/3.11.5-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/software/Python/3.11.3-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/software/Python/3.11.5-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.3-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen3/software/Python/3.11.5-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software/Python/3.11.3-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software/Python/3.11.5-GCCcore-13.2.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/Python/3.11.3-GCCcore-12.3.0
rm -rf /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/Python/3.11.5-GCCcore-13.2.0

cd /cvmfs/software.eessi.io/versions

tar xvzf /srv/tmp/tarballs/eessi-2023.06-software-linux-aarch64-generic-1714491188.tar.gz
tar xvzf /srv/tmp/tarballs/eessi-2023.06-software-linux-aarch64-neoverse_n1-1714491164.tar.gz
tar xvzf /srv/tmp/tarballs/eessi-2023.06-software-linux-aarch64-neoverse_v1-1714490014.tar.gz
tar xvzf /srv/tmp/tarballs/eessi-2023.06-software-linux-x86_64-amd-zen2-1714490894.tar.gz
tar xvzf /srv/tmp/tarballs/eessi-2023.06-software-linux-x86_64-amd-zen3-1714490155.tar.gz
tar xvzf /srv/tmp/tarballs/eessi-2023.06-software-linux-x86_64-generic-1714491255.tar.gz
tar xvzf /srv/tmp/tarballs/eessi-2023.06-software-linux-x86_64-intel-haswell-1714491212.tar.gz
tar xvzf /srv/tmp/tarballs/eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1714490695.tar.gz

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 30, 2024

Manual ingestion completed, I've closed the staging PRs. Manual check for just one CPU target:

$ ls -l /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software/hatchling/
total 1
dr-xr-xr-x 5 cvmfs cvmfs 66 apr 30 21:18 1.18.0-GCCcore-12.3.0
dr-xr-xr-x 5 cvmfs cvmfs 66 apr 30 21:18 1.18.0-GCCcore-13.2.0

$ ml hatchling/1.18.0-GCCcore-13.2.0 
$ python
Python 3.11.5 (main, Apr 30 2024, 14:52:08) [GCC 13.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import setuptools_scm
>>> setuptools_scm.__path__
['/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software/Python/3.11.5-GCCcore-13.2.0/lib/python3.11/site-packages/setuptools_scm']

So, setuptools_scm is now part of Python instead of hatchling, as expected.

This PR can be merged. I've also retriggered builds for Bioconductor 3.18 with EB 4.9.1 in #533, which should hopefully succeed now.

@boegel boegel merged commit e4e639b into EESSI:2023.06-software.eessi.io Apr 30, 2024
33 checks passed
@bedroge bedroge deleted the rebuild_python_eb491 branch April 30, 2024 20:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2023.06-software.eessi.io 2023.06 version of software.eessi.io ready-to-deploy Mark a PR as ready to deploy
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants