{perf}[gompi/2023b] Extrae v4.2.0 #20690

julianmorillo · 2024-05-30T14:37:48Z

No description provided.

ocaisa · 2024-05-30T18:44:45Z

@boegelbot please test @ generoso
CORE_CNT=16

boegelbot · 2024-05-30T18:45:09Z

@ocaisa: Request for testing this PR well received on login1

PR test command 'EB_PR=20690 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_20690 --ntasks="16" ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 13598

Test results coming soon (I hope)...

- notification for comment with ID 2140650688 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2024-05-30T18:49:22Z

Test report by @boegelbot
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
cnx1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/boegelbot/ccd838a90cbc93f7901fa857588daded for a full test report.

ocaisa · 2024-05-30T18:59:30Z

@boegelbot please test @ jsc-zen3
CORE_CNT=16

boegelbot · 2024-05-30T19:00:08Z

@ocaisa: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=20690 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_20690 --ntasks="16" ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

exit code: 0
output:

Submitted batch job 4251

Test results coming soon (I hope)...

- notification for comment with ID 2140688491 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2024-05-30T19:03:37Z

Test report by @boegelbot
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
jsczen3c1.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.4, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.18
See https://gist.github.com/boegelbot/f79c457fa4dcc06087fdc851cd077fa7 for a full test report.

easybuild/easyconfigs/e/Extrae/Extrae-4.1.6-gompi-2023b.eb

Co-authored-by: ocaisa <alan.ocais@cecam.org>

bedroge · 2024-05-31T09:05:00Z

@boegelbot please test @ generoso

boegelbot · 2024-05-31T09:05:12Z

@bedroge: Request for testing this PR well received on login1

PR test command 'EB_PR=20690 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_20690 --ntasks=4 ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 13603

Test results coming soon (I hope)...

- notification for comment with ID 2141552680 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2024-05-31T09:11:01Z

Test report by @boegelbot
FAILED
Build succeeded for 0 out of 1 (1 easyconfigs in total)
cns2 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/boegelbot/d11d5438822e785e5acbdff695e06cfb for a full test report.

bedroge · 2024-05-31T10:24:45Z

I'm trying this on my system now, and the MPI tests are all failing with similar errors:

==============================================================
   Extrae 4.1.6: tests/functional/tracer/MPI/test-suite.log
==============================================================

# TOTAL: 21
# PASS:  0
# SKIP:  0
# XFAIL: 0
# FAIL:  21
# XPASS: 0
# ERROR: 0

.. contents:: :depth: 2

FAIL: mpi_initfini_c_linked_1proc.sh
====================================

Welcome to Extrae 4.1.6
Extrae: Application has been linked or preloaded with Extrae, BUT EXTRAE_ON is NOT set!
Welcome to Extrae 4.1.6
Extrae: Application has been linked or preloaded with Extrae, BUT EXTRAE_ON is NOT set!
mpi2prv: Unable to open TRACE.mpits file.
mpi2prv: No intermediate trace files given.
merger: Output trace format is: Paraver
merger: Extrae 4.1.6
Error! Could not find 'MPI_Init'.
FAIL mpi_initfini_c_linked_1proc.sh (exit status: 1)

and the IO ones:

FAIL: io.sh
===========

Welcome to Extrae 4.1.6
Extrae: Application has been linked or preloaded with Extrae, BUT EXTRAE_ON is NOT set!
mpi2prv: Unable to open TRACE.mpits file.
mpi2prv: No intermediate trace files given.
merger: Output trace format is: Paraver
merger: Extrae 4.1.6
Error! Could not find 'open()'.
FAIL io.sh (exit status: 1)

bedroge · 2024-05-31T10:56:50Z

The docs suggests that having an XML config file (which the tests supply) should make setting EXTRAE_ON redundant, but that doesn't seem to work here. Manually setting EXTRAE_ON brings things a bit further, but it still complains that the resulting file doesn't contain open().

It was a bit tricky to find, but ultimately I was checking the source code where this error about EXTRAE_ON is being printed, and apparently it happens if XML2 is not used/found:
https://github.com/bsc-performance-tools/extrae/blob/4.1.6/src/tracer/wrappers/API/wrapper.c#L1824
Checking the build log again shows that it indeed failed to find libxml2:

checking for XML2 installation... /usr/local
checking for XML2 binaries directory... /usr/local/bin
checking for XML2 required binary xml2-config... no
checking for XML2 includes directory... /usr/local/include
checking for XML2 libraries directory... /usr/local/lib
checking for XML2 shared library folder... no
checking for XML2 multiarch library folder... no
checking for XML2 required library libxml2... no
checking for XML2 valid installation... no

edit: adding a --with-xml=$EBROOTLIBXML2 seems to solve the issue. Should be fixed by: easybuilders/easybuild-easyblocks#3339.

edit2: still some tests fail, though. For instance, one MPI test is now failing because of:

*** The MPI_Allreduce() function was called after MPI_FINALIZE was invoked.
*** This is disallowed by the MPI standard.
*** Your MPI job will now abort.

This is the same error as the last one in this issue: bsc-performance-tools/extrae#98.

… tracing

ocaisa · 2024-06-13T14:34:47Z

@boegelbot please test @ jsc-zen3
CORE_CNT=16
EB_ARGS="--include-easyblocks-from-pr 3339"

ocaisa · 2024-07-16T14:26:07Z

@boegelbot please test @ jsc-zen3
CORE_CNT=16
EB_ARGS="--include-easyblocks-from-pr 3392"

boegelbot · 2024-07-16T14:30:11Z

@ocaisa: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=20690 EB_ARGS="--include-easyblocks-from-pr 3392" EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_20690 --ntasks="16" ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

exit code: 0
output:

Submitted batch job 4564

Test results coming soon (I hope)...

- notification for comment with ID 2231059743 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

ocaisa · 2024-07-16T14:30:47Z

@boegelbot please test @ generoso
CORE_CNT=16
EB_ARGS="--include-easyblocks-from-pr 3392"

boegelbot · 2024-07-16T14:35:09Z

@ocaisa: Request for testing this PR well received on login1

PR test command 'EB_PR=20690 EB_ARGS="--include-easyblocks-from-pr 3392" EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_20690 --ntasks="16" ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 13931

Test results coming soon (I hope)...

- notification for comment with ID 2231070391 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2024-07-16T14:36:09Z

Test report by @boegelbot
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#3392
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
jsczen3c2.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.4, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.18
See https://gist.github.com/boegelbot/fa25fa6ff14f75391ae55572076ef195 for a full test report.

boegelbot · 2024-07-16T14:41:05Z

Test report by @boegelbot
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#3392
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
cnx1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/boegelbot/ca1eeaec1153e0b0bee282df9e5a129b for a full test report.

ocaisa · 2024-07-16T14:57:04Z

@boegelbot please test @ jsc-zen3
CORE_CNT=16

bedroge · 2024-07-16T14:58:22Z

Test report by @bedroge
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#3392
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
bob-Latitude-5300 - Linux Ubuntu 22.04, x86_64, Intel(R) Core(TM) i7-8665U CPU @ 1.90GHz, Python 3.10.12
See https://gist.github.com/bedroge/350b363c51f77f7cab7b5c96f5e701ab for a full test report.

boegelbot · 2024-07-16T15:00:11Z

@ocaisa: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=20690 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_20690 --ntasks="16" ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

exit code: 0
output:

Submitted batch job 4568

Test results coming soon (I hope)...

- notification for comment with ID 2231131658 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

ocaisa · 2024-07-16T15:01:14Z

@boegelbot please test @ generoso
CORE_CNT=16

boegelbot · 2024-07-16T15:05:10Z

@ocaisa: Request for testing this PR well received on login1

PR test command 'EB_PR=20690 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_20690 --ntasks="16" ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 13932

Test results coming soon (I hope)...

- notification for comment with ID 2231141057 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2024-07-16T15:05:34Z

Test report by @boegelbot
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
jsczen3c1.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.4, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.18
See https://gist.github.com/boegelbot/f03dbf7409eb714404ecba25a78bb829 for a full test report.

bedroge · 2024-07-16T15:09:35Z

Test report by @bedroge
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#3392
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
starfive - Linux Debian GNU/Linux n/a, RISC-V-64, UNKNOWN, Python 3.10.9
See https://gist.github.com/bedroge/d24b595334aa6c05edfc895ad11cda5e for a full test report.

boegelbot · 2024-07-16T15:11:07Z

Test report by @boegelbot
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
cnx1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/boegelbot/ef90f8ee6db28866a50f35a7937051c1 for a full test report.

bedroge · 2024-07-16T15:13:50Z

Test report by @bedroge
FAILED
Build succeeded for 0 out of 1 (1 easyconfigs in total)
bob-Latitude-5300 - Linux Ubuntu 22.04, x86_64, Intel(R) Core(TM) i7-8665U CPU @ 1.90GHz, Python 3.10.12
See https://gist.github.com/bedroge/a628252915f869c8b034de18570f893b for a full test report.

edit: oh, this was without the PR, but I should have included the older PR (3339)...

julianmorillo · 2024-07-16T15:17:04Z

Test report by @bedroge FAILED Build succeeded for 0 out of 1 (1 easyconfigs in total) bob-Latitude-5300 - Linux Ubuntu 22.04, x86_64, Intel(R) Core(TM) i7-8665U CPU @ 1.90GHz, Python 3.10.12 See https://gist.github.com/bedroge/a628252915f869c8b034de18570f893b for a full test report.

Did you included "--include-easyblocks-from-pr 3339" in the command line?

bedroge · 2024-07-16T15:17:57Z

Sorry, ignore that one 😆 Indeed forgot to include the other easyblocks PR, retrying it now.

bedroge · 2024-07-16T15:25:28Z

Test report by @bedroge
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#3339
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
bob-Latitude-5300 - Linux Ubuntu 22.04, x86_64, Intel(R) Core(TM) i7-8665U CPU @ 1.90GHz, Python 3.10.12
See https://gist.github.com/bedroge/3bddcb205b3e55d5081700da375dbbc9 for a full test report.

easybuild/easyconfigs/e/Extrae/Extrae-4.2.0-gompi-2023b.eb

ocaisa

This has been tested to death!

julianmorillo added 2 commits May 30, 2024 16:34

Add Extrae-4.1.6-gompi.2023b.eb and make binutils detection more robust

e0bfd59

Add the use of the patch to the easyconfig file

de831e8

julianmorillo mentioned this pull request May 30, 2024

Notes on kickstarting the RISC-V software layer EESSI/software-layer#552

Open

julianmorillo added 5 commits May 30, 2024 17:16

Adding checksum

ffebdad

Solving "line too long" failing test

b4386d9

Solve naming issue

aa3c8dd

Solve zlib dependency

92ec082

Fix zlib dependency

0eb7f74

ocaisa mentioned this pull request May 30, 2024

{perf}[gompi/2023a] Extrae v4.0.6 #20153

Draft

ocaisa reviewed May 30, 2024

View reviewed changes

easybuild/easyconfigs/e/Extrae/Extrae-4.1.6-gompi-2023b.eb Outdated Show resolved Hide resolved

ocaisa reviewed May 31, 2024

View reviewed changes

easybuild/easyconfigs/e/Extrae/Extrae-4.1.6-gompi-2023b.eb Outdated Show resolved Hide resolved

julianmorillo and others added 2 commits May 31, 2024 10:37

Update easybuild/easyconfigs/e/Extrae/Extrae-4.1.6-gompi-2023b.eb

3106598

Co-authored-by: ocaisa <alan.ocais@cecam.org>

Update easybuild/easyconfigs/e/Extrae/Extrae-4.1.6-gompi-2023b.eb

f6d2516

Co-authored-by: ocaisa <alan.ocais@cecam.org>

julianmorillo changed the title ~~Add Extrae-4.1.6-gompi.2023b.eb and make binutils detection more robust~~ Add Extrae-4.1.6-gompi-2023b.eb and make binutils detection more robust May 31, 2024

boegel added this to the 4.x milestone Jun 8, 2024

boegel added the update label Jun 8, 2024

Moving to 4.1.7 version as there is a critical bug fix related to MPI…

fe34609

… tracing

ocaisa changed the title ~~Add Extrae-4.1.6-gompi-2023b.eb and make binutils detection more robust~~ Add Extrae-4.1.7-gompi-2023b.eb and make binutils detection more robust Jun 13, 2024

julianmorillo mentioned this pull request Jul 16, 2024

Disable dynamic memory tracing, which causes MPI tests fail in some systems easybuilders/easybuild-easyblocks#3392

Closed

julianmorillo and others added 2 commits July 16, 2024 16:44

Merge branch 'easybuilders:develop' into develop

4ed82a5

Disable dynamic memory instrumentation

a13e667

julianmorillo dismissed ocaisa’s stale review via a13e667 July 16, 2024 14:54

ocaisa reviewed Jul 16, 2024

View reviewed changes

easybuild/easyconfigs/e/Extrae/Extrae-4.2.0-gompi-2023b.eb Outdated Show resolved Hide resolved

Update easybuild/easyconfigs/e/Extrae/Extrae-4.2.0-gompi-2023b.eb

a26b35c

ocaisa approved these changes Jul 16, 2024

View reviewed changes

ocaisa enabled auto-merge July 16, 2024 15:41

ocaisa merged commit b77d542 into easybuilders:develop Jul 16, 2024
9 checks passed

bedroge modified the milestones: 4.x, release after 4.9.2 Jul 16, 2024

bedroge changed the title ~~Add Extrae-4.2.0-gompi-2023b.eb~~ {perf}[gompi/2023b] Extrae v4.2.0 Jul 16, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

{perf}[gompi/2023b] Extrae v4.2.0 #20690

{perf}[gompi/2023b] Extrae v4.2.0 #20690

julianmorillo commented May 30, 2024

ocaisa commented May 30, 2024

boegelbot commented May 30, 2024

boegelbot commented May 30, 2024

ocaisa commented May 30, 2024

boegelbot commented May 30, 2024

boegelbot commented May 30, 2024

bedroge commented May 31, 2024

boegelbot commented May 31, 2024

boegelbot commented May 31, 2024

bedroge commented May 31, 2024 •

edited

Loading

bedroge commented May 31, 2024 •

edited

Loading

ocaisa commented Jun 13, 2024

ocaisa commented Jul 16, 2024

boegelbot commented Jul 16, 2024

ocaisa commented Jul 16, 2024

boegelbot commented Jul 16, 2024

boegelbot commented Jul 16, 2024

boegelbot commented Jul 16, 2024

ocaisa commented Jul 16, 2024

bedroge commented Jul 16, 2024

boegelbot commented Jul 16, 2024

ocaisa commented Jul 16, 2024

boegelbot commented Jul 16, 2024

boegelbot commented Jul 16, 2024

bedroge commented Jul 16, 2024

boegelbot commented Jul 16, 2024

bedroge commented Jul 16, 2024 •

edited

Loading

julianmorillo commented Jul 16, 2024

bedroge commented Jul 16, 2024

bedroge commented Jul 16, 2024

ocaisa left a comment

{perf}[gompi/2023b] Extrae v4.2.0 #20690

{perf}[gompi/2023b] Extrae v4.2.0 #20690

Conversation

julianmorillo commented May 30, 2024

ocaisa commented May 30, 2024

boegelbot commented May 30, 2024

boegelbot commented May 30, 2024

ocaisa commented May 30, 2024

boegelbot commented May 30, 2024

boegelbot commented May 30, 2024

bedroge commented May 31, 2024

boegelbot commented May 31, 2024

boegelbot commented May 31, 2024

bedroge commented May 31, 2024 • edited Loading

bedroge commented May 31, 2024 • edited Loading

ocaisa commented Jun 13, 2024

ocaisa commented Jul 16, 2024

boegelbot commented Jul 16, 2024

ocaisa commented Jul 16, 2024

boegelbot commented Jul 16, 2024

boegelbot commented Jul 16, 2024

boegelbot commented Jul 16, 2024

ocaisa commented Jul 16, 2024

bedroge commented Jul 16, 2024

boegelbot commented Jul 16, 2024

ocaisa commented Jul 16, 2024

boegelbot commented Jul 16, 2024

boegelbot commented Jul 16, 2024

bedroge commented Jul 16, 2024

boegelbot commented Jul 16, 2024

bedroge commented Jul 16, 2024 • edited Loading

julianmorillo commented Jul 16, 2024

bedroge commented Jul 16, 2024

bedroge commented Jul 16, 2024

ocaisa left a comment

Choose a reason for hiding this comment

bedroge commented May 31, 2024 •

edited

Loading

bedroge commented May 31, 2024 •

edited

Loading

bedroge commented Jul 16, 2024 •

edited

Loading