Icon4py merge greenline in main

[halungge]

Adapting icon and py-icon4py packages to icon4py PR https://github.com/C2SM/icon4py/pull/260

Includes

• update build path in icon and icon4py
• added dependencies in py-icon4py
• new py-ghex package for python bindings of GHEX https://github.com/ghex-org/GHEX
  • packages for dependencies not yet available in spack 0.18
• new patch version for serialbox to make the python extension run with numpy@1.24

[dominichofer]

Please add spack info <package> and spack spec <package> tests for the new packages in test/integration_test.py. And spack install <package> tests in test/system_test.py. Once added, please trigger them in our CI system with a GitHub comment launch jenkins <package1> <package2> [docu]. Thank you!

[halungge]

launch jenkins py-ghex py-hatch-vcs py-pyproject-metadata py-pytest-mpi py-pytest-subprocess py-setuptools-scm py-exceptiongroup py-flit-scm py-cattrs serialbox

[halungge]

Really? At least the spack info and spack spec tests you could easily generate. Just make it a parametrized test with generator function for all packages in the repo...

[jenkins-apn]

tsa

🟢 unit test

	Test
🟢	summary

🔴 integration test

	Test
🟢	py-cattrs-spack_info
🔴	py-cattrs-spack_spec
🟢	py-exceptiongroup-spack_info
🟢	py-exceptiongroup-spack_spec
🟢	py-flit-scm-spack_info
🟢	py-flit-scm-spack_spec
🟢	py-ghex-spack_info
🟢	py-ghex-spack_spec
🟢	py-pyproject-metadata-spack_info
🟢	py-pyproject-metadata-spack_spec
🟢	py-pytest-mpi-spack_info
🟢	py-pytest-mpi-spack_spec
🟢	py-pytest-subprocess-spack_spec
🟢	py-setuptools-scm-spack_info
🟢	py-setuptools-scm-spack_spec

WARNING: Serial tests did not run for system tests

[jenkins-apn]

daint

🟢 unit test

	Test
🟢	summary

🔴 integration test

	Test
🟢	py-cattrs-spack_info
🔴	py-cattrs-spack_spec
🟢	py-exceptiongroup-spack_info
🟢	py-exceptiongroup-spack_spec
🟢	py-flit-scm-spack_info
🟢	py-flit-scm-spack_spec
🟢	py-ghex-spack_info
🟢	py-ghex-spack_spec
🟢	py-pyproject-metadata-spack_info
🟢	py-pyproject-metadata-spack_spec
🟢	py-pytest-mpi-spack_info
🟢	py-pytest-mpi-spack_spec
🟢	py-pytest-subprocess-spack_spec
🟢	py-setuptools-scm-spack_info
🟢	py-setuptools-scm-spack_spec

WARNING: Serial tests did not run for system tests

[jenkins-apn]

balfrin

🟢 unit test

	Test
🟢	summary

🔴 integration test

	Test
🟢	py-cattrs-spack_info
🔴	py-cattrs-spack_spec
🟢	py-exceptiongroup-spack_info
🟢	py-exceptiongroup-spack_spec
🟢	py-flit-scm-spack_info
🟢	py-flit-scm-spack_spec
🟢	py-ghex-spack_info
🟢	py-ghex-spack_spec
🟢	py-pyproject-metadata-spack_info
🟢	py-pyproject-metadata-spack_spec
🟢	py-pytest-mpi-spack_info
🟢	py-pytest-mpi-spack_spec
🟢	py-pytest-subprocess-spack_spec
🟢	py-setuptools-scm-spack_info
🟢	py-setuptools-scm-spack_spec

WARNING: Serial tests did not run for system tests

[halungge]

launch jenkins py-cattrs

[jenkins-apn]

balfrin

🟢 unit test

	Test
🟢	summary

🟢 integration test

	Test
🟢	py-cattrs-spack_info
🟢	py-cattrs-spack_spec

🟢 system test

	Test
🟢	PyCattrs-install_default

[jenkins-apn]

daint

🟢 unit test

	Test
🟢	summary

🟢 integration test

	Test
🟢	py-cattrs-spack_info
🟢	py-cattrs-spack_spec

🟢 system test

	Test
🟢	PyCattrs-install_default

[jenkins-apn]

tsa

🟢 unit test

	Test
🟢	summary

🟢 integration test

	Test
🟢	py-cattrs-spack_info
🟢	py-cattrs-spack_spec

🟢 system test

	Test
🟢	PyCattrs-install_default

[halungge]

launch jenkins py-ghex py-hatch-vcs py-pyproject-metadata py-pytest-mpi py-pytest-subprocess py-setuptools-scm py-exceptiongroup py-flit-scm py-cattrs serialbox

[jenkins-apn]

balfrin

🟢 unit test

	Test
🟢	summary

🟢 integration test

	Test
🟢	py-cattrs-spack_info
🟢	py-cattrs-spack_spec
🟢	py-exceptiongroup-spack_info
🟢	py-exceptiongroup-spack_spec
🟢	py-flit-scm-spack_info
🟢	py-flit-scm-spack_spec
🟢	py-ghex-spack_info
🟢	py-ghex-spack_spec
🟢	py-hatch-vcs-spack_spec
🟢	py-pyproject-metadata-spack_info
🟢	py-pyproject-metadata-spack_spec
🟢	py-pytest-mpi-spack_info
🟢	py-pytest-mpi-spack_spec
🟢	py-pytest-subprocess-spack_spec
🟢	py-setuptools-scm-spack_info
🟢	py-setuptools-scm-spack_spec

🟢 system test

	Test
🟢	PyCattrs-install_default

[jenkins-apn]

tsa

🟢 unit test

	Test
🟢	summary

🟢 integration test

	Test
🟢	py-cattrs-spack_info
🟢	py-cattrs-spack_spec
🟢	py-exceptiongroup-spack_info
🟢	py-exceptiongroup-spack_spec
🟢	py-flit-scm-spack_info
🟢	py-flit-scm-spack_spec
🟢	py-ghex-spack_info
🟢	py-ghex-spack_spec
🟢	py-hatch-vcs-spack_spec
🟢	py-pyproject-metadata-spack_info
🟢	py-pyproject-metadata-spack_spec
🟢	py-pytest-mpi-spack_info
🟢	py-pytest-mpi-spack_spec
🟢	py-pytest-subprocess-spack_spec
🟢	py-setuptools-scm-spack_info
🟢	py-setuptools-scm-spack_spec

🟢 system test

	Test
🟢	PyCattrs-install_default

[jenkins-apn]

daint

🟢 unit test

	Test
🟢	summary

🟢 integration test

	Test
🟢	py-cattrs-spack_info
🟢	py-cattrs-spack_spec
🟢	py-exceptiongroup-spack_info
🟢	py-exceptiongroup-spack_spec
🟢	py-flit-scm-spack_info
🟢	py-flit-scm-spack_spec
🟢	py-ghex-spack_info
🟢	py-ghex-spack_spec
🟢	py-hatch-vcs-spack_spec
🟢	py-pyproject-metadata-spack_info
🟢	py-pyproject-metadata-spack_spec
🟢	py-pytest-mpi-spack_info
🟢	py-pytest-mpi-spack_spec
🟢	py-pytest-subprocess-spack_spec
🟢	py-setuptools-scm-spack_info
🟢	py-setuptools-scm-spack_spec

🟢 system test

	Test
🟢	PyCattrs-install_default

[jonasjucker]

launch jenkins icon daint

[jenkins-apn]

tsa

🟢 unit test

	Test
🟢	summary

WARNING: Serial tests did not run for system tests

[jenkins-apn]

daint

🟢 unit test

	Test
🟢	summary

WARNING: Serial tests did not run for system tests

[jenkins-apn]

balfrin

🟢 unit test

	Test
🟢	summary

WARNING: Serial tests did not run for system tests

[jonasjucker]

launch jenkins icon

[jenkins-apn]

tsa

🟢 unit test

	Test
🟢	summary

🟢 integration test

	Test
🟢	icon-spack_info
🟢	icon-spack_spec
🟢	icon_serialization=create_claw=std-spack_spec

[jenkins-apn]

balfrin

🟢 unit test

	Test
🟢	summary

🟢 integration test

	Test
🟢	icon-spack_info
🟢	icon-spack_spec
🟢	icon_serialization=create_claw=std-spack_spec

🔴 system test

	Test
🔴	Icon-install_2_6_6_gcc
🔴	Icon-install_2_6_6_nvhpc
🔴	Icon-install_nwp_gpu

WARNING: Serial tests did not run for system tests

[abishekg7]

@jonasjucker I'm also trying to build this locally on daint. There might be more fixes to come.

[abishekg7]

@jonasjucker there are some updates to the builtin py-isort in spack:develop that seem to fix our issues. But should I extend the inbuilt py-isort and add the fixes, or just override it with the latest py-isort recipe?

[jonasjucker]

@jonasjucker there are some updates to the builtin py-isort in spack:develop that seem to fix our issues. But should I extend the inbuilt py-isort and add the fixes, or just override it with the latest py-isort recipe?

I have no preference, if it is only a small fix, i.e. something like patch(xxx) or version(xxx) Id' prefer an extension.
Otherwise an override is good too. But better add an issue to not forget about the override.

[jenkins-apn]

daint

🟢 unit test

	Test
🟢	summary

🟢 integration test

	Test
🟢	icon-spack_info
🟢	icon-spack_spec
🟢	icon_serialization=create_claw=std-spack_spec

🔴 system test

	Test
🟢	Icon-install_2_6_6_gcc
🟢	daint_cpu_cce
🟢	daint_cpu_gcc
🟢	daint_cpu_nvhpc
🟢	daint_gpu_nvhpc
🔴	daint_dsl_nvhpc

WARNING: Serial tests did not run for system tests

[abishekg7]

launch jenkins icon daint

[jenkins-apn]

tsa

🟢 unit test

	Test
🟢	summary

[jenkins-apn]

balfrin

🟢 unit test

	Test
🟢	summary

[jenkins-apn]

daint

🟢 unit test

	Test
🟢	summary

🟢 integration test

	Test
🟢	icon-spack_info
🟢	icon-spack_spec
🟢	icon_serialization=create_claw=std-spack_spec

🟢 system test

	Test
🟢	Icon-install_2_6_6_gcc
🟢	daint_cpu_cce
🟢	daint_cpu_gcc
🟢	daint_cpu_nvhpc
🟢	daint_cpu_nvhpc_out_of_source
🟢	daint_gpu_nvhpc
🟢	daint_dsl_nvhpc

[jonasjucker]

moved to #834