feat: add HEP cloud_pipeline stack

[wdconinc]

This PR adds a high energy physics (HEP) cloud pipeline stack. The goal is to include at least the core packages in HEP, to ensure they are tested when the underlying dependencies are modified or updated. For that reason, many of the variants have been enabled, even if they are not enabled by default.

TODO:

• dd4hep: depends_on root +root7 in some cases #43671
• podio: +rntuple requires root +root7 #43672

At this point it includes the following packages, but clearly could include a lot more (snapshot updated 2024-04-17):

• acts +analysis +binaries +dd4hep +edm4hep +examples +fatras +geant4 +hepmc3 +identification +podio +pythia8 +python +tgeo
• dd4hep +ddalign +ddcad +ddcond +dddetectors +dddigi +ddeve +ddg4 +ddrec +edm4hep +hepmc3 +lcio +utilityapps +xercesc
• delphes +pythia8
• edm4hep
• fastjet
• fjcontrib
• gaudi +aida +examples +heppdt +xercesc ^gdb +python
• geant4 +opengl +qt +threads ~vtk
• hepmc
• hepmc3 +interfaces +protobuf +python +rootio
• herwig3 +njet +vbfnlo
• lcio -examples +jar +rootdict # Note: lcio +examples ^ncurses -termlib, which leads to conflicts
• lhapdf +python
• madgraph5amc
• opendatadetector
• podio +rntuple +sio
• py-uproot +lz4 +xrootd +zstd
• pythia8 +evtgen +fastjet +hdf5 +hepmc +hepmc3 +lhapdf ~madgraph5amc +python +rivet -root # pythia8 and root circularly depend
• rivet hepmc=3
• root +davix +dcache +examples +fftw +fits +fortran +gdml +graphviz +gsl +http +math +minuit +mlp +mysql +opengl ~oracle +postgres +pythia6 +pythia8 +python +r +roofit +root7 +shadow +spectrum +sqlite +ssl +tbb +threads +tmva +unuran +vc +vdt +veccore +webgui +x +xml +xrootd
• sherpa +analysis -blackhat +fastjet +gzip +hepmc2 +hepmc3 +hepmc3root +hztool +lhapdf +lhole +openloops +pythia ~python ~recola ~rivet +root +ufo
• vecgeom +gdml +geant4 +root
• xrootd +davix +http +krb5 +python +readline +scitokens-cpp

[alalazo]

I assume this is still a work in progress. Let me know when it's ready to be merged.

[wdconinc]

Cherry-picked #43671 and #43672 while awaiting their merging...

[wdconinc]

This finally builds the hep cloud pipeline. Remaining failure is the chai issue in https://spackpm.slack.com/archives/C02N33GM28H/p1713298552011109?thread_ts=1713298552.011109&cid=C02N33GM28H.

[wdconinc]

@jmcarcell Do you want to review this and indicate what else would be useful to add here, based on what packages and variants you depend on in key4hep?

@alalazo At this point this is unify: false. Is there a preference for unify: when_possible? I don't see other cloud pipelines use when_possible; they only use false (most) or true (only in developer-tools).

[jmcarcell]

Looks fine to me. I don't think I have anything to add related to the variants.

[wdconinc]

Rebased to pick up #43738 fixing chai build.

[vvolkl]

Hi Wouter,

I think this is fantastic! Look good to me wrt. variants, I think @andresailer has also taken a look to check that this works for lcg releases.

The selection of packages seems good too. The most minmal stack that makes sense to me just needs to include dd4hep ( all variants enabled ), but this seems a good basis.