Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Intermittent failures in DD4hep test workflow #32646

Closed
kpedro88 opened this issue Jan 12, 2021 · 15 comments
Closed

Intermittent failures in DD4hep test workflow #32646

kpedro88 opened this issue Jan 12, 2021 · 15 comments

Comments

@kpedro88
Copy link
Contributor

I've seen this issue in unrelated PRs at least twice now:
#32576 (comment)
#32574 (comment)

@kpedro88
Copy link
Contributor Author

assign geometry

@cmsbuild
Copy link
Contributor

New categories assigned: geometry

@Dr15Jones,@cvuosalo,@mdhildreth,@makortel,@ianna,@civanch you have been requested to review this Pull request/Issue and eventually sign? Thanks

@cmsbuild
Copy link
Contributor

A new Issue was created by @kpedro88 Kevin Pedro.

@Dr15Jones, @dpiparo, @silviodonato, @smuzaffar, @makortel, @qliphy can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

@cvuosalo
Copy link
Contributor

@civanch Could you please take a look at these errors? How might they be caused?

@cvuosalo
Copy link
Contributor

assign simulation

@cmsbuild
Copy link
Contributor

New categories assigned: simulation

@mdhildreth,@civanch you have been requested to review this Pull request/Issue and eventually sign? Thanks

@civanch
Copy link
Contributor

civanch commented Jan 12, 2021

I would guess, that this happens just now after recent PRs were merged. @cvuosalo , @hugo83, @bsunanda do you agree or it is something else?

@cvuosalo
Copy link
Contributor

@civanch I noticed some sporadic errors in my own tests of the workflow last month, so the instability has been present for a while. But the errors were not reproducible.

@civanch
Copy link
Contributor

civanch commented Jan 15, 2021

This error has been discussed with expert in Geant4 tracking John Apostolakis. It happens due to negative step length -1 mm, which is huge and is not related to precision lost. From my point of view, it is an indication that there is a broken geometry. Position of the initial point (-538.967161 604.098226 -167.072581), particle is e- of 6 keV. John said, that for -1 mm step integration in field may fail, such step length is not allowed.

@makortel
Copy link
Contributor

makortel commented Jan 21, 2021

(message irrelevant for his issue deleted)

@Dr15Jones
Copy link
Contributor

@makortel we've been seeing the ppc related failure consistently. We really need access to a machine to attempt to debug what is happening.

@makortel
Copy link
Contributor

Oh, it was PPC, missed that, thanks. Nevermind then (in this issue).

@civanch
Copy link
Contributor

civanch commented Apr 25, 2021

+1

This is fixed now

@cmsbuild
Copy link
Contributor

This issue is fully signed and ready to be closed.

@silviodonato
Copy link
Contributor

#33568

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

7 participants