Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jenkins: build timeouts #3157

Open
mpranj opened this issue Nov 4, 2019 · 2 comments
Assignees

Comments

@mpranj
Copy link
Member

@mpranj mpranj commented Nov 4, 2019

The following build message occurred in multiple PRs I have seen (e.g. #3150):

Sending interrupt signal to process

Terminated

It seems that we are increasingly hitting the 10 minute Jenkins limit (when a build has no log output for 10 minutes).

timeout(activity: true, time: 10, unit: 'MINUTES') {

I'm not sure it will help to increase the limit, as some of the killed jobs show that they are running for 5+ hours. We can try to increase the limit and see whether we are only exceeding it by very little. Otherwise I think we will need to evaluate what's causing the builds to take forever and work on a better solution.

The fact that many builds are currently failing (and being re-built) because of problems with our Jenkins ironically puts even more load on the systems, so the effect seems to amplify.

@markus2330

This comment has been minimized.

Copy link
Contributor

@markus2330 markus2330 commented Nov 4, 2019

Thank you for creating this issue!

@Mistreated can you try to change the timeout?

mpranj added a commit to mpranj/libelektra that referenced this issue Nov 5, 2019
@mpranj

This comment has been minimized.

Copy link
Member Author

@mpranj mpranj commented Nov 5, 2019

I took the liberty to test/increase the timeout in my PR, as it keeps hitting this limit. Seems like it is usually a build on a7 (which is slower) and I have not yet seen it on v2 (which is presumably faster).

@mpranj mpranj referenced this issue Nov 5, 2019
5 of 16 tasks complete
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants
You can’t perform that action at this time.