Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Merged by Bors] - Add timeouts to GH actions workflow #2167

Closed
wants to merge 3 commits into from

Conversation

lrettig
Copy link
Member

@lrettig lrettig commented Oct 22, 2020

Motivation

I've noticed that these tests hang sometimes, this should make our lives a little easier by timing out tests if they're obviously hanging. I reviewed the times of the last few successful runs of each job and added a pretty large buffer in these timeouts. (see, e.g., https://github.com/spacemeshos/go-spacemesh/runs/1294892834?check_suite_focus=true)

Changes

Test Plan

N/A

Also, remove first slack notification, this is unnecessary since this
test is so quick
@lrettig lrettig added the CI label Oct 22, 2020
Copy link
Member

@noamnelke noamnelke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've noticed this, too. I'm wondering why they hang... Don't think we've seen this behaviour on Travis 🤔

I think that timing out is probably better than just hanging, but still pretty frustrating if we don't know why.

@lrettig
Copy link
Member Author

lrettig commented Oct 26, 2020

I've noticed this, too. I'm wondering why they hang... Don't think we've seen this behaviour on Travis 🤔

I think that timing out is probably better than just hanging, but still pretty frustrating if we don't know why.

Agree. Took another quick look just now and I'm not sure. Here are some recent timeouts:

All of these failed right after github.com/spacemeshos/go-spacemesh/events (likely github.com/spacemeshos/go-spacemesh/filesystem or github.com/spacemeshos/go-spacemesh/hare), or else right after github.com/spacemeshos/go-spacemesh/p2p/metrics (github.com/spacemeshos/go-spacemesh/miner?). Can't tell for sure what's going on without enabling verbose log output.

Let's merge this and investigate further if the timeouts continue.

@lrettig
Copy link
Member Author

lrettig commented Oct 26, 2020

bors merge

bors bot pushed a commit that referenced this pull request Oct 26, 2020
## Motivation

I've noticed that these tests hang sometimes, this should make our lives a little easier by timing out tests if they're obviously hanging. I reviewed the times of the last few successful runs of each job and added a pretty large buffer in these timeouts. (see, e.g., https://github.com/spacemeshos/go-spacemesh/runs/1294892834?check_suite_focus=true)

## Changes
- Adds `timeout-minutes` to each workflow job (per https://docs.github.com/en/free-pro-team@latest/actions/reference/workflow-syntax-for-github-actions#jobsjob_idstepstimeout-minutes)
- Removes initial slack notification, as it's redundant since this test is so quick anyway

## Test Plan
N/A
@bors
Copy link

bors bot commented Oct 26, 2020

Build failed:

  • systemtest-blocks-add-node
  • systemtest-genesis-p2p
  • systemtest-hare-mining
  • systemtest-latenodes
  • systemtest-sync-blocks

@lrettig
Copy link
Member Author

lrettig commented Oct 26, 2020

bors merge

bors bot pushed a commit that referenced this pull request Oct 26, 2020
## Motivation

I've noticed that these tests hang sometimes, this should make our lives a little easier by timing out tests if they're obviously hanging. I reviewed the times of the last few successful runs of each job and added a pretty large buffer in these timeouts. (see, e.g., https://github.com/spacemeshos/go-spacemesh/runs/1294892834?check_suite_focus=true)

## Changes
- Adds `timeout-minutes` to each workflow job (per https://docs.github.com/en/free-pro-team@latest/actions/reference/workflow-syntax-for-github-actions#jobsjob_idstepstimeout-minutes)
- Removes initial slack notification, as it's redundant since this test is so quick anyway

## Test Plan
N/A
@bors
Copy link

bors bot commented Oct 26, 2020

Pull request successfully merged into develop.

Build succeeded:

@bors bors bot changed the title Add timeouts to GH actions workflow [Merged by Bors] - Add timeouts to GH actions workflow Oct 26, 2020
@bors bors bot closed this Oct 26, 2020
@bors bors bot deleted the gh-actions-timeout branch October 26, 2020 13:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants