Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: increase dgram timeout for armv6 #2808

Closed
wants to merge 1 commit into from

Conversation

Trott
Copy link
Member

@Trott Trott commented Sep 11, 2015

test-dgram-broadcast-multi-process.js and
test-dgram-multicast-multi-process.js were failing on Pi 1 because the
test was timing out. Changed static 5000ms timeout to a dynamically
determined timeout based on the processor using
common.platformTimeout().

These tests aren't (yet) currently run on CI because they are in test/internet. But I altered the Makefile and had them run at https://ci.nodejs.org/job/node-test-commit-arm/593/

test-dgram-broadcast-multi-process.js and
test-dgram-multicast-multi-process.js were failing on Pi 1 because the
test was timing out. Changed static 5000ms timeout to a dynamically
determined timeout based on the processor using
common.platformTimeout().
@Trott
Copy link
Member Author

Trott commented Sep 11, 2015

Oh, and you can see the tests failing in prior CI here: https://ci.nodejs.org/job/node-test-commit-arm/591/

@ChALkeR ChALkeR added test Issues and PRs related to the tests. arm Issues and PRs related to the ARM platform. labels Sep 11, 2015
@silverwind
Copy link
Contributor

If the tests were passing before with 5s, I think doing 35s would be a bit too much. How about something like 2s which would still be 14s on that Pi.

@Trott
Copy link
Member Author

Trott commented Sep 11, 2015

The tests take about 11-13 seconds to run on the arm6 machines, so I'm not so sure 35 seconds is out of line if we're looking to have a timeout large enough that the test won't sometimes be flaky. Each test file has a 60 second timeout (unless that's increased for armv6, but I don't think it is), and for this test on armv6, I'd actually be OK giving it the full 60s before blowing up.

@Trott
Copy link
Member Author

Trott commented Sep 11, 2015

I don't think these tests were ever passing on Raspberry Pi 1 machines. We don't (yet) run these tests on CI. (I had to do modify the test-ci job in the Makefile to sort of trick the CI into running the test.) So they likely have always been failing on Raspberry Pi 1 machines.

@bnoordhuis
Copy link
Member

LGTM FWIW

@Fishrock123
Copy link
Member

35s seems a bit much, but, eh.
LGTM

@silverwind
Copy link
Contributor

@Trott: The 60s test timeout is actually increased to 180s for ARMv6, which might be a bit much actually, but otherwise, this is LGTM, thought a test that takes this long isn't really optimal.

@Trott
Copy link
Member Author

Trott commented Sep 11, 2015

If it makes anyone feel less conflicted, there are dozens of tests already in the suite that runs on CI that take as long or longer on the Raspberry Pi 1 devices than these tests take. Sometimes, they take far longer. test-pipe.js takes over 60 seconds (which should have tipped me off that the timeout was increased for armv6), taking as much as 95 seconds recently. test-cluster-disconnect.js takes around 50 seconds. It's entirely possible that there are optimizations to be made that could help these tests run faster. But a test at around 12 seconds isn't even in the top 20 problem tests for these devices.

I'm all for efforts to try to speed these tests up, of course.

Trott added a commit that referenced this pull request Sep 12, 2015
test-dgram-broadcast-multi-process.js and
test-dgram-multicast-multi-process.js were failing on Pi 1 because the
test was timing out. Changed static 5000ms timeout to a dynamically
determined timeout based on the processor using
common.platformTimeout().

PR-URL: #2808
Reviewed-By: Ben Noordhuis <info@bnoordhuis.nl>
Reviewed-By: Jeremiah Senkpiel <fishrock123@rocketmail.com>
Reviewed-By: Roman Reiss <me@silverwind.io>
@silverwind
Copy link
Contributor

Thanks, landed in bcc6d47 (just saw another test failure on this).

@silverwind silverwind closed this Sep 12, 2015
@Fishrock123 Fishrock123 mentioned this pull request Sep 13, 2015
7 tasks
Trott added a commit that referenced this pull request Sep 15, 2015
test-dgram-broadcast-multi-process.js and
test-dgram-multicast-multi-process.js were failing on Pi 1 because the
test was timing out. Changed static 5000ms timeout to a dynamically
determined timeout based on the processor using
common.platformTimeout().

PR-URL: #2808
Reviewed-By: Ben Noordhuis <info@bnoordhuis.nl>
Reviewed-By: Jeremiah Senkpiel <fishrock123@rocketmail.com>
Reviewed-By: Roman Reiss <me@silverwind.io>
Trott added a commit that referenced this pull request Sep 15, 2015
test-dgram-broadcast-multi-process.js and
test-dgram-multicast-multi-process.js were failing on Pi 1 because the
test was timing out. Changed static 5000ms timeout to a dynamically
determined timeout based on the processor using
common.platformTimeout().

PR-URL: #2808
Reviewed-By: Ben Noordhuis <info@bnoordhuis.nl>
Reviewed-By: Jeremiah Senkpiel <fishrock123@rocketmail.com>
Reviewed-By: Roman Reiss <me@silverwind.io>
@rvagg rvagg mentioned this pull request Sep 15, 2015
@rvagg rvagg mentioned this pull request Sep 22, 2015
@Trott Trott deleted the test-dgram-fixes branch January 9, 2022 22:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
arm Issues and PRs related to the ARM platform. test Issues and PRs related to the tests.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants