Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

test_average is slow in FlexCI #8303

Merged
merged 1 commit into from Oct 18, 2019
Merged

test_average is slow in FlexCI #8303

merged 1 commit into from Oct 18, 2019

Conversation

toslunar
Copy link
Member

#7670 roughly doubled the number of testcases in test_average and #8211 disabled pairwise testing in FlexCI.

I found the failure in https://ci.preferred.jp/chainer.py27and35.gpu/35308/

2019-10-17 16:01:32.581641 STDOUT 2318] 	[SUCCESS] /chainer/tests/chainer_tests/training_tests/updaters_tests/test_standard_updater.py (221 passed, 37 deselected in 4.18 seconds)
2019-10-17 16:01:32.628795 STDOUT 2318] 	[TIMEOUT] /chainer/tests/chainer_tests/functions_tests/math_tests/test_average.py (60 seconds)
2019-10-17 16:01:32.628820 STDERR 2318] 	[DEBUG] failed to wait a command: python3.5 -m pytest -m not slow and (gpu or cudnn or cuda) /chainer/tests/chainer_tests/functions_tests/math_tests/test_average.py: signal: killed
2019-10-17 16:01:32.628801 STDOUT 2318] 	============================= test session starts ==============================
2019-10-17 16:01:32.628803 STDOUT 2318] 	platform linux -- Python 3.5.2, pytest-4.1.1, py-1.8.0, pluggy-0.13.0
2019-10-17 16:01:32.628804 STDOUT 2318] 	rootdir: /chainer, inifile: setup.cfg
2019-10-17 16:01:32.628810 STDOUT 2318] 	plugins: xdist-1.26.1, forked-1.0.2
2019-10-17 16:01:32.628811 STDOUT 2318] 	collected 3717 items / 1413 deselected
2019-10-17 16:01:32.628813 STDOUT 2318] 	
2019-10-17 16:01:32.628814 STDOUT 2318] 	chainer/tests/chainer_tests/functions_tests/math_tests/test_average.py . [  0%]
2019-10-17 16:01:32.628815 STDOUT 2318] 	s..s..s..s..s.ssssss.s..s..s..s..s..s..s.sss.s..s..s..s.sss.s..s..s..s.. [  3%]
2019-10-17 16:01:32.628818 STDOUT 2318] 	s..s..s..s..s..s..s..s..s..s..s.sss.s.sss.s..s..s..s..s..s..s..s..s..s.. [  6%]
2019-10-17 16:01:32.628820 STDOUT 2318] 	s..s..s..s..s..s..s.sss.s..s..s..s..s..s..s..s..s..s.sss.s..s.ssssss.s.. [  9%]
2019-10-17 16:01:32.628821 STDOUT 2318] 	s.sss.s..s..s..s..s.sss.s..s..s.sss.s..s..s..s..s..s..s..s.sss.s..s..s.. [ 12%]
2019-10-17 16:01:32.628822 STDOUT 2318] 	s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s.. [ 15%]
2019-10-17 16:01:32.628823 STDOUT 2318] 	s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s.. [ 18%]
2019-10-17 16:01:32.628824 STDOUT 2318] 	s..s..s..s.sss.s..s..s..s..s.sss.s..s..s..s.sss.s.sss.s..s..s..s..s..s.s [ 21%]
2019-10-17 16:01:32.628825 STDOUT 2318] 	ss.s..s..s..s..s..s..s..s..s.sss.s..s..s..s..s..s..s..s.sss.s.sss.s..s.. [ 25%]
2019-10-17 16:01:32.628829 STDOUT 2318] 	s.sss.s..s..s..s..s.ssssss.s..s..s..s..s..s..s.sss.s..s..s..s..s..s.sss. [ 28%]
2019-10-17 16:01:32.628830 STDOUT 2318] 	s..s..s..s.sss.s..s.sss.s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s.s [ 31%]
2019-10-17 16:01:32.629103 STDOUT 2318] 	ss.s..s.sss.s.sss.s..s.sss.s..s..s..s.sss.s..s..s..s..s.sss.s..s..s..s.. [ 34%]
2019-10-17 16:01:32.629104 STDOUT 2318] 	s..s..s.sss.s.sss.s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s.. [ 37%]
2019-10-17 16:01:32.629105 STDOUT 2318] 	s..s..s..s..s..s..s..s.sss.s..s..s..s..s..s..s.sss.s.sss.s..s..s..s..s.. [ 40%]
2019-10-17 16:01:32.629106 STDOUT 2318] 	s..s..s..s..s..s..s..s..s..s..s..s..s.sss.s..s..s..s..s..s..s..s..s..s.. [ 43%]
2019-10-17 16:01:32.629106 STDOUT 2318] 	s..s.sss.s..s..s.sss.s..s.ssssss.s..s..s..s..s..s..s.sss.s..s..s..s..s.. [ 46%]
2019-10-17 16:01:32.629107 STDOUT 2318] 	s..s..s..s.sss.s..s..s..s..s.sss.s..s..s..s.sss.s..s..s..s..s..s..s..s.. [ 50%]
2019-10-17 16:01:32.629108 STDOUT 2318] 	s..s..s..s..s..s..s..s..s..s..s..s..s.ssssss.s..s..s..s..s..s..s.sss.s.. [ 53%]
2019-10-17 16:01:32.629109 STDOUT 2318] 	s..s.sss.s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s.sss.s..s..s..s.s [ 56%]
2019-10-17 16:01:32.629126 STDOUT 2318] 	ss.s..s..s..s.sss.s..s..s..s.sss.s..s..s..s..s..s..s..s..s..s..s..s.sss. [ 59%]
2019-10-17 16:01:32.629126 STDOUT 2318] 	s..s..s..s..s..s..s..s..s..s..s..s..s..s..s.sss.s..s..s.sss.s..s..s..s.s [ 62%]
2019-10-17 16:01:32.629127 STDOUT 2318] 	ss.s..s..s..s..s..s..s..s..s.sss.s.sss.s..s..s..s..s..s..s..s..s..s..s.. [ 65%]
2019-10-17 16:01:32.629128 STDOUT 2318] 	s..s..s.sss.s..s..s..s..s..s..s..s.sss.s..s..s..s.sss.s..s..s..s..s..s.. [ 68%]
2019-10-17 16:01:32.629129 STDOUT 2318] 	s..s..s..s..s.sss.s..s..s..s..s..s..s..s.sss.s..s..s..s..s..s.sss.s..s.. [ 71%]
2019-10-17 16:01:32.629223 STDOUT 2318] 	s..s..s..s..s..s.sss.s.sss.s..s..s..s..s.sss.s..s..s..s..s..s..s..s..s.. [ 75%]
2019-10-17 16:01:32.629224 STDOUT 2318] 	s..s..s..s..s..s..s..s..s..s..s..s.sss.s..s..s..s..s.sss.s..s..s..s..s.. [ 78%]
2019-10-17 16:01:32.629224 STDOUT 2318] 	s..s..s..s..s.sss.s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s.. [ 81%]
2019-10-17 16:01:32.629225 STDOUT 2318] 	s..s..s.sss.s.sss.s..s..s..s..s..s..s..s..s..s..s..s..s..s.sss.s..s..s.s [ 84%]
2019-10-17 16:01:32.629226 STDOUT 2318] 	ss.s..s..s..s..s..s..s..s..s..s..s..s..s..s.sss.s..s..s..s..s..s..s..s.. [ 87%]
2019-10-17 16:01:32.629227 STDOUT 2318] 	s.sss.s..s..s..s..s..s..s..s..s.ssssss.s..s.sss.s.sss.s..s..s.sss.s..s.. [ 90%]
2019-10-17 16:01:32.629228 STDOUT 2318] 	s.ssssss.s..s.ssssss.s..s..s..s.sss.s..s..s..s..s..s..s..s..s..s..s..s.. [ 93%]
2019-10-17 16:01:32.629228 STDOUT 2318] 	s..s..s..s..s.sss.s.sss.s..s..s..s..s..s.sss.s..s..s.sss.s..s..s..s..s.. [ 96%]
2019-10-17 16:01:32.629229 STDOUT 2318] 	s..s..s..s..s..s..s..s..s..s..s..s..s..s..s..s.sss.s..s..s..s..s..s..s.  [100%]
2019-10-17 16:01:32.629230 STDOUT 2318] 	
2019-10-17 16:01:32.629231 STDOUT 2318] 	========== 1344 passed, 960 skipped, 1413 deselected in 58.50 seconds ==========
2019-10-17 16:01:34.923656 STDOUT 2318] 	[SUCCESS] /chainer/tests/chainer_tests/functions_tests/rnn_tests/test_function_lstm.py (438 passed, 282 deselected in 42.77 seconds)
2019-10-17 16:01:49.897633 STDERR 2318] 	[DEBUG] flushing reporter...
2019-10-17 16:01:49.897649 STDOUT 2318] 	[SUCCESS] /chainer/tests/chainer_tests/functions_tests/rnn_tests/test_function_slstm.py (975 passed, 492 deselected in 55.11 seconds)
2019-10-17 16:01:49.897654 STDOUT 2318] 	
2019-10-17 16:01:49.897655 STDOUT 2318] 	============================ FAILED TESTS ============================
2019-10-17 16:01:49.897656 STDOUT 2318] 	[TIMEOUT] /chainer/tests/chainer_tests/functions_tests/math_tests/test_average.py (60 seconds)
2019-10-17 16:01:49.897658 STDOUT 2318] 	
2019-10-17 16:01:49.897659 STDOUT 2318] 	============================ TEST SUMMARY ============================
2019-10-17 16:01:49.897660 STDOUT 2318] 	1 failed, 0 flaky, 356 passed
2019-10-17 16:01:51.257238 STDOUT 2318] 	Overall status: FAILED
2019-10-17 16:01:51.260355 STDERR 2318] 	+ py35_test_status=1
2019-10-17 16:01:51.260359 STDERR 2318] 	+ echo py35_test_status=1
2019-10-17 16:01:51.260382 STDOUT 2318] 	py35_test_status=1
2019-10-17 16:01:51.260362 STDERR 2318] 	+ exit 1
2019-10-17 16:01:51.773119 STDOUT 2318] 	[EOF]
2019-10-17 16:01:51.773120 STDERR 2318] 	[EOF]

@toslunar toslunar added the cat:test Test or CI related. label Oct 17, 2019
@kmaehashi
Copy link
Member

pfnCI, test this please.

@kmaehashi kmaehashi added the to-be-backported Pull request that should be backported. label Oct 18, 2019
@kmaehashi kmaehashi added this to the v7.0.0rc1 milestone Oct 18, 2019
@kmaehashi kmaehashi added the st:test-and-merge State indicating that pull request is approved by a reviewer and can be merged after CI passes. label Oct 18, 2019
@toslunar
Copy link
Member Author

I suppose the PR does not have to be backported because #7670 is v7-only.

@chainer-ci
Copy link
Member

Jenkins CI test (for commit 3b9929d, target branch master) failed with status FAILURE.

@kmaehashi kmaehashi removed the to-be-backported Pull request that should be backported. label Oct 18, 2019
@kmaehashi
Copy link
Member

kmaehashi commented Oct 18, 2019 •
edited

I suppose the PR does not have to be backported because #7670 is v7-only.

I see, that makes sense.

@kmaehashi
Copy link
Member

LGTM, test failures are not related to this PR.

@kmaehashi kmaehashi merged commit 2975497 into chainer:master Oct 18, 2019
@toslunar toslunar deleted the pfnci-f-average branch October 18, 2019 11:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@kmaehashi kmaehashi

Labels
cat:test Test or CI related. st:test-and-merge State indicating that pull request is approved by a reviewer and can be merged after CI passes.
Projects
None yet
Milestone
v7.0.0rc1
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@toslunar @kmaehashi @chainer-ci