regrtest stops prematurately on FreeBSD buildbot, with "success" result.

[florentx]

BPO	8263
Nosy	@vstinner, @bitdancer, @voidspace, @skrah, @florentx

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2010-04-22.00:58:50.987>
created_at = <Date 2010-03-30.10:16:13.583>
labels = ['type-bug', 'tests']
title = 'regrtest stops prematurately on FreeBSD buildbot, with "success" result.'
updated_at = <Date 2010-04-22.00:58:50.985>
user = 'https://github.com/florentx'

bugs.python.org fields:

activity = <Date 2010-04-22.00:58:50.985>
actor = 'r.david.murray'
assignee = 'none'
closed = True
closed_date = <Date 2010-04-22.00:58:50.987>
closer = 'r.david.murray'
components = ['Tests']
creation = <Date 2010-03-30.10:16:13.583>
creator = 'flox'
dependencies = []
files = []
hgrepos = []
issue_num = 8263
keywords = ['patch', 'buildbot']
message_count = 11.0
messages = ['101926', '101927', '101936', '101937', '101938', '101947', '103390', '103452', '103454', '103747', '103935']
nosy_count = 5.0
nosy_names = ['vstinner', 'r.david.murray', 'michael.foord', 'skrah', 'flox']
pr_nums = []
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue8263'
versions = ['Python 2.7', 'Python 3.2']

[florentx]

The regrtest returns "success", even if the test suite is not run completely.
The last running test is "test_unittest".

http://www.python.org/dev/buildbot/all/builders/x86%20FreeBSD%20trunk/builds/171
...
51 tests OK.
2 tests skipped:
test_ascii_formatd test_py3kwarn
1 skip unexpected on freebsd6:
test_ascii_formatd
[294584 refs]
program finished with exit code 0
elapsedTime=1082.949696

http://www.python.org/dev/buildbot/all/builders/x86%20FreeBSD%20trunk/builds/168
...
37 tests OK.
5 tests skipped:
test_bsddb185 test_macostools test_py3kwarn test_startfile
test_winreg
1 skip unexpected on freebsd6:
test_bsddb185
[184731 refs]
program finished with exit code 0
elapsedTime=507.756584

[voidspace]

I wonder if unittest.test.test_break runs and the signals.SIGINT it sends terminates a process early? Do you have access to this platform to try it Florent?

[florentx]

Sorry, but I don't have such environment.

Proposed patch will add a notice if the regrtest is interrupted (Ctrl+C).
And the exitcode is set to 1, meaning test failed for the buildbot.

[voidspace]

That sounds very useful from a diagnostic point of view. If it does turn out to be the problem then we will have to disable the test for that platform. At the moment test_break runs on all platforms that have os.kill(...).

[florentx]

Slightly different, with a count of omitted tests
And removed "All .. tests OK" is there's some tests omitted.

[florentx]

Regrtest.py fixed with r79497 to report keyboard interrupt as a "failure".

[bitdancer]

I can reliably reproduce the SIGINT problem on a FreeBSD 6.3 box, if (and so far only if) some test that uses threading is run first (see also bpo-3864). So I suspect this is a freebsd6 specific problem and just needs a skip added.

[bitdancer]

The test_break unit test is now skipped for freebsd6 on trunk in r80155. I suspect this affects py3k as well on freebsd6.

[vstinner]

See also issue bpo-8432.

[skrah]

Confirmed on FreeBSD-6.4/py3k. Threading causes the problem, the skip
works here, too.

[bitdancer]

Skip committed to py3k in r80331.