Test test_with_dwarf (TestCallStdStringFunction.ExprCommandCallFunctionTestCase) fails on FreeBSD Buildbot

[emaste]

Bugzilla Link	17807
Version	unspecified
OS	All

Extended Description

This doesn't fail when I run the test locally, but consistently does on the buildbot.

Creating this PR to keep track of it.
Might be a duplicate of PR llvm.org/pr14437 on Linux, which claims to be a GCC issue.

Buildbot run:

http://llvm-amd64.freebsd.your.org:8010/builders/lldb-amd64-freebsd/builds/1544

Error log:

http://llvm-amd64.freebsd.your.org:8010/builders/lldb-amd64-freebsd/builds/1544/steps/check-lldb.1/logs/stdio

Error:

2: test_with_dwarf (TestCallStdStringFunction.ExprCommandCallFunctionTestCase)
Test calling std::String member function. ... FAILURE

======================================================================
FAIL: test_with_dwarf
(TestCallStdStringFunction.ExprCommandCallFunctionTestCase)
Test calling std::String member function.

Traceback (most recent call last):
File "/data/buildslave/lldb-amd64-freebsd/src-llvm/tools/lldb/test/lldbtest.py",
line 370, in wrapper
return func(self, *args, **kwargs)
File "/data/buildslave/lldb-amd64-freebsd/src-llvm/tools/lldb/test/lldbtest.py",
line 401, in expectedFailureGcc_easy_wrapper
bugnumber(*args, **kwargs)
File "/data/buildslave/lldb-amd64-freebsd/src-llvm/tools/lldb/test/lldbtest.py",
line 473, in expectedFailureIcc_easy_wrapper
bugnumber(*args, **kwargs)
File "/data/buildslave/lldb-amd64-freebsd/src-llvm/tools/lldb/test/expression_command/call-function/TestCallStdStringFunction.py",
line 34, in test_with_dwarf
self.call_function()
File "/data/buildslave/lldb-amd64-freebsd/src-llvm/tools/lldb/test/expression_command/call-function/TestCallStdStringFunction.py",
line 55, in call_function
substrs = ['Hello world'])
File "/data/buildslave/lldb-amd64-freebsd/src-llvm/tools/lldb/test/lldbtest.py",
line 1892, in expect
self.runCmd(str, msg=msg, trace = (True if trace else False),
check = not error, inHistory=inHistory)
File "/data/buildslave/lldb-amd64-freebsd/src-llvm/tools/lldb/test/lldbtest.py",
line 1818, in runCmd
msg if msg else CMD_MSG(cmd))
AssertionError: False is not True : Command 'print str.c_str()'
returns successfully
Config=amd64-clang

Ran 2 tests in 5.228s

FAILED (failures=1, skipped=1)

[emaste]

assigned to @emaste

[emaste]

Still failing on the buildbot

[emaste]

This test is still passing for me locally and the buildbot has been retired. Need to investigate again once the new buildbot is in place.

[llvmbot]

This test is failing 100% of the time ( -r247709 & r248089 ) similar to the original problem report.

FAIL: test_with_dwarf (TestCallStdStringFunction.ExprCommandCallFunctionTestCase)
Test calling std::String member function.

Traceback (most recent call last):
File "/usr/home/jlw/LLDB/llvm-150919.wrk/tools/lldb/test/lldbtest.py", line 551, in wrapper
return func(self, *args, **kwargs)
File "/usr/home/jlw/LLDB/llvm-150919.wrk/tools/lldb/test/lldbtest.py", line 615, in wrapper
func(*args, **kwargs)
File "/usr/home/jlw/LLDB/llvm-150919.wrk/tools/lldb/test/lldbtest.py", line 615, in wrapper
func(*args, **kwargs)
File "/usr/home/jlw/LLDB/llvm-150919.wrk/tools/lldb/test/expression_command/call-function/TestCallStdStringFunction.py", line 35, in test_with_dwarf
self.call_function()
File "/usr/home/jlw/LLDB/llvm-150919.wrk/tools/lldb/test/expression_command/call-function/TestCallStdStringFunction.py", line 52, in call_function
substrs = ['Hello world'])
File "/usr/home/jlw/LLDB/llvm-150919.wrk/tools/lldb/test/lldbtest.py", line 2616, in expect
self.runCmd(str, msg=msg, trace = (True if trace else False), check = not error, inHistory=inHistory)
File "/usr/home/jlw/LLDB/llvm-150919.wrk/tools/lldb/test/lldbtest.py", line 2542, in runCmd
msg if msg else CMD_MSG(cmd))
AssertionError: False is not True : Command 'print str.c_str()' returns successfully
Config=x86_64-clang

[emaste]

Interesting -- this test passes for me, on FreeBSD 10.2

[emaste]

This passes for me on FreeBSD 10 and on the WIP FreeBSD 11 buildbot. John, are you able to run this test with verbose logging on?

[llvmbot]

Log file from arm-linux buildbot

[emaste]

FreeBSD decorator removed in r310626

[emaste]

FreeBSD xfail removed from the lit version of this test in r325856

[emaste]

Unsure if this test is still present

[emaste]

Oops, typo in my commandline. This passes consistently when run locally as
$ bin/lldb-dotest -p TestCallStdStringFunction

Will check on the status once the buildbot is restored