Skip to content

consistent functionality test failures on ubuntu-latest #179

@andrurogerz

Description

@andrurogerz

Since nightly build/test run #161 , the Test Linux x86_64 functionalities and Test Android x86_64 functionalities jobs have been failing. The timing of the failures coincides exactly with the move of ubuntu-latest to run on Ubuntu 24.04.1 LTS when they were previously running on Ubuntu 22.04.5 LTS.

There are two new test cases that fail consistently in both of these jobs: TestDataFormatterSynthVal.DataFormatterSynthValueTestCase.test_with_run_command_dwarf and TestDataFormatterSynthVal.DataFormatterSynthValueTestCase.test_with_run_command_dwo. These are two variants of the same test case.

Example failure log:

======================================================================
FAIL: test_with_run_command_dwarf (TestDataFormatterSynthVal.DataFormatterSynthValueTestCase.test_with_run_command_dwarf)
      Test using Python synthetic children provider to provide a value.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/runner/work/ds2/ds2/SourceCache/llvm/lldb/packages/Python/lldbsuite/test/lldbtest.py", line 1769, in test_method
    return attrvalue(self)
           ^^^^^^^^^^^^^^^
  File "/home/runner/work/ds2/ds2/SourceCache/llvm/lldb/test/API/functionalities/data-formatter/data-formatter-synthval/TestDataFormatterSynthVal.py", line 85, in test_with_run_command
    self.assertEqual(x_val(), 3, "x != 3 after synthetics")
AssertionError: 0 != 3 : x != 3 after synthetics
Config=x86_64-/usr/local/lib/android/sdk/ndk/27.2.12479018/toolchains/llvm/prebuilt/linux-x86_64/bin/x86_64-linux-android28-clang
======================================================================
FAIL: test_with_run_command_dwo (TestDataFormatterSynthVal.DataFormatterSynthValueTestCase.test_with_run_command_dwo)
      Test using Python synthetic children provider to provide a value.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/runner/work/ds2/ds2/SourceCache/llvm/lldb/packages/Python/lldbsuite/test/lldbtest.py", line 1769, in test_method
    return attrvalue(self)
           ^^^^^^^^^^^^^^^
  File "/home/runner/work/ds2/ds2/SourceCache/llvm/lldb/test/API/functionalities/data-formatter/data-formatter-synthval/TestDataFormatterSynthVal.py", line 85, in test_with_run_command
    self.assertEqual(x_val(), 3, "x != 3 after synthetics")
AssertionError: 0 != 3 : x != 3 after synthetics
Config=x86_64-/usr/local/lib/android/sdk/ndk/27.2.12479018/toolchains/llvm/prebuilt/linux-x86_64/bin/x86_64-linux-android28-clang
----------------------------------------------------------------------
Ran 1692 tests in 405.195s

FAILED (failures=2, skipped=904, expected failures=24)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions