Skip to content

Conversation

SLTozer
Copy link
Contributor

@SLTozer SLTozer commented Aug 29, 2025

As part of the DebugifyBuilder, we add cflag arguments to the test suite build step containing the path of a report file, where any bugs detected by debugify will be written. Debugify appends to the file rather than replacing it, as we wish to accumulate the bugs found in all invocations of Clang during the test suite build step to a single file. Currently however, this file is not cleaned up after builds, meaning that we are constantly appending bugs to the same file after each test run, rather than creating a fresh file - this contaminates the results for future builds, as bugs will never disappear from the list even if they no longer exist in LLVM. This patch moves the report file into the test suite build directory, which will always be cleaned before each test run, preventing the results of one run from seeping into subsequent runs.

@SLTozer SLTozer requested review from dyung and kamaub August 29, 2025 14:36
@SLTozer SLTozer self-assigned this Aug 29, 2025
Copy link
Contributor

@DavidSpickett DavidSpickett left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have no context for the builder overall, I would look at the existing builder but the site is down at the moment. This seems logical in isolation though.

Assuming that this is the way it works:

  • test suite build dir is cleaned before each new run
  • debugify report is written into test suite build dir
  • a script is run on that report, which generates a further report, which is shown in the build results
  • the original report file can now be discarded, and will be, when the next run happens

Then this LGTM.

I just had to check that you weren't saving the original report as an artifact because if so, you're missing changing the location to save it from.

@SLTozer
Copy link
Contributor Author

SLTozer commented Sep 1, 2025

Assuming that this is the way it works:

Yes, that's exactly correct, thanks!

@SLTozer SLTozer merged commit 2b44506 into llvm:main Sep 1, 2025
3 checks passed
vvereschaka pushed a commit to vvereschaka/llvm-zorg that referenced this pull request Sep 25, 2025
As part of the DebugifyBuilder, we add cflag arguments to the test suite
build step containing the path of a report file, where any bugs detected
by debugify will be written. Debugify appends to the file rather than
replacing it, as we wish to accumulate the bugs found in all invocations
of Clang during the test suite build step to a single file. Currently
however, this file is not cleaned up after builds, meaning that we are
constantly appending bugs to the same file after each test run, rather
than creating a fresh file - this contaminates the results for future
builds, as bugs will never disappear from the list even if they no
longer exist in LLVM. This patch moves the report file into the test
suite build directory, which will always be cleaned before each test
run, preventing the results of one run from seeping into subsequent
runs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants