Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[lit] Allow passing extra commands to executeShTest
This allows creating custom test formats on top of `executeShTest` that inject commands at the beginning of the file being parsed, without requiring these commands to physically appear in the test file itself. For example, one could define a test format that prints out additional debug information at the beginning of each test. More realistically, this has been used to define custom test formats like one that supports compilation failure tests (e.g. with the extension `compile.fail.cpp`) by injecting a command that calls the compiler on the file itself and expects it to fail. Without this change, the only alternative is to create a temporary file with the same content as the original test, then prepend the desired `// RUN:` lines to that file, and call `executeShTest` on that file instead. This is both slow and cumbersome to do. Differential Revision: https://reviews.llvm.org/D76290
- Loading branch information
Showing
6 changed files
with
89 additions
and
4 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,17 @@ | ||
import lit | ||
|
||
class CustomFormat(lit.formats.TestFormat): | ||
def execute(self, test, litConfig): | ||
commands = [ | ||
'echo "THIS WAS"', | ||
'echo "INJECTED"' | ||
] | ||
return lit.TestRunner.executeShTest(test, litConfig, | ||
useExternalSh=False, | ||
preamble_commands=commands) | ||
|
||
config.name = 'shtest-inject' | ||
config.suffixes = ['.txt'] | ||
config.test_format = CustomFormat() | ||
config.test_source_root = None | ||
config.test_exec_root = None |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,3 @@ | ||
|
||
# This test voluntarily has no RUN lines or anything else. The RUN lines are | ||
# injected by the test format. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,7 @@ | ||
|
||
# This test has several RUN lines, but more run lines are prepended to it by | ||
# the test format in use. | ||
|
||
# RUN: echo "IN THE FILE" | ||
# RUN: echo "IF IT WORKS" | ||
# RUN: echo "AS EXPECTED" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
|
||
# This test has one RUN line, but more run lines are prepended to it by the | ||
# test format in use. | ||
|
||
# RUN: echo "IN THE FILE" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,49 @@ | ||
# Check that we can inject commands at the beginning of a ShTest using a custom | ||
# test format. | ||
|
||
# RUN: %{lit} -j 1 %{inputs}/shtest-inject/test-empty.txt --show-all | FileCheck --check-prefix=CHECK-TEST1 %s | ||
# | ||
# CHECK-TEST1: Script: | ||
# CHECK-TEST1: -- | ||
# CHECK-TEST1: echo "THIS WAS" | ||
# CHECK-TEST1: echo "INJECTED" | ||
# CHECK-TEST1: -- | ||
# | ||
# CHECK-TEST1: THIS WAS | ||
# CHECK-TEST1: INJECTED | ||
# | ||
# CHECK-TEST1: Expected Passes : 1 | ||
|
||
# RUN: %{lit} -j 1 %{inputs}/shtest-inject/test-one.txt --show-all | FileCheck --check-prefix=CHECK-TEST2 %s | ||
# | ||
# CHECK-TEST2: Script: | ||
# CHECK-TEST2: -- | ||
# CHECK-TEST2: echo "THIS WAS" | ||
# CHECK-TEST2: echo "INJECTED" | ||
# CHECK-TEST2: echo "IN THE FILE" | ||
# CHECK-TEST2: -- | ||
# | ||
# CHECK-TEST2: THIS WAS | ||
# CHECK-TEST2: INJECTED | ||
# CHECK-TEST2: IN THE FILE | ||
# | ||
# CHECK-TEST2: Expected Passes : 1 | ||
|
||
# RUN: %{lit} -j 1 %{inputs}/shtest-inject/test-many.txt --show-all | FileCheck --check-prefix=CHECK-TEST3 %s | ||
# | ||
# CHECK-TEST3: Script: | ||
# CHECK-TEST3: -- | ||
# CHECK-TEST3: echo "THIS WAS" | ||
# CHECK-TEST3: echo "INJECTED" | ||
# CHECK-TEST3: echo "IN THE FILE" | ||
# CHECK-TEST3: echo "IF IT WORKS" | ||
# CHECK-TEST3: echo "AS EXPECTED" | ||
# CHECK-TEST3: -- | ||
# | ||
# CHECK-TEST3: THIS WAS | ||
# CHECK-TEST3: INJECTED | ||
# CHECK-TEST3: IN THE FILE | ||
# CHECK-TEST3: IF IT WORKS | ||
# CHECK-TEST3: AS EXPECTED | ||
# | ||
# CHECK-TEST3: Expected Passes : 1 |