Skip to content

Commit

Permalink
[lit] Try to fix c981c53 test fails under windows
Browse files Browse the repository at this point in the history
Failures were seen at
<https://lab.llvm.org/buildbot/#/builders/216/builds/26431>.

All but one failure is due to different shell-quoting of file names
because they contain special characters under windows.  Generalize
associated FileCheck patterns.

`llvm/utils/lit/tests/shtest-output-printing.py` fails because the
exit code was 127 instead of the expected 1.  Unfortunately, this CI
config doesn't pass `-dump-input-filter=all` to FileCheck, so we
cannot see the rest of the lit execution trace.  For now, generalize
the FileCheck pattern to accept any non-zero exit code to get past
this error.
  • Loading branch information
jdenny-ornl committed Aug 29, 2023
1 parent b291182 commit f254bbf
Show file tree
Hide file tree
Showing 4 changed files with 13 additions and 13 deletions.
2 changes: 1 addition & 1 deletion llvm/utils/lit/tests/shtest-env.py
Original file line number Diff line number Diff line change
Expand Up @@ -85,7 +85,7 @@

# CHECK: FAIL: shtest-env :: env-calls-not-builtin.txt ({{[^)]*}})
# CHECK: env -u FOO BAR=3 not rm {{.+}}.no-such-file
# CHECK: # executed command: env -u FOO BAR=3 not rm {{.+}}.no-such-file
# CHECK: # executed command: env -u FOO BAR=3 not rm {{.+}}.no-such-file{{.+}}
# CHECK: # | Error: 'env' cannot call 'rm'
# CHECK: # error: command failed with exit status: {{.*}}

Expand Down
2 changes: 1 addition & 1 deletion llvm/utils/lit/tests/shtest-not.py
Original file line number Diff line number Diff line change
Expand Up @@ -106,7 +106,7 @@

# CHECK: FAIL: shtest-not :: not-calls-env-builtin.txt {{.*}}
# CHECK: not --crash env -u FOO BAR=3 rm {{.*}}.no-such-file
# CHECK: # executed command: not --crash env -u FOO BAR=3 rm {{.*}}.no-such-file
# CHECK: # executed command: not --crash env -u FOO BAR=3 rm {{.+}}.no-such-file{{.+}}
# CHECK: # | Error: 'env' cannot call 'rm'
# CHECK: # error: command failed with exit status: {{.*}}

Expand Down
2 changes: 1 addition & 1 deletion llvm/utils/lit/tests/shtest-output-printing.py
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
# CHECK: -- Testing: {{.*}}
# CHECK: FAIL: shtest-output-printing :: basic.txt {{.*}}
# CHECK-NEXT: ***{{\**}} TEST 'shtest-output-printing :: basic.txt' FAILED ***{{\**}}
# CHECK-NEXT: Exit Code: 1
# CHECK-NEXT: Exit Code: {{[1-9][0-9]*}}
# CHECK-EMPTY:
# CHECK-NEXT: Command Output (stdout):
# CHECK-NEXT: --
Expand Down
20 changes: 10 additions & 10 deletions llvm/utils/lit/tests/shtest-shell.py
Original file line number Diff line number Diff line change
Expand Up @@ -238,7 +238,7 @@
# CHECK-NOT: error

# CHECK: diff -u {{.*}}.foo {{.*}}.bar | FileCheck {{.*}} && false || true
# CHECK-NEXT: # executed command: diff -u {{.*}}.foo {{.*}}.bar
# CHECK-NEXT: # executed command: diff -u {{.+}}.foo{{.+}} {{.+}}.bar{{.+}}
# CHECK-NEXT: # note: command had no output on stdout or stderr
# CHECK-NEXT: # error: command failed with exit status: 1
# CHECK-NEXT: # executed command: FileCheck
Expand All @@ -253,8 +253,8 @@
# CHECK-NOT: error

# CHECK: cat {{.*}}.bar | diff -u {{.*}}.foo - && false || true
# CHECK-NEXT: # executed command: cat {{.*}}.bar
# CHECK-NEXT: # executed command: diff -u {{.*}}.foo -
# CHECK-NEXT: # executed command: cat {{.+}}.bar{{.+}}
# CHECK-NEXT: # executed command: diff -u {{.+}}.foo{{.+}} -
# CHECK-NEXT: # .---command stdout{{-*}}
# CHECK: # | @@
# CHECK-NEXT: # | -foo
Expand All @@ -264,8 +264,8 @@
# CHECK-NEXT: # executed command: true

# CHECK: cat {{.*}}.bar | diff -u - {{.*}}.foo && false || true
# CHECK-NEXT: # executed command: cat {{.*}}.bar
# CHECK-NEXT: # executed command: diff -u - {{.*}}.foo
# CHECK-NEXT: # executed command: cat {{.+}}.bar{{.+}}
# CHECK-NEXT: # executed command: diff -u - {{.+}}.foo{{.+}}
# CHECK-NEXT: # .---command stdout{{-*}}
# CHECK: # | @@
# CHECK-NEXT: # | -bar
Expand All @@ -279,8 +279,8 @@
# CHECK-NOT: error

# CHECK: cat {{.*}}.bar | diff -u {{.*}}.foo - | FileCheck {{.*}}
# CHECK-NEXT: # executed command: cat {{.*}}.bar
# CHECK-NEXT: # executed command: diff -u {{.*}}.foo -
# CHECK-NEXT: # executed command: cat {{.+}}.bar{{.+}}
# CHECK-NEXT: # executed command: diff -u {{.+}}.foo{{.+}} -
# CHECK-NEXT: note: command had no output on stdout or stderr
# CHECK-NEXT: error: command failed with exit status: 1
# CHECK-NEXT: # executed command: FileCheck
Expand Down Expand Up @@ -427,7 +427,7 @@
# CHECK: *** TEST 'shtest-shell :: diff-unified.txt' FAILED ***

# CHECK: diff -u {{.*}}.foo {{.*}}.bar && false || true
# CHECK-NEXT: # executed command: diff -u {{.*}}.foo {{.*}}.bar
# CHECK-NEXT: # executed command: diff -u {{.+}}.foo{{.+}} {{.+}}.bar{{.+}}
# CHECK-NEXT: # .---command stdout{{-*}}
# CHECK: # | @@ {{.*}} @@
# CHECK-NEXT: # | 3
Expand All @@ -443,7 +443,7 @@
# CHECK-NEXT: # executed command: true

# CHECK: diff -U 2 {{.*}}.foo {{.*}}.bar && false || true
# CHECK-NEXT: # executed command: diff -U 2 {{.*}}.foo {{.*}}.bar
# CHECK-NEXT: # executed command: diff -U 2 {{.+}}.foo{{.+}} {{.+}}.bar{{.+}}
# CHECK-NEXT: # .---command stdout{{-*}}
# CHECK: # | @@ {{.*}} @@
# CHECK-NEXT: # | 4
Expand All @@ -457,7 +457,7 @@
# CHECK-NEXT: # executed command: true

# CHECK: diff -U4 {{.*}}.foo {{.*}}.bar && false || true
# CHECK-NEXT: # executed command: diff -U4 {{.*}}.foo {{.*}}.bar
# CHECK-NEXT: # executed command: diff -U4 {{.+}}.foo{{.+}} {{.+}}.bar{{.+}}
# CHECK-NEXT: # .---command stdout{{-*}}
# CHECK: # | @@ {{.*}} @@
# CHECK-NEXT: # | 2
Expand Down

0 comments on commit f254bbf

Please sign in to comment.