Skip to content

Commit

Permalink
[NFC][lit] Add a test showing that timing data for tests not executed…
Browse files Browse the repository at this point in the history
… is lost

I.e. when you first run lit on a directory, and then on a single test,
the timing knowledge about anything else other than that single test
is lost. This isn't right.
  • Loading branch information
LebedevRI committed Mar 22, 2021
1 parent ef4b3a4 commit b32fe2b
Show file tree
Hide file tree
Showing 3 changed files with 15 additions and 4 deletions.
1 change: 1 addition & 0 deletions llvm/utils/lit/tests/Inputs/reorder/.lit_test_times.txt
@@ -1,3 +1,4 @@
42.0 not-executed.txt
3.0 subdir/ccc.txt
2.0 bbb.txt
0.1 aaa.txt
1 change: 1 addition & 0 deletions llvm/utils/lit/tests/Inputs/reorder/new-test.txt
@@ -0,0 +1 @@
# RUN: true
17 changes: 13 additions & 4 deletions llvm/utils/lit/tests/reorder.py
@@ -1,13 +1,22 @@
## Check that we can reorder test runs.

# RUN: cp %{inputs}/reorder/.lit_test_times.txt %{inputs}/reorder/.lit_test_times.txt.orig
# RUN: %{lit} -j1 %{inputs}/reorder | FileCheck %s
# RUN: not diff %{inputs}/reorder/.lit_test_times.txt %{inputs}/reorder/.lit_test_times.txt.orig
# RUN: %{lit} -j1 %{inputs}/reorder > %t.out
# RUN: cp %{inputs}/reorder/.lit_test_times.txt %{inputs}/reorder/.lit_test_times.txt.new
# RUN: cp %{inputs}/reorder/.lit_test_times.txt.orig %{inputs}/reorder/.lit_test_times.txt
# RUN: not diff %{inputs}/reorder/.lit_test_times.txt.new %{inputs}/reorder/.lit_test_times.txt.orig
# RUN: FileCheck --check-prefix=TIMES --implicit-check-not=not-executed.txt < %{inputs}/reorder/.lit_test_times.txt.new %s
# RUN: FileCheck < %t.out %s
# END.

# CHECK: -- Testing: 3 tests, 1 workers --
# TIMES: subdir/ccc.txt
# TIMES-NEXT: bbb.txt
# TIMES-NEXT: aaa.txt
# TIMES-NEXT: new-test.txt

# CHECK: -- Testing: 4 tests, 1 workers --
# CHECK-NEXT: PASS: reorder :: subdir/ccc.txt
# CHECK-NEXT: PASS: reorder :: bbb.txt
# CHECK-NEXT: PASS: reorder :: aaa.txt
# CHECK: Passed: 3
# CHECK-NEXT: PASS: reorder :: new-test.txt
# CHECK: Passed: 4

0 comments on commit b32fe2b

Please sign in to comment.