Skip to content

Commit

Permalink
update latest SVF performance data
Browse files Browse the repository at this point in the history
  • Loading branch information
@yuleisui
yuleisui committed Feb 22, 2024
1 parent d4e08be commit d7e8d21
Show file tree
Hide file tree
Showing 2 changed files with 151 additions and 28 deletions.
56 changes: 28 additions & 28 deletions diff_tests/perf-latest.txt
View file
Original file line number Diff line number Diff line change
@@ -1,123 +1,123 @@
Start testing: Feb 22 08:09 UTC
Start testing: Feb 22 09:25 UTC
----------------------------------------------------------
1158/1364 Testing: diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc
1158/1364 Test: diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -vfspta -dump-vfg -dump-json=ir.json" "wpa -vfspta -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/dc.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc" start time: Feb 22 08:09 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc" start time: Feb 22 09:25 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -vfspta -dump-vfg -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/dc.bc
Executing command: ./wpa -vfspta -read-json ir.json
<end of output>
Test time = 0.88 sec
Test time = 1.00 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc" end time: Feb 22 08:09 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc" time elapsed: 00:00:00
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc" end time: Feb 22 09:25 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc" time elapsed: 00:00:01
----------------------------------------------------------

1159/1364 Testing: diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc
1159/1364 Test: diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -vfspta -dump-vfg -dump-json=ir.json" "wpa -vfspta -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bc.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc" start time: Feb 22 08:09 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc" start time: Feb 22 09:25 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -vfspta -dump-vfg -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bc.bc
Executing command: ./wpa -vfspta -read-json ir.json
<end of output>
Test time = 1.69 sec
Test time = 1.86 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc" end time: Feb 22 08:09 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc" end time: Feb 22 09:25 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc" time elapsed: 00:00:01
----------------------------------------------------------

1160/1364 Testing: diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc
1160/1364 Test: diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -vfspta -dump-vfg -dump-json=ir.json" "wpa -vfspta -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/libbz2.so.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc" start time: Feb 22 08:09 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc" start time: Feb 22 09:25 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -vfspta -dump-vfg -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/libbz2.so.bc
Executing command: ./wpa -vfspta -read-json ir.json
<end of output>
Test time = 2.36 sec
Test time = 2.62 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc" end time: Feb 22 08:09 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc" end time: Feb 22 09:25 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc" time elapsed: 00:00:02
----------------------------------------------------------

1161/1364 Testing: diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc
1161/1364 Test: diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -vfspta -dump-vfg -dump-json=ir.json" "wpa -vfspta -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bunzip2.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc" start time: Feb 22 08:09 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc" start time: Feb 22 09:25 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -vfspta -dump-vfg -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bunzip2.bc
Executing command: ./wpa -vfspta -read-json ir.json
<end of output>
Test time = 2.90 sec
Test time = 3.20 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc" end time: Feb 22 08:09 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc" time elapsed: 00:00:02
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc" end time: Feb 22 09:25 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc" time elapsed: 00:00:03
----------------------------------------------------------

1162/1364 Testing: diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc
1162/1364 Test: diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -vfspta -dump-vfg -dump-json=ir.json" "wpa -vfspta -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/htop.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc" start time: Feb 22 08:09 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc" start time: Feb 22 09:25 UTC
Output:
----------------------------------------------------------
vcall gep idx not constantint
Executing command: ./wpa -vfspta -dump-vfg -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/htop.bc
Executing command: ./wpa -vfspta -read-json ir.json
<end of output>
Test time = 9.41 sec
Test time = 11.00 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc" end time: Feb 22 08:09 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc" time elapsed: 00:00:09
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc" end time: Feb 22 09:26 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc" time elapsed: 00:00:11
----------------------------------------------------------

1163/1364 Testing: diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc
1163/1364 Test: diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -ander -dump-json=ir.json" "wpa -ander -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/libcurl.so.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc" start time: Feb 22 08:09 UTC
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc" start time: Feb 22 09:26 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -ander -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/libcurl.so.bc
Executing command: ./wpa -ander -read-json ir.json
<end of output>
Test time = 31.90 sec
Test time = 32.52 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc" end time: Feb 22 08:10 UTC
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc" time elapsed: 00:00:31
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc" end time: Feb 22 09:26 UTC
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc" time elapsed: 00:00:32
----------------------------------------------------------

1164/1364 Testing: diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc
1164/1364 Test: diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -ander -dump-json=ir.json" "wpa -ander -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bash.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc" start time: Feb 22 08:10 UTC
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc" start time: Feb 22 09:26 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -ander -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bash.bc
Executing command: ./wpa -ander -read-json ir.json
<end of output>
Test time = 39.15 sec
Test time = 42.49 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc" end time: Feb 22 08:10 UTC
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc" time elapsed: 00:00:39
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc" end time: Feb 22 09:27 UTC
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc" time elapsed: 00:00:42
----------------------------------------------------------

End testing: Feb 22 08:10 UTC
End testing: Feb 22 09:27 UTC
123 changes: 123 additions & 0 deletions diff_tests/perf_history/perf-2024-02-22T09:27:22.txt
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,123 @@
Start testing: Feb 22 09:25 UTC
----------------------------------------------------------
1158/1364 Testing: diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc
1158/1364 Test: diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -vfspta -dump-vfg -dump-json=ir.json" "wpa -vfspta -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/dc.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc" start time: Feb 22 09:25 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -vfspta -dump-vfg -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/dc.bc
Executing command: ./wpa -vfspta -read-json ir.json
<end of output>
Test time = 1.00 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc" end time: Feb 22 09:25 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/dc.bc" time elapsed: 00:00:01
----------------------------------------------------------

1159/1364 Testing: diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc
1159/1364 Test: diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -vfspta -dump-vfg -dump-json=ir.json" "wpa -vfspta -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bc.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc" start time: Feb 22 09:25 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -vfspta -dump-vfg -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bc.bc
Executing command: ./wpa -vfspta -read-json ir.json
<end of output>
Test time = 1.86 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc" end time: Feb 22 09:25 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bc.bc" time elapsed: 00:00:01
----------------------------------------------------------

1160/1364 Testing: diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc
1160/1364 Test: diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -vfspta -dump-vfg -dump-json=ir.json" "wpa -vfspta -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/libbz2.so.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc" start time: Feb 22 09:25 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -vfspta -dump-vfg -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/libbz2.so.bc
Executing command: ./wpa -vfspta -read-json ir.json
<end of output>
Test time = 2.62 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc" end time: Feb 22 09:25 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/libbz2.so.bc" time elapsed: 00:00:02
----------------------------------------------------------

1161/1364 Testing: diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc
1161/1364 Test: diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -vfspta -dump-vfg -dump-json=ir.json" "wpa -vfspta -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bunzip2.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc" start time: Feb 22 09:25 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -vfspta -dump-vfg -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bunzip2.bc
Executing command: ./wpa -vfspta -read-json ir.json
<end of output>
Test time = 3.20 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc" end time: Feb 22 09:25 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/bunzip2.bc" time elapsed: 00:00:03
----------------------------------------------------------

1162/1364 Testing: diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc
1162/1364 Test: diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -vfspta -dump-vfg -dump-json=ir.json" "wpa -vfspta -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/htop.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc" start time: Feb 22 09:25 UTC
Output:
----------------------------------------------------------
vcall gep idx not constantint
Executing command: ./wpa -vfspta -dump-vfg -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/htop.bc
Executing command: ./wpa -vfspta -read-json ir.json
<end of output>
Test time = 11.00 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc" end time: Feb 22 09:26 UTC
"diff-perf-cruxbc-small/test_cases_bc/crux-bc/htop.bc" time elapsed: 00:00:11
----------------------------------------------------------

1163/1364 Testing: diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc
1163/1364 Test: diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -ander -dump-json=ir.json" "wpa -ander -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/libcurl.so.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc" start time: Feb 22 09:26 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -ander -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/libcurl.so.bc
Executing command: ./wpa -ander -read-json ir.json
<end of output>
Test time = 32.52 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc" end time: Feb 22 09:26 UTC
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/libcurl.so.bc" time elapsed: 00:00:32
----------------------------------------------------------

1164/1364 Testing: diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc
1164/1364 Test: diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc
Command: "/home/runner/work/SVF/SVF/Test-Suite/diff_tests/difftest.py" "wpa -ander -dump-json=ir.json" "wpa -ander -read-json" "/home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bash.bc" "ir.json"
Directory: /home/runner/work/SVF/SVF/Release-build/bin
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc" start time: Feb 22 09:26 UTC
Output:
----------------------------------------------------------
Executing command: ./wpa -ander -dump-json=ir.json /home/runner/work/SVF/SVF/Test-Suite/test_cases_bc/crux-bc/bash.bc
Executing command: ./wpa -ander -read-json ir.json
<end of output>
Test time = 42.49 sec
----------------------------------------------------------
Test Passed.
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc" end time: Feb 22 09:27 UTC
"diff-perf-cruxbc-big/test_cases_bc/crux-bc/bash.bc" time elapsed: 00:00:42
----------------------------------------------------------

End testing: Feb 22 09:27 UTC

0 comments on commit d7e8d21

Please sign in to comment.