Skip to content

Commit

Permalink
Update benchmark.yml
Browse files Browse the repository at this point in the history 
Attempt to fix Windows and other builds
  • Loading branch information
@zeux
zeux committed Jun 25, 2022
1 parent 5e405b5 commit 224d35b
Showing 1 changed file with 5 additions and 11 deletions.
16 changes: 5 additions & 11 deletions .github/workflows/benchmark.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -45,12 +45,8 @@ jobs:
- name: Move build files to root
run: |
move build/RelWithDebInfo/* .
move build/Release/* .
- name: Check dir structure
run: |
ls build/RelWithDebInfo
ls
- uses: actions/setup-python@v3
with:
python-version: "3.9"
Expand Down Expand Up @@ -171,7 +167,7 @@ jobs:
fail-on-alert: true
comment-on-alert: true
comment-always: true
github-token: ${{ secrets.GITHUB_TOKEN }}
github-token: ${{ secrets.BENCH_GITHUB_TOKEN }}

- name: Store ${{ matrix.bench.title }} result (CacheGrind)
if: matrix.os == 'ubuntu-latest'
Expand All @@ -185,7 +181,7 @@ jobs:
fail-threshold: 1000%
fail-on-alert: false
comment-on-alert: true
github-token: ${{ secrets.GITHUB_TOKEN }}
github-token: ${{ secrets.BENCH_GITHUB_TOKEN }}

- name: Push benchmark results
if: github.event_name == 'push'
Expand All @@ -205,8 +201,6 @@ jobs:
fail-fast: false
matrix:
os: [ubuntu-latest]
engine:
- { channel: stable, version: latest }
bench:
- {
script: "run-analyze",
Expand Down Expand Up @@ -270,7 +264,7 @@ jobs:
fail-on-alert: true
comment-on-alert: true
comment-always: true
github-token: ${{ secrets.GITHUB_TOKEN }}
github-token: ${{ secrets.BENCH_GITHUB_TOKEN }}

- name: Store ${{ matrix.bench.title }} result (CacheGrind)
uses: Roblox/rhysd-github-action-benchmark@v-luau
Expand All @@ -285,7 +279,7 @@ jobs:
fail-on-alert: true
comment-on-alert: true
comment-always: true
github-token: ${{ secrets.GITHUB_TOKEN }}
github-token: ${{ secrets.BENCH_GITHUB_TOKEN }}

- name: Push benchmark results
if: github.event_name == 'push'
Expand Down

4 comments on commit 224d35b

@luau-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Luau Analyze

Benchmark suite Current: 224d35b Previous: 5e405b5 Ratio
duration 3.36 3ms (±0.02%)

This comment was automatically generated by workflow using github-action-benchmark.

@luau-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Luau Analyze

Benchmark suite Current: 224d35b Previous: 5e405b5 Ratio
Performance#TotalInstructionsExecuted 1267145686 executions (±0%) 1265541316 executions (±0%) 1.00
Performance#L1_InstrReadCacheMisses 0.0084315656 misses/op (±0%) 0.0084463809 misses/op (±0%) 1.00
Performance#LL_InstrReadCacheMisses 0.0000317754 misses/op (±0%) 0.0000322961 misses/op (±0%) 0.98
Performance#TotalMemoryReads 342871178 reads (±0%) 342644070 reads (±0%) 1.00
Performance#L1_DataReadCacheMisses 0.0351503648 misses/op (±0%) 0.0432638598 misses/op (±0%) 0.81
Performance#LL_DataReadCacheMisses 0.0006438366 misses/op (±0%) 0.0008294526 misses/op (±0%) 0.78
Performance#TotalMemoryWrites 143186695 writes (±0%) 143215716 writes (±0%) 1.00
Performance#L1_DataWriteCacheMisses 0.0122652178 misses/op (±0%) 0.0147294728 misses/op (±0%) 0.83
Performance#LL_DataWriteCacheMisses 0.0034833753 misses/op (±0%) 0.0034866006 misses/op (±0%) 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@luau-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Luau Benchmarks

Benchmark suite Current: 224d35b Previous: 08ab7da Ratio
base64 29.666 ms (±0.325%) 30.2 ms (±0.027%) 0.98
chess 143.825 ms (±0.315%) 125.928 ms (±0.540%) 1.14
life 112.106 ms (±0.200%) 102.937 ms (±0.012%) 1.09
qsort 93.476 ms (±0.383%) 93.519 ms (±0.071%) 1.00
sha256 32.823 ms (±0.264%) 30.305 ms (±0.024%) 1.08
ack 79.665 ms (±0.172%) 74.592 ms (±0.060%) 1.07
binary-trees 35.239 ms (±0.918%) 33.815 ms (±0.465%) 1.04
fannkuchen-redux 16.538 ms (±0.873%) 16.14 ms (±0.122%) 1.02
fixpoint-fact 92.24 ms (±0.336%) 81.57 ms (±0.417%) 1.13
heapsort 25.831 ms (±0.292%) 30.224 ms (±0.074%) 0.85
mandel 95.213 ms (±0.354%) 88.065 ms (±0.156%) 1.08
n-body 43.227 ms (±0.586%) 38.208 ms (±0.133%) 1.13
qt 98.476 ms (±0.473%) 82.369 ms (±0.406%) 1.20
queen 2.701 2ms (±0.195%) 2.517 2ms (±0.390%) 1.07
scimark 90.584 ms (±0.196%) 99.567 ms (±0.031%) 0.91
spectral-norm 19.809 ms (±0.227%) 22.155 ms (±0.054%) 0.89
sieve 185.082 ms (±0.283%) 203.34 ms (±0.047%) 0.91
3d-cube 10.267 ms (±0.303%) 9.635 9ms (±0.101%) 1.07
3d-morph 12.15 ms (±0.548%) 11.322 ms (±0.045%) 1.07
3d-raytrace 13.419 ms (±0.214%) 12.393 ms (±0.729%) 1.08
controlflow-recursive 6.788 6ms (±0.296%) 6.048 6ms (±0.030%) 1.12
crypto-aes 19.288 ms (±0.341%) 18.336 ms (±0.057%) 1.05
fannkuch 33.339 ms (±0.554%) 30.21 ms (±0.085%) 1.10
math-cordic 22.741 ms (±0.837%) 20.934 ms (±0.092%) 1.09
math-partial-sums 6.698 6ms (±0.308%) 5.923 5ms (±0.088%) 1.13
n-body-oop 63.753 ms (±0.191%) 56.959 ms (±0.051%) 1.12
tictactoe 229.983 ms (±0.193%) 181.763 ms (±0.108%) 1.27
trig 36.087 ms (±0.938%) 28.676 ms (±0.076%) 1.26

This comment was automatically generated by workflow using github-action-benchmark.

@luau-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Luau Benchmarks

Benchmark suite Current: 224d35b Previous: 08ab7da Ratio
base64 34.179 ms (±1.457%) 30.2 ms (±0.027%) 1.13
chess 139.765 ms (±0.908%) 125.928 ms (±0.540%) 1.11
life 119.319 ms (±1.236%) 102.937 ms (±0.012%) 1.16
qsort 110.639 ms (±1.378%) 93.519 ms (±0.071%) 1.18
sha256 34.433 ms (±1.448%) 30.305 ms (±0.024%) 1.14
ack 80.642 ms (±1.225%) 74.592 ms (±0.060%) 1.08
binary-trees 40.896 ms (±1.774%) 33.815 ms (±0.465%) 1.21
fannkuchen-redux 18.11 ms (±1.768%) 16.14 ms (±0.122%) 1.12
fixpoint-fact 86.727 ms (±1.564%) 81.57 ms (±0.417%) 1.06
heapsort 32.425 ms (±0.828%) 30.224 ms (±0.074%) 1.07
mandel 106.21 ms (±0.820%) 88.065 ms (±0.156%) 1.21
n-body 46.242 ms (±1.144%) 38.208 ms (±0.133%) 1.21
qt 91.286 ms (±0.944%) 82.369 ms (±0.406%) 1.11
queen 2.56 2ms (±1.049%) 2.517 2ms (±0.390%) 1.02
scimark 111.527 ms (±0.906%) 99.567 ms (±0.031%) 1.12
spectral-norm 24.412 ms (±1.358%) 22.155 ms (±0.054%) 1.10
sieve 218.898 ms (±0.707%) 203.34 ms (±0.047%) 1.08
3d-cube 11.755 ms (±0.629%) 9.635 9ms (±0.101%) 1.22
3d-morph 13.602 ms (±1.339%) 11.322 ms (±0.045%) 1.20
3d-raytrace 14.538 ms (±2.296%) 12.393 ms (±0.729%) 1.17
controlflow-recursive 7.008 7ms (±1.994%) 6.048 6ms (±0.030%) 1.16
crypto-aes 23.778 ms (±1.981%) 18.336 ms (±0.057%) 1.30
fannkuch 35.531 ms (±1.416%) 30.21 ms (±0.085%) 1.18
math-cordic 24.436 ms (±2.496%) 20.934 ms (±0.092%) 1.17
math-partial-sums 7.811 7ms (±2.811%) 5.923 5ms (±0.088%) 1.32
n-body-oop 73.785 ms (±0.785%) 56.959 ms (±0.051%) 1.30
tictactoe 222.262 ms (±0.635%) 181.763 ms (±0.108%) 1.22
trig 35.05 ms (±3.184%) 28.676 ms (±0.076%) 1.22

This comment was automatically generated by workflow using github-action-benchmark.

Please sign in to comment.