Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(runtime): update weights #3432

Merged
merged 3 commits into from
Oct 22, 2023
Merged

chore(runtime): update weights #3432

merged 3 commits into from
Oct 22, 2023

Conversation

github-actions[bot]
Copy link
Contributor

run_all_benchmarks.sh script is applied to update weights (branch: master, commit ece52b4)
Note: If CI fails, try manually updating the heuristic tests: runtime/vara/src/tests.rs

@breathx
Copy link
Member

breathx commented Oct 21, 2023

Comparison table for Vara runtime for Instruction

name master weights/patch-ece52b48 diff
i64const 209 ps 206 ps +1.46%
i64load 10.5 ns 9.4 ns +11.75%
i32load 10.7 ns 9.3 ns +15.25%
i64store 25.8 ns 20.7 ns +24.59%
i32store 21.6 ns 23.3 ns -7.01%
select 7.3 ns 7.2 ns +1.28%
if 6.4 ns 6.4 ns +0.33%
br 3.1 ns 3.1 ns +0.77%
br_if 5.7 ns 5.6 ns +2.12%
br_table 9.9 ns 10.2 ns -2.61%
br_table_per_entry 360 ps 352 ps +2.27%
call 4.4 ns 4.5 ns -1.28%
call_indirect 19.5 ns 19.2 ns +1.63%
call_indirect_per_param 2.3 ns 2.3 ns +3.27%
call_per_local 0 ps 0 ps N/A
local_get 869 ps 907 ps -4.19%
local_set 2.0 ns 2.1 ns -8.51%
local_tee 2.0 ns 2.5 ns -20.89%
global_get 1.7 ns 1.8 ns -9.66%
global_set 2.6 ns 3.0 ns -11.62%
memory_current 14.0 ns 14.2 ns -1.32%
i64clz 6.6 ns 6.5 ns +1.53%
i32clz 6.1 ns 6.0 ns +1.66%
i64ctz 6.1 ns 6.0 ns +1.41%
i32ctz 5.3 ns 5.3 ns -1.09%
i64popcnt 1.1 ns 1.2 ns -9.07%
i32popcnt 846 ps 919 ps -7.94%
i64eqz 3.8 ns 3.7 ns +0.97%
i32eqz 2.3 ns 2.5 ns -6.60%
i32extend8s 887 ps 1.1 ns -18.32%
i32extend16s 859 ps 1.1 ns -18.19%
i64extend8s 1.0 ns 1.1 ns -3.24%
i64extend16s 1.1 ns 1.1 ns -0.47%
i64extend32s 822 ps 942 ps -12.74%
i64extendsi32 786 ps 772 ps +1.81%
i64extendui32 361 ps 321 ps +12.46%
i32wrapi64 196 ps 140 ps +40.00%
i64eq 3.4 ns 3.1 ns +8.87%
i32eq 2.1 ns 1.8 ns +11.21%
i64ne 3.5 ns 3.1 ns +10.73%
i32ne 2.1 ns 2.2 ns -5.62%
i64lts 3.5 ns 3.4 ns +1.76%
i32lts 2.0 ns 2.2 ns -7.87%
i64ltu 3.4 ns 3.4 ns +0.80%
i32ltu 2.0 ns 2.1 ns -5.78%
i64gts 3.4 ns 3.3 ns +1.79%
i32gts 2.1 ns 2.0 ns +0.78%
i64gtu 3.5 ns 3.5 ns -1.14%
i32gtu 2.1 ns 2.2 ns -7.15%
i64les 3.4 ns 3.5 ns -0.58%
i32les 2.0 ns 2.3 ns -14.03%
i64leu 3.4 ns 3.4 ns -0.70%
i32leu 2.1 ns 2.2 ns -6.74%
i64ges 3.3 ns 3.4 ns -0.60%
i32ges 2.0 ns 1.9 ns +8.54%
i64geu 3.4 ns 3.2 ns +5.91%
i32geu 2.0 ns 2.3 ns -11.98%
i64add 2.3 ns 2.5 ns -8.64%
i32add 1.1 ns 1.2 ns -9.75%
i64sub 2.3 ns 2.5 ns -9.70%
i32sub 949 ps 1.2 ns -18.26%
i64mul 3.3 ns 3.3 ns -1.62%
i32mul 2.2 ns 2.3 ns -5.65%
i64divs 4.3 ns 3.3 ns +32.27%
i32divs 4.2 ns 3.6 ns +17.15%
i64divu 5.1 ns 4.7 ns +10.30%
i32divu 4.5 ns 4.2 ns +8.97%
i64rems 17.7 ns 18.6 ns -5.02%
i32rems 14.5 ns 14.3 ns +1.05%
i64remu 5.2 ns 4.1 ns +27.71%
i32remu 4.4 ns 3.7 ns +19.53%
i64and 2.3 ns 2.5 ns -9.34%
i32and 949 ps 1.2 ns -20.65%
i64or 2.4 ns 2.5 ns -4.55%
i32or 959 ps 957 ps +0.21%
i64xor 2.3 ns 2.3 ns -0.66%
i32xor 1.0 ns 1.2 ns -14.22%
i64shl 1.9 ns 2.2 ns -11.99%
i32shl 851 ps 1.1 ns -20.39%
i64shrs 2.0 ns 2.2 ns -10.13%
i32shrs 770 ps 890 ps -13.48%
i64shru 1.9 ns 1.8 ns +5.52%
i32shru 850 ps 805 ps +5.59%
i64rotl 2.0 ns 2.1 ns -7.92%
i32rotl 838 ps 1.0 ns -16.95%
i64rotr 1.9 ns 2.2 ns -14.05%
i32rotr 841 ps 1.0 ns -18.51%

Comparison table for Vara runtime for HostFn

name master weights/patch-ece52b48 diff
alloc 7.8 µs 7.6 µs +2.57%
alloc_per_page 389.6 ns 408.3 ns -4.57%
free 787.4 ns 799.9 ns -1.57%
gr_reserve_gas 2.5 µs 2.5 µs +0.88%
gr_unreserve_gas 2.2 µs 2.1 µs +3.29%
gr_system_reserve_gas 1.2 µs 1.3 µs -7.89%
gr_gas_available 1.1 µs 1.2 µs -4.24%
gr_message_id 1.1 µs 1.2 µs -6.82%
gr_pay_program_rent 22.3 ns 26.8 ns -16.74%
gr_program_id 1.1 µs 1.2 µs -9.56%
gr_source 1.1 µs 1.2 µs -8.83%
gr_value 1.1 µs 1.2 µs -11.93%
gr_value_available 1.1 µs 1.2 µs -12.09%
gr_size 1.1 µs 1.2 µs -10.76%
gr_read 1.8 µs 1.9 µs -8.38%
gr_read_per_byte 161 ps 164 ps -1.83%
gr_block_height 1.1 µs 1.2 µs -6.66%
gr_block_timestamp 1.1 µs 1.2 µs -4.85%
gr_random 2.2 µs 2.2 µs -1.10%
gr_reply_deposit 6.5 µs 7.5 µs -14.30%
gr_send 3.3 µs 3.3 µs +0.63%
gr_send_per_byte 260 ps 260 ps +0.00%
gr_send_wgas 3.3 µs 3.3 µs +0.27%
gr_send_wgas_per_byte 260 ps 266 ps -2.26%
gr_send_init 1.2 µs 1.3 µs -2.58%
gr_send_push 2.0 µs 2.2 µs -7.34%
gr_send_push_per_byte 380 ps 362 ps +4.97%
gr_send_commit 2.8 µs 2.8 µs +1.35%
gr_send_commit_wgas 2.9 µs 2.8 µs +3.67%
gr_reservation_send 3.5 µs 3.5 µs +0.95%
gr_reservation_send_per_byte 263 ps 268 ps -1.87%
gr_reservation_send_commit 3.1 µs 3.1 µs +0.36%
gr_reply_commit 18.2 µs 16.3 µs +11.26%
gr_reply_commit_wgas 20.7 µs 16.6 µs +24.85%
gr_reservation_reply 12.8 µs 11.1 µs +15.11%
gr_reservation_reply_per_byte 428.8 ns 434.3 ns -1.28%
gr_reservation_reply_commit 5.3 µs 6.7 µs -20.49%
gr_reply_push 1.9 µs 2.0 µs -4.79%
gr_reply 21.6 µs 17.6 µs +23.10%
gr_reply_per_byte 426 ps 426 ps +0.00%
gr_reply_wgas 18.3 µs 18.4 µs -0.57%
gr_reply_wgas_per_byte 422 ps 421 ps +0.24%
gr_reply_push_per_byte 662 ps 646 ps +2.48%
gr_reply_to 1.1 µs 1.2 µs -7.58%
gr_signal_code 1.0 µs 1.2 µs -9.70%
gr_signal_from 1.1 µs 1.2 µs -9.81%
gr_reply_input 22.9 µs 25.6 µs -10.50%
gr_reply_input_wgas 17.3 µs 23.8 µs -27.49%
gr_reply_push_input 1.3 µs 1.4 µs -6.81%
gr_reply_push_input_per_byte 157 ps 120 ps +30.83%
gr_send_input 3.5 µs 3.6 µs -1.36%
gr_send_input_wgas 3.6 µs 3.6 µs +1.99%
gr_send_push_input 1.6 µs 1.7 µs -3.77%
gr_send_push_input_per_byte 166 ps 150 ps +10.67%
gr_debug 1.4 µs 1.5 µs -2.02%
gr_debug_per_byte 315 ps 292 ps +7.88%
gr_reply_code 1.0 µs 1.2 µs -10.38%
gr_exit 541.2 µs 503.3 µs +7.52%
gr_leave 536.1 µs 426.5 µs +25.70%
gr_wait 519.1 µs 465.5 µs +11.51%
gr_wait_for 547.3 µs 421.3 µs +29.91%
gr_wait_up_to 553.6 µs 480.1 µs +15.30%
gr_wake 1.9 µs 2.1 µs -7.28%
gr_create_program 4.5 µs 4.4 µs +1.98%
gr_create_program_payload_per_byte 94 ps 95 ps -1.05%
gr_create_program_salt_per_byte 2.1 ns 2.1 ns +2.78%
gr_create_program_wgas 4.6 µs 4.5 µs +1.77%
gr_create_program_wgas_payload_per_byte 87 ps 97 ps -10.31%
gr_create_program_wgas_salt_per_byte 2.1 ns 2.1 ns +2.59%

Comparison table for Vara runtime for Memory

name master weights/patch-ece52b48 diff
lazy_pages_signal_read 29.1 µs 29.1 µs -0.04%
lazy_pages_signal_write 35.5 µs 35.5 µs +0.14%
lazy_pages_signal_write_after_read 10.7 µs 11.0 µs -3.30%
lazy_pages_host_func_read 29.6 µs 30.3 µs -2.18%
lazy_pages_host_func_write 35.1 µs 36.3 µs -3.19%
lazy_pages_host_func_write_after_read 9.3 µs 11.1 µs -16.21%
load_page_data 9.4 µs 10.8 µs -12.52%
upload_page_data 103.9 µs 103.4 µs +0.55%
static_page 100 ps 100 ps +0.00%
mem_grow 926.9 ns 981.1 ns -5.52%
parachain_read_heuristic 0 ps 0 ps N/A

@breathx breathx added the A0-pleasereview PR is ready to be reviewed by the team label Oct 21, 2023
@breathx breathx merged commit 57df8b3 into master Oct 22, 2023
10 checks passed
@breathx breathx deleted the weights/patch-ece52b48 branch October 22, 2023 13:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A0-pleasereview PR is ready to be reviewed by the team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants