Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add actions for Raft scenarios #5996

Merged
merged 3 commits into from
Feb 7, 2024

Conversation

eddyashton
Copy link
Member

Pulling out a few actions proposed in previous PRs (#5991), adding them explicitly here.

@eddyashton eddyashton requested a review from a team as a code owner February 7, 2024 11:01
Copy link
Member

@heidihoward heidihoward left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you so much! This is really helpful to me as it was it easier for me to run the scenario in #5996 against the current main

@ccf-bot
Copy link
Collaborator

ccf-bot commented Feb 7, 2024

new_driver_actions@81393 aka 20240207.11 vs main ewma over 20 builds from 81082 to 81376

Click to see table

main

build_id build_number pi_basic_mt_sgx_cft^ pi_basic_mt_sgx_cft_mem Commit latency factor tpcc_sgx_cft^ tpcc_sgx_cft_mem pi_basic_mt_virtual_cft^ tpcc_virtual_cft^ ls_sgx_cft^ ls_sgx_cft_mem pi_ls_sgx_cft^ pi_ls_sgx_cft_mem ls_virtual_cft^ pi_basic_sgx_cft^ pi_basic_sgx_cft_mem pi_ls_virtual_cft^ pi_basic_virtual_cft^ pi_basic_js_virtual_cft^ ls_jwt_virtual_cft^ pi_ls_jwt_virtual_cft^ tlc_3node_fixed_duration_s tlc_3node_fixed_states pi_basic_js_sgx_cft^ pi_basic_js_sgx_cft_mem ls_js_virtual_cft^ tlc_atomic_reconfig_duration_s tlc_atomic_reconfig_states tlc_reconfig_duration_s tlc_reconfig_states ls_full_js_virtual_cft^ ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem ls_js_jwt_virtual_cft^ pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem hist_sgx_cft^ ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^ tlc_sim_traces tlc_sim_levelmean
81082 20240131.21 28031.6 2.30851e+07 0.775369 5624.37 8.59996e+07 85782.3 17242.7 14004.3 1.88908e+07 14153.2 1.05021e+07 53185.6 15519.6 1.46964e+07 58230.6 61698.8 4599.1 20956.9 22145.5 7 77678 1434.6 1.25993e+07 20760 163 4.37276e+06 554 1.33071e+07 17866.7 6814.83 1.88908e+07 11791.7 6921.8 6.30784e+06 5810.37 1.67936e+07 5737.02 1.67936e+07 44870.4 3991.71 1.67936e+07 836799 1.17473e+06 8.13431e+06 3.15786e+07 41737 391
81093 20240201.3 27841.7 2.51822e+07 0.777591 5608 8.59996e+07 83402.1 17295.4 14013.2 1.88908e+07 14185 1.05021e+07 53364.3 15594.1 1.46964e+07 57728.1 62992.6 4659.8 20680.4 21886.6 6 77678 1435.3 1.25993e+07 20679.6 158 4.37276e+06 552 1.33071e+07 17573.8 6857.42 1.67936e+07 11777.3 7086 6.30784e+06 5805.16 1.67936e+07 5453.77 1.67936e+07 47043.4 3974.74 1.67936e+07 832580 1.1843e+06 8.15014e+06 3.0882e+07 40666 391
81114 20240201.11 28072.4 2.51822e+07 0.822915 5513.38 8.59996e+07 79807 17304.8 14011.9 1.88908e+07 14121.1 1.05021e+07 56139.4 15543.7 1.25993e+07 57508.6 62598.8 4639.2 20556.5 21777 7 77678 1422 1.25993e+07 20887.8 160 4.37276e+06 551 1.33071e+07 17575.8 7183.82 1.88908e+07 11723.6 7058.8 6.30784e+06 5813.99 1.67936e+07 5731.83 1.88908e+07 45387.7 3967.96 1.67936e+07 836976 1.17864e+06 8.15459e+06 3.10124e+07 44839 392
81124 20240201.15 28137.9 2.51822e+07 0.764222 5616.65 8.59996e+07 96228.1 17327.1 14093.5 1.88908e+07 14176.1 1.05021e+07 53350.9 15633.1 1.25993e+07 58149.3 61837.4 4612.9 21209.2 21195.9 5 58806 1424.1 1.25993e+07 17421.1 165 4.51944e+06 575 1.35909e+07 17629.9 6803.97 1.88908e+07 11831 6943.7 6.30784e+06 5765.82 1.67936e+07 5738.28 1.67936e+07 44049.2 3989.03 1.67936e+07 834565 1.18157e+06 8.14907e+06 3.13303e+07 45276 378
81141 20240201.21 28194 2.51822e+07 0.830179 5603.72 8.59996e+07 69246.9 17379.3 14032.8 1.88908e+07 14138 1.05021e+07 56204.6 15624.9 1.46964e+07 57632.2 61922.3 4617.9 21011.5 22151.3 5 58806 1422.7 1.25993e+07 20824.9 167 4.51944e+06 564 1.35909e+07 17266.5 7222.9 1.67936e+07 11777.6 6881.9 6.30784e+06 5765.47 1.67936e+07 5714.02 1.88908e+07 45071.3 3981.21 1.67936e+07 829086 1.18319e+06 8.13505e+06 3.09207e+07 45002 374
81143 20240201.22 28003.9 2.30851e+07 0.788425 5550.38 8.59996e+07 76974.1 17353.5 13997 1.88908e+07 14131.3 1.05021e+07 55835.3 15659.6 1.25993e+07 57480.8 61038.5 4609.9 21136.2 21619.8 5 58806 1438.8 1.25993e+07 20837.9 173 4.51944e+06 586 1.35909e+07 17714.7 6788.68 1.88908e+07 11811.6 6851.8 6.30784e+06 5805.87 1.67936e+07 5460.09 1.67936e+07 43160 3990.5 1.67936e+07 827345 1.17974e+06 8.13328e+06 3.07859e+07 44907 383
81155 20240201.27 27721.2 2.30851e+07 0.754562 5512.97 8.59996e+07 79007.3 17327.2 13974.9 1.88908e+07 14047.6 1.05021e+07 52936.4 15473.6 1.25993e+07 55935.3 61111.5 4588.6 21159.9 21663.3 5 58806 1428.8 1.25993e+07 20596.9 164 4.51944e+06 606 1.35909e+07 17353.6 6809.82 1.67936e+07 11679.6 6972.8 6.30784e+06 5757.94 1.67936e+07 5454.24 1.67936e+07 44675.3 3965.43 1.67936e+07 820629 1.16845e+06 8.14927e+06 3.04445e+07 45810 375
81186 20240202.2 28011 2.51822e+07 0.773666 5662.38 8.59996e+07 75832.1 17109 14042.4 1.88908e+07 14167 1.05021e+07 50572 15641 1.46964e+07 55772.4 60552.9 4591 17510.5 21380.3 5 58806 1429.9 1.25993e+07 17498.5 170 4.51944e+06 585 1.35909e+07 17671.9 6848.6 1.88908e+07 11649.9 6937.2 6.30784e+06 5820.01 1.67936e+07 5492.31 1.67936e+07 46328.9 3999.6 1.67936e+07 823466 1.18357e+06 8.15462e+06 3.15339e+07 45685 385
81200 20240202.7 28277.6 2.30851e+07 0.826825 5539.59 8.59996e+07 76950.8 17401 14053.6 1.88908e+07 14055.3 1.05021e+07 53078.8 15421.9 1.46964e+07 55959.1 62600.8 4627.2 20746.6 20480.5 5 58806 1426.9 1.25993e+07 20951.4 172 4.51944e+06 581 1.35909e+07 17688 6838.35 1.88908e+07 11826.7 6999.3 6.30784e+06 5759.1 1.67936e+07 5491.42 1.88908e+07 44597.7 3983.75 1.67936e+07 830516 1.1777e+06 8.14777e+06 3.07258e+07 43368 351
81231 20240205.1 27929 2.51822e+07 0.829009 5528.21 8.59996e+07 84841.5 17303.3 13962.1 1.88908e+07 14091.9 1.05021e+07 53303 15406.6 1.46964e+07 55966.3 61704.9 4622.7 17350.6 20125.6 5 58806 1418.5 1.25993e+07 20960.2 168 4.51944e+06 586 1.35909e+07 17177.3 6905.99 1.88908e+07 11801.8 7038.7 6.30784e+06 5807.09 1.67936e+07 5719.16 1.67936e+07 40918.8 4009.92 1.67936e+07 839482 1.18031e+06 8.13664e+06 3.07993e+07 48129 363
81247 20240205.8 28037.1 2.51822e+07 0.784941 5605.14 8.59996e+07 87515.1 17426.2 14122.7 1.67936e+07 14258.1 1.05021e+07 53343.3 15645.9 1.46964e+07 55754.7 61656.2 4618.3 17403.7 21428.9 5 58806 1442.1 1.25993e+07 17469.3 166 4.51944e+06 574 1.35909e+07 17654.5 6831.03 1.67936e+07 11773 6971.5 6.30784e+06 5808.79 1.67936e+07 5774.58 1.67936e+07 47698.5 4010.69 1.67936e+07 834746 1.17802e+06 8.15115e+06 3.08564e+07 48791 353
81263 20240205.15 28246 2.30851e+07 0.790075 5605.25 8.59996e+07 99265.8 17261.5 14047.1 1.88908e+07 14114.5 1.05021e+07 52906.2 15517.5 1.46964e+07 57724.7 63218.3 4673.4 20851.3 21974.6 6 58806 1423.5 1.25993e+07 17370.6 171 4.51944e+06 594 1.35909e+07 17686.3 7224.46 1.67936e+07 11673.1 6972.9 6.30784e+06 5772.75 1.67936e+07 5489.49 1.88908e+07 45499.7 4003.36 1.67936e+07 839482 1.17502e+06 8.14457e+06 3.09956e+07 47867 356
81278 20240205.21 28168.1 2.51822e+07 0.816863 5528.11 8.59996e+07 67618.4 17318.9 13971 1.67936e+07 14087.3 1.05021e+07 53331.6 15474.2 1.46964e+07 55767.5 62563.2 4654.2 17491.1 21372.1 5 58806 1424.2 1.25993e+07 20960.2 163 4.51944e+06 572 1.35909e+07 17615.5 6873.57 1.88908e+07 11836.1 6875.9 6.30784e+06 5756.61 1.67936e+07 5481.33 1.67936e+07 45651.3 3956.07 1.67936e+07 824845 1.17907e+06 8.14865e+06 3.09506e+07 45709 360
81301 20240205.30 28205.7 2.30851e+07 0.79962 5498.43 8.59996e+07 70410 17447.7 13959.8 1.88908e+07 14117.7 1.05021e+07 53141.2 15430.6 1.46964e+07 56057.9 61985.5 4622.5 17342.2 21229.2 5 58806 1422.7 1.25993e+07 17780.3 166 4.51944e+06 601 1.35909e+07 17643.3 6792.49 1.88908e+07 11790.8 6862.2 6.30784e+06 5800.44 1.67936e+07 5465.35 1.67936e+07 42648.7 3990.69 1.67936e+07 827496 1.1805e+06 8.13486e+06 3.16025e+07 49097 374
81310 20240206.1 28124.9 2.51822e+07 0.805583 5589.04 8.59996e+07 79114.7 17359.7 14041 1.88908e+07 14125.3 1.05021e+07 52956.5 15638.2 1.46964e+07 55926.5 61954.3 4559.5 17425.4 21170.7 5 58806 1424.5 1.25993e+07 20846.6 174 4.51944e+06 617 1.35909e+07 17719.7 7230.05 1.67936e+07 11666.5 6914.2 6.30784e+06 5798.32 1.67936e+07 5463.02 1.67936e+07 43133.8 4005.06 1.67936e+07 834173 1.17513e+06 8.15183e+06 3.08197e+07 49055 355
81326 20240206.7 28027.6 2.51822e+07 0.783095 5510.64 8.59996e+07 80674.2 17368.3 13947.2 1.88908e+07 14067.9 1.05021e+07 53111.4 15201.4 1.46964e+07 56876.4 63902.9 4647.2 20574.7 20605 5 58806 1414.8 1.25993e+07 20951.4 176 4.51944e+06 586 1.35909e+07 17657.1 6807.55 1.88908e+07 11893.8 7009.3 6.30784e+06 5803.72 1.67936e+07 5448.79 1.88908e+07 45019.4 3966.21 1.67936e+07 837634 1.17457e+06 8.15313e+06 3.10519e+07 48222 361
81341 20240206.13 28092.8 2.30851e+07 0.819308 5565.89 8.59996e+07 75312.5 17349.3 14082.6 1.88908e+07 14139.2 1.05021e+07 53101.5 15588.8 1.46964e+07 56845.6 64358.5 4664.4 17593.5 21205.8 5 58806 1437.3 1.05021e+07 17387.7 170 4.51944e+06 626 1.35909e+07 17186.4 7217.28 1.67936e+07 11729 6973.2 6.30784e+06 5769.96 1.67936e+07 5499.51 1.67936e+07 40385 3967.79 1.67936e+07 827175 1.17999e+06 8.13234e+06 3.07568e+07 47903 356
81359 20240206.20 28060.5 2.51822e+07 0.839544 5606.54 8.59996e+07 70638.6 17249.1 14072.3 1.88908e+07 14142.8 1.05021e+07 52827.8 15576.9 1.46964e+07 56839.5 63626.3 4671.6 20687.9 21654.9 5 58806 1435 1.25993e+07 20748.9 165 4.51944e+06 579 1.35909e+07 17679 7244.35 1.67936e+07 11773.1 6928.7 6.30784e+06 5802.68 1.67936e+07 5486.69 1.67936e+07 45752.6 3981.76 1.67936e+07 833856 1.1806e+06 8.15407e+06 3.07604e+07 44974 349
81367 20240207.1 27905.7 2.30851e+07 0.786338 5623.71 8.59996e+07 76504.3 17349.2 14040.1 1.88908e+07 14158.8 1.05021e+07 53414.4 15603.8 1.46964e+07 56580.3 63339.1 4682.2 17381.8 20528.8 5 58806 1433.2 1.25993e+07 20947 173 4.51944e+06 577 1.35909e+07 17640.9 7254.86 1.88908e+07 11699.6 6930.7 6.30784e+06 5762.6 1.67936e+07 5707.82 1.67936e+07 45625.1 4003.98 1.67936e+07 837148 1.17799e+06 8.15485e+06 3.13471e+07 48742 367
81376 20240207.5 28211.8 2.30851e+07 0.791487 5680.25 8.59996e+07 85830.9 17347.4 14052.1 1.88908e+07 14207.2 1.05021e+07 52775.6 15675.8 1.25993e+07 55089.1 62099.1 4612 17330.1 22048.3 6 58806 1421.9 1.05021e+07 20947.4 168 4.51944e+06 582 1.35909e+07 17341 7251.18 1.67936e+07 11623.1 6975.1 6.30784e+06 5811.57 1.67936e+07 5487.37 1.88908e+07 42785.6 3993.07 1.67936e+07 835691 1.17803e+06 8.13728e+06 2.98808e+07 48517 364

new_driver_actions

build_id build_number Commit latency factor tpcc_sgx_cft^ tpcc_sgx_cft_mem pi_basic_mt_virtual_cft^ tpcc_virtual_cft^ ls_virtual_cft^ pi_basic_mt_sgx_cft^ pi_basic_mt_sgx_cft_mem pi_ls_virtual_cft^ pi_basic_virtual_cft^ ls_sgx_cft^ ls_sgx_cft_mem pi_ls_sgx_cft^ pi_ls_sgx_cft_mem pi_basic_sgx_cft^ pi_basic_sgx_cft_mem pi_basic_js_virtual_cft^ ls_jwt_virtual_cft^ pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ pi_basic_js_sgx_cft^ pi_basic_js_sgx_cft_mem ls_js_jwt_virtual_cft^ ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem hist_sgx_cft^ ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem tlc_3node_fixed_duration_s tlc_3node_fixed_states tlc_atomic_reconfig_duration_s tlc_atomic_reconfig_states tlc_reconfig_duration_s tlc_reconfig_states RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^ tlc_sim_traces tlc_sim_levelmean
81381 20240207.6 0.833341 5601.69 8.59996e+07 91185.4 17277.3 50348.7 27833.1 2.51822e+07 55733.3 62590.4 14046.2 1.88908e+07 14154.9 1.05021e+07 15521.4 1.46964e+07 4515.6 20666.4 21019.4 20933.8 17477.8 1429.8 1.25993e+07 11699.4 6865.44 1.88908e+07 6973 6.30784e+06 5798.64 1.67936e+07 45874.9 5450.29 1.67936e+07 3967.75 1.67936e+07 6 58806 167 4.51944e+06 576 1.35909e+07 832276 1.17754e+06 8.12737e+06 3.08076e+07 47939 362
81393 20240207.11 0.782817 5622.37 8.59996e+07 85025 17303.7 52995 28213.8 2.51822e+07 55865.3 62950.4 13996.2 1.67936e+07 14089.9 1.05021e+07 15504.4 1.46964e+07 4650 20771.9 21479.5 20938.2 17312.3 1422.6 1.25993e+07 11741.9 7216.4 1.88908e+07 6967 6.30784e+06 5798.86 1.67936e+07 39494.8 5485.73 1.67936e+07 3980.46 1.67936e+07 5 58806 167 4.51944e+06 563 1.35909e+07 841659 1.18391e+06 8.15416e+06 3.06876e+07 49421 354

images

@achamayou achamayou enabled auto-merge (squash) February 7, 2024 11:59
@achamayou achamayou merged commit 0582c4a into microsoft:main Feb 7, 2024
22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants