Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[release/4.x] Cherry pick: Add basic backpressure mechanism if primary has too many in-flight transactions (#5692) #5745

Merged
merged 5 commits into from
Oct 19, 2023
Merged

[release/4.x] Cherry pick: Add basic backpressure mechanism if primary has too many in-flight transactions (#5692) #5745

merged 5 commits into from
Oct 19, 2023

Conversation

achamayou
Copy link
Member

@achamayou
Add basic backpressure mechanism if primary has too many in-flight tr…
94c37cd 
…ansactions (microsoft#5692)

(cherry picked from commit d1d9d8e)

# Conflicts:
#	CHANGELOG.md
#	tests/infra/basicperf.py
#	tests/infra/remote.py
@achamayou achamayou requested a review from a team as a code owner October 18, 2023 15:42
@achamayou achamayou added the 4.x-backport Highlights PRs targeting the 4.x branch label Oct 18, 2023
@achamayou achamayou enabled auto-merge (squash) October 18, 2023 15:42
eddyashton
eddyashton reviewed Oct 18, 2023
View reviewed changes
CHANGELOG.md Outdated Show resolved Hide resolved
@ccf-bot
Copy link
Collaborator

ccf-bot commented Oct 18, 2023 •
edited
Loading

backport/release/4.x/pr-5692@77415 aka 20231019.6 vs release/4.x ewma over 20 builds from 76285 to 77403

Click to see table

release/4.x

build_id build_number Commit latency factor tpcc_virtual_cft^ ls_virtual_cft^ pi_ls_virtual_cft^ ls_jwt_virtual_cft^ pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ hist_sgx_cft^ tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem pi_ls_sgx_cft^ pi_ls_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^
76285 20230922.2 0.799862 17350 45581.8 44511.9 17549.7 19018.3 4173.08 3702.99 3752.96 45567.2 5608.04 8.59996e+07 14059.7 1.67936e+07 14232 1.05021e+07 6855.98 1.67936e+07 7188.2 6.30784e+06 1459.98 1.05021e+07 1280.53 1.05021e+07 1303.05 1.05021e+07 828183 1.17868e+06 8.15433e+06 3.27753e+07
76346 20230925.2 0.802053 17402 45524.2 47345.8 17115.4 18542.9 4434.67 3732.99 3768.27 45953.9 5628.1 8.59996e+07 14074.3 1.67936e+07 14227.9 1.05021e+07 6855.82 1.88908e+07 7201.3 6.30784e+06 1463.13 1.05021e+07 1287.44 1.05021e+07 1291.03 1.05021e+07 829606 1.18042e+06 8.15173e+06 3.04223e+07
76414 20230926.2 0.806567 17370 45685.2 47422.8 17283.8 19351.7 4426.62 3727.77 3798.16 43863.4 5625.01 8.59996e+07 14011.4 1.88908e+07 14207.5 1.05021e+07 6871.45 1.67936e+07 7215.8 6.30784e+06 1460.64 1.05021e+07 1281.73 1.05021e+07 1303.32 1.05021e+07 832445 1.17954e+06 8.14952e+06 3.10845e+07
76475 20230927.2 0.780784 17481.1 45614.3 47089.7 17216.6 19016.1 4438.51 3715.17 3773.47 46912.3 5567.13 8.59996e+07 14075.4 1.88908e+07 14197.5 1.05021e+07 7247.5 1.67936e+07 7196.3 6.30784e+06 1458.67 1.05021e+07 1277.25 1.05021e+07 1290.57 1.05021e+07 842542 1.18151e+06 8.14758e+06 3.08127e+07
76523 20230928.3 0.791744 17121.8 43847.3 45927.4 17480.9 18743.8 4282.92 3599.56 3669.41 38874.5 5624.66 8.59996e+07 14099.3 1.88908e+07 14254.2 1.05021e+07 7283.92 1.67936e+07 7199.6 6.30784e+06 1459.87 1.05021e+07 1279.14 1.05021e+07 1303.57 1.05021e+07 830623 1.17622e+06 8.14917e+06 3.07471e+07
76605 20230929.3 0.794619 17372.9 43675.5 46882.3 17153.9 19083.2 4422.03 3728.57 3781.93 43156.9 5528.1 8.59996e+07 14071.7 1.88908e+07 14194.2 1.05021e+07 6845.03 1.67936e+07 7250.6 6.30784e+06 1464.52 1.05021e+07 1275.46 1.05021e+07 1294.89 1.05021e+07 828515 1.18256e+06 8.15241e+06 3.07106e+07
76682 20231002.2 0.795416 17429.7 43807.5 47103.8 17037.9 18973.2 4404.17 3765.78 3788.71 43221.9 5537.99 8.59996e+07 14015.5 1.67936e+07 14169.9 1.05021e+07 6825.93 1.67936e+07 7155.8 6.30784e+06 1454.37 1.05021e+07 1280.24 1.05021e+07 1290.23 1.05021e+07 831957 1.17075e+06 8.15274e+06 3.06734e+07
76732 20231003.2 0.789944 17593.2 43762.2 33974.1 17430.4 18760.3 4283.27 3637.4 3653.99 39282.7 5609.42 8.59996e+07 14045.5 1.67936e+07 14208.5 1.05021e+07 6884.55 1.88908e+07 7181.8 6.30784e+06 1461.28 1.05021e+07 1279.86 1.05021e+07 1292.28 1.05021e+07 835629 1.17736e+06 8.15137e+06 3.08434e+07
76819 20231004.3 0.807069 17249.3 43715.9 46504.9 16985.8 18920.4 4419.47 3722.08 3784.97 41835.8 5610.64 8.59996e+07 14113.4 1.88908e+07 14220.3 1.05021e+07 6865.25 1.88908e+07 7243.5 6.30784e+06 1458.38 1.05021e+07 1279.5 1.05021e+07 1287.07 1.05021e+07 832050 1.18486e+06 8.16984e+06 3.12138e+07
76925 20231005.3 0.809171 17203.2 43629.6 47004.2 17192.2 19133.3 4463.56 3727.51 3645.37 41890.8 5582.63 8.59996e+07 14059.8 1.88908e+07 14206 1.05021e+07 7261.85 1.67936e+07 7175.8 6.30784e+06 1458.85 1.05021e+07 1280.05 1.05021e+07 1295.18 1.05021e+07 839833 1.18299e+06 8.15501e+06 3.07614e+07
76943 20231006.2 0.798662 17653.3 43888.7 47048.9 17190.8 18742.7 4412.46 3728.69 3774.03 47974.2 5596.91 8.59996e+07 14121.4 1.67936e+07 14246.3 1.05021e+07 7265.4 1.67936e+07 7203.3 6.30784e+06 1461.24 1.05021e+07 1279.48 1.05021e+07 1302.52 1.05021e+07 820948 1.17955e+06 8.13289e+06 3.14269e+07
76983 20231009.3 0.801814 17117.3 43711.1 46975.3 17186.3 18705.9 4427.63 3717.55 3774.24 45279.1 5632.92 8.59996e+07 14042.4 1.88908e+07 14247.5 1.05021e+07 6895.13 1.88908e+07 7205.1 6.30784e+06 1453.99 1.05021e+07 1272.37 1.05021e+07 1301.06 1.05021e+07 841366 1.17618e+06 8.15361e+06 3.07378e+07
77013 20231010.3 0.790055 17138.2 43629.4 45985.3 17459.9 19035.3 4444.61 3749.53 3802.96 43378.3 5597.26 8.59996e+07 14078.3 1.88908e+07 14234.8 1.05021e+07 6858.07 1.88908e+07 7198.5 6.30784e+06 1454.78 1.05021e+07 1276.23 1.05021e+07 1290 1.05021e+07 818831 1.17724e+06 8.15361e+06 3.07826e+07
77078 20231011.5 0.808507 17129.1 43765 46636.5 17221.8 19288.2 4428.07 3728.86 3784.44 41537.1 5624.05 8.59996e+07 14145.9 1.88908e+07 14265.2 1.05021e+07 6839.81 1.67936e+07 7203.8 6.30784e+06 1456.17 1.05021e+07 1275.03 1.05021e+07 1291.12 1.05021e+07 830593 1.18037e+06 8.15394e+06 3.16235e+07
77151 20231012.4 0.778621 17109.5 43692.3 46548.2 17205.3 18575.2 4428.27 3710.96 3759.24 40524 5665.85 8.59996e+07 14083.6 1.67936e+07 14213.5 1.05021e+07 6913.46 1.88908e+07 7207.5 6.30784e+06 1460.52 1.05021e+07 1290.17 1.05021e+07 1306.04 1.05021e+07 834428 1.17973e+06 8.14949e+06 3.06711e+07
77198 20231013.2 0.787261 17262.9 43684.6 46802.9 17059.9 19065 4413.96 3698.72 3756.52 39916.8 5622.53 8.59996e+07 14098.5 1.88908e+07 14250.2 1.05021e+07 6890.78 1.88908e+07 7251.2 6.30784e+06 1460.18 1.05021e+07 1275.87 1.05021e+07 1303.97 1.05021e+07 828399 1.18608e+06 8.17304e+06 3.06918e+07
77230 20231016.2 0.777841 17121.3 43703.4 46945.7 16904.9 18828.1 4438.99 3724.28 3789.57 45076.8 5623.42 8.59996e+07 14053.7 1.88908e+07 14246.7 1.05021e+07 6881.04 1.67936e+07 7263.4 6.30784e+06 1464.6 1.05021e+07 1284.76 1.05021e+07 1303.83 1.05021e+07 838624 1.18017e+06 8.15079e+06 3.08016e+07
77301 20231017.2 0.785227 17423.7 43905.1 46952.5 17180.6 18623.7 4446.66 3717.65 3786.36 45594 5553.28 8.59996e+07 14026.7 1.88908e+07 14219.3 1.05021e+07 6831.38 1.67936e+07 7232.6 6.30784e+06 1459.17 1.05021e+07 1277.06 1.05021e+07 1301.17 1.05021e+07 840943 1.17774e+06 8.17186e+06 3.13174e+07
77356 20231018.3 0.780978 17494.2 45538.5 46974.8 17097.4 18991.9 4446.16 3446.69 3790.19 44978.1 5627.65 8.59996e+07 14031.2 1.88908e+07 14234.3 1.05021e+07 7265.93 1.67936e+07 7191.4 6.30784e+06 1465.85 1.05021e+07 1221.5 1.05021e+07 1290.4 1.05021e+07 829081 1.17576e+06 8.1555e+06 3.08267e+07
77403 20231019.1 0.801122 17712.7 45658 47188.5 17142.5 18950.1 4272.84 3460.76 3617.67 44514.2 5606.74 8.59996e+07 14045 1.67936e+07 14220.6 1.05021e+07 6855.95 1.88908e+07 7193.6 6.30784e+06 1466.9 1.05021e+07 1215.22 1.05021e+07 1307.36 1.05021e+07 825308 1.17638e+06 8.15527e+06 3.08564e+07

backport/release/4.x/pr-5692

build_id build_number Commit latency factor tpcc_virtual_cft^ tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_virtual_cft^ pi_ls_virtual_cft^ ls_jwt_virtual_cft^ pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_sgx_cft^ ls_sgx_cft_mem pi_ls_sgx_cft^ pi_ls_sgx_cft_mem ls_full_js_virtual_cft^ ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_js_jwt_virtual_cft^ ls_js_sgx_cft^ ls_js_sgx_cft_mem hist_sgx_cft^ ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^
77387 20231018.14 0.779182 17170.3 5640.54 8.59996e+07 45652.5 46792.6 17063.1 19049.8 4429.47 14085.4 1.88908e+07 14208.3 1.05021e+07 3458.47 6842.09 1.67936e+07 7235 6.30784e+06 3761.26 1461.47 1.05021e+07 39322.7 1222.97 1.05021e+07 1288.05 1.05021e+07 837795 1.18695e+06 8.17245e+06 3.03632e+07
77415 20231019.6 0.771026 17116.8 5576.19 8.59996e+07 43838.2 46950.3 17164.5 18804.7 4382.25 14086.6 1.88908e+07 14211.1 1.05021e+07 3465.63 6835.67 1.88908e+07 7198.5 6.30784e+06 3641.96 1464.74 1.05021e+07 45948.5 1211.04 1.05021e+07 1289.32 1.05021e+07 835461 1.17301e+06 8.16867e+06 3.09216e+07

images

@achamayou achamayou merged commit f9e853d into microsoft:release/4.x Oct 19, 2023
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@eddyashton eddyashton eddyashton approved these changes

Assignees
No one assigned
Labels
4.x-backport Highlights PRs targeting the 4.x branch
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@achamayou @ccf-bot @eddyashton