Make various compiler optimisations configurable#536
Merged
Conversation
Closed
Mainly for pre-compilation, but inherit some other ones from the linked branch too. See: #374 Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
d26e6bf to
e1a0f08
Compare
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: e1a0f08 | Previous: b877570 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
2775217788.0000205 ns/iter |
2768041733.000018 ns/iter |
1.00 |
E2E_Compiler_ansible_meta |
60579860.99999756 ns/iter |
61216563.00000083 ns/iter |
0.99 |
E2E_Compiler_aws_cdk |
1145323.9525368328 ns/iter |
1163471.1474036698 ns/iter |
0.98 |
E2E_Compiler_babelrc |
11178684.492064247 ns/iter |
11163908.737705138 ns/iter |
1.00 |
E2E_Compiler_clang_format |
50601312.35714494 ns/iter |
51207897.714285925 ns/iter |
0.99 |
E2E_Compiler_cmake_presets |
1578194291.0000453 ns/iter |
1570842023.0000114 ns/iter |
1.00 |
E2E_Compiler_code_climate |
7762866.0999999335 ns/iter |
7777880.7159089325 ns/iter |
1.00 |
E2E_Compiler_cql2 |
226305728.99998924 ns/iter |
229527090.3333441 ns/iter |
0.99 |
E2E_Compiler_cspell |
235608824.33334503 ns/iter |
235418794.66665706 ns/iter |
1.00 |
E2E_Compiler_cypress |
28866329.041666936 ns/iter |
28565727.3333347 ns/iter |
1.01 |
E2E_Compiler_deno |
25834843.88461644 ns/iter |
25973447.259258576 ns/iter |
0.99 |
E2E_Compiler_dependabot |
10998078.312500326 ns/iter |
11088978.01612883 ns/iter |
0.99 |
E2E_Compiler_draft_04 |
54771629.8181833 ns/iter |
54756514.46153926 ns/iter |
1.00 |
E2E_Compiler_fabric_mod |
22394386.48387059 ns/iter |
22364185.967741113 ns/iter |
1.00 |
E2E_Compiler_geojson |
54278770.30769406 ns/iter |
54402643.46153666 ns/iter |
1.00 |
E2E_Compiler_gitpod_configuration |
23472346.699999966 ns/iter |
23117315.100000724 ns/iter |
1.02 |
E2E_Compiler_helm_chart_lock |
4302953.4355828855 ns/iter |
4205636.365853485 ns/iter |
1.02 |
E2E_Compiler_importmap |
1565608.2566964459 ns/iter |
1528867.8185840906 ns/iter |
1.02 |
E2E_Compiler_jasmine |
5306037.757575819 ns/iter |
5241153.962963045 ns/iter |
1.01 |
E2E_Compiler_jshintrc |
15579568.355555138 ns/iter |
15190606.466666799 ns/iter |
1.03 |
E2E_Compiler_jsconfig |
56896225.74999949 ns/iter |
56706239.666667104 ns/iter |
1.00 |
E2E_Compiler_krakend |
737934550.0000341 ns/iter |
728762694.000011 ns/iter |
1.01 |
E2E_Compiler_lazygit |
109381550.6666734 ns/iter |
108257611.16666399 ns/iter |
1.01 |
E2E_Compiler_lerna |
5863437.697478887 ns/iter |
5835097.8050848 ns/iter |
1.00 |
E2E_Compiler_nest_cli |
33546346.90476219 ns/iter |
32743866.047618598 ns/iter |
1.02 |
E2E_Compiler_omc |
2784994084.0000043 ns/iter |
2759960896.9999847 ns/iter |
1.01 |
E2E_Compiler_omnisharp |
19229058.611110695 ns/iter |
18867000.52777712 ns/iter |
1.02 |
E2E_Compiler_openapi |
1539849994.9999974 ns/iter |
1490284151.0000257 ns/iter |
1.03 |
E2E_Compiler_pre_commit_hooks |
9142293.012820492 ns/iter |
8914555.884615537 ns/iter |
1.03 |
E2E_Compiler_pulumi |
14927186.00000086 ns/iter |
14915016.106383374 ns/iter |
1.00 |
E2E_Compiler_semantic_release |
4200743.604790504 ns/iter |
4197198.371257346 ns/iter |
1.00 |
E2E_Compiler_stale |
4310760.320754739 ns/iter |
4309874.583850897 ns/iter |
1.00 |
E2E_Compiler_stylecop |
16676344.023809839 ns/iter |
16544094.047618719 ns/iter |
1.01 |
E2E_Compiler_tmuxinator |
5737310.975206591 ns/iter |
5806085.074380383 ns/iter |
0.99 |
E2E_Compiler_ui5 |
338349020.9999991 ns/iter |
337157960.4999795 ns/iter |
1.00 |
E2E_Compiler_ui5_manifest |
4516545669.99997 ns/iter |
4397318927.999948 ns/iter |
1.03 |
E2E_Compiler_unreal_engine_uproject |
16713294.738095675 ns/iter |
16921223.439025164 ns/iter |
0.99 |
E2E_Compiler_vercel |
54496231.230770655 ns/iter |
54157641.15384893 ns/iter |
1.01 |
E2E_Compiler_yamllint |
7200081.886598006 ns/iter |
7198011.937499989 ns/iter |
1.00 |
E2E_Evaluator_adaptivecard |
53026.224414870776 ns/iter |
51949.649446218835 ns/iter |
1.02 |
E2E_Evaluator_ansible_meta |
328067.0524849052 ns/iter |
322444.392463245 ns/iter |
1.02 |
E2E_Evaluator_aws_cdk |
67903.14528845879 ns/iter |
66998.98670061973 ns/iter |
1.01 |
E2E_Evaluator_babelrc |
158686.16350764822 ns/iter |
157922.09547959728 ns/iter |
1.00 |
E2E_Evaluator_clang_format |
135046.45708236564 ns/iter |
134445.2371732839 ns/iter |
1.00 |
E2E_Evaluator_cmake_presets |
5334889.201680592 ns/iter |
5305356.511278257 ns/iter |
1.01 |
E2E_Evaluator_code_climate |
270503.560985003 ns/iter |
268908.39716041496 ns/iter |
1.01 |
E2E_Evaluator_cql2 |
271504.46489859663 ns/iter |
274543.002744014 ns/iter |
0.99 |
E2E_Evaluator_cspell |
993306.4281566847 ns/iter |
996010.0968660974 ns/iter |
1.00 |
E2E_Evaluator_cypress |
226907.36823339516 ns/iter |
229488.94827585752 ns/iter |
0.99 |
E2E_Evaluator_deno |
564538.31840392 ns/iter |
565978.697975673 ns/iter |
1.00 |
E2E_Evaluator_dependabot |
546134.4745895435 ns/iter |
543155.1172360319 ns/iter |
1.01 |
E2E_Evaluator_draft_04 |
8107779.301204541 ns/iter |
8167015.62500002 ns/iter |
0.99 |
E2E_Evaluator_fabric_mod |
1276803.9747748098 ns/iter |
1271065.0089928776 ns/iter |
1.00 |
E2E_Evaluator_geojson |
25743798.071427397 ns/iter |
25154281.89285883 ns/iter |
1.02 |
E2E_Evaluator_gitpod_configuration |
328445.2538787189 ns/iter |
327481.4320297653 ns/iter |
1.00 |
E2E_Evaluator_helm_chart_lock |
445383.554493328 ns/iter |
443928.96298618277 ns/iter |
1.00 |
E2E_Evaluator_importmap |
70312.3778614592 ns/iter |
69545.99502031803 ns/iter |
1.01 |
E2E_Evaluator_jasmine |
166919.05169551083 ns/iter |
158741.7514491084 ns/iter |
1.05 |
E2E_Evaluator_jshintrc |
1317059.490530232 ns/iter |
1316719.821229179 ns/iter |
1.00 |
E2E_Evaluator_jsconfig |
686644.2246305067 ns/iter |
684724.0696761326 ns/iter |
1.00 |
E2E_Evaluator_krakend |
339549.4405867905 ns/iter |
335182.20408163505 ns/iter |
1.01 |
E2E_Evaluator_lazygit |
221720.6492561041 ns/iter |
213937.30557274353 ns/iter |
1.04 |
E2E_Evaluator_lerna |
194614.28417860664 ns/iter |
192063.54266117347 ns/iter |
1.01 |
E2E_Evaluator_nest_cli |
253782.76171592475 ns/iter |
248257.59185841083 ns/iter |
1.02 |
E2E_Evaluator_omc |
30076.115626861505 ns/iter |
29909.29266615054 ns/iter |
1.01 |
E2E_Evaluator_omnisharp |
716049.941717839 ns/iter |
698045.461847364 ns/iter |
1.03 |
E2E_Evaluator_openapi |
19157353.42105276 ns/iter |
20114828.18918897 ns/iter |
0.95 |
E2E_Evaluator_pre_commit_hooks |
605952.344104792 ns/iter |
623719.69303519 ns/iter |
0.97 |
E2E_Evaluator_pulumi |
834576.1396449852 ns/iter |
836523.3428571898 ns/iter |
1.00 |
E2E_Evaluator_semantic_release |
138667.99626058055 ns/iter |
136551.0974000831 ns/iter |
1.02 |
E2E_Evaluator_stale |
166683.35909409798 ns/iter |
164680.5665649295 ns/iter |
1.01 |
E2E_Evaluator_stylecop |
530664.2528648078 ns/iter |
512376.79441996606 ns/iter |
1.04 |
E2E_Evaluator_tmuxinator |
135726.83994580756 ns/iter |
133338.25434289768 ns/iter |
1.02 |
E2E_Evaluator_ui5 |
774170.9790055347 ns/iter |
761067.483801342 ns/iter |
1.02 |
E2E_Evaluator_ui5_manifest |
4779421.421768675 ns/iter |
4707043.599999755 ns/iter |
1.02 |
E2E_Evaluator_unreal_engine_uproject |
670801.7631578804 ns/iter |
658474.2637464829 ns/iter |
1.02 |
E2E_Evaluator_vercel |
387434.6328690565 ns/iter |
386515.33443889813 ns/iter |
1.00 |
E2E_Evaluator_yamllint |
16200.417561244172 ns/iter |
16053.44626771263 ns/iter |
1.01 |
Micro_Draft4_Meta_1_No_Callback |
273.7089499672607 ns/iter |
273.38745071591865 ns/iter |
1.00 |
Micro_Draft4_Required_Properties |
694.6328729431629 ns/iter |
669.1933402552677 ns/iter |
1.04 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
32.789827373694656 ns/iter |
33.8057544241676 ns/iter |
0.97 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
14.640501268462698 ns/iter |
14.931227892014906 ns/iter |
0.98 |
Micro_Draft4_Items_Schema |
631.8463031658096 ns/iter |
617.2270063669521 ns/iter |
1.02 |
Micro_Draft4_Nested_Object |
6.559889515720405 ns/iter |
6.224017704473361 ns/iter |
1.05 |
Micro_Draft4_Properties_Triad_Optional |
891.5167460177353 ns/iter |
884.0743574980459 ns/iter |
1.01 |
Micro_Draft4_Properties_Triad_Closed |
704.6616754419907 ns/iter |
699.7917028650503 ns/iter |
1.01 |
Micro_Draft4_Properties_Triad_Required |
1000.3648034743801 ns/iter |
890.6931522199942 ns/iter |
1.12 |
Micro_Draft4_Properties_Closed |
86.28220752474921 ns/iter |
86.41581935641078 ns/iter |
1.00 |
Micro_Draft4_Non_Recursive_Ref |
33.593765398843935 ns/iter |
33.90690175205374 ns/iter |
0.99 |
Micro_Draft4_Pattern_Properties_True |
248.8648506129168 ns/iter |
241.74657955267017 ns/iter |
1.03 |
Micro_Draft4_Ref_To_Single_Property |
14.629845583909832 ns/iter |
14.952782682546104 ns/iter |
0.98 |
Micro_Draft4_Additional_Properties_Type |
62.48164217760413 ns/iter |
62.832609376910604 ns/iter |
0.99 |
Micro_Draft4_Nested_Oneof |
87.03216025439635 ns/iter |
86.455359170345 ns/iter |
1.01 |
Micro_Draft4_Short_Enum |
17.487767901225194 ns/iter |
18.044619982849156 ns/iter |
0.97 |
Micro_Draft4_Long_Enum |
21.873694944000558 ns/iter |
20.54154454528764 ns/iter |
1.06 |
Micro_Draft4_Long_Enum_Short_Strings |
17.42916287424242 ns/iter |
17.418905671393958 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
11.829875280637397 ns/iter |
11.82404759362387 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
16430080.60465078 ns/iter |
16048184.068182535 ns/iter |
1.02 |
Micro_Draft4_Ref_Many_Nested |
9884627781.000006 ns/iter |
9670040728.999992 ns/iter |
1.02 |
Micro_Draft6_Property_Names |
148.26446957595454 ns/iter |
128.50232706228434 ns/iter |
1.15 |
Micro_Draft7_If_Then_Else |
42.02822278686206 ns/iter |
40.46174195263101 ns/iter |
1.04 |
Micro_2019_09_Unevaluated_Properties |
54.79714490089353 ns/iter |
59.52594459461053 ns/iter |
0.92 |
Micro_2020_12_Dynamic_Ref |
534.5347013168077 ns/iter |
556.8684064195012 ns/iter |
0.96 |
Micro_2020_12_Dynamic_Ref_Single |
11.82801274944679 ns/iter |
11.515556034523224 ns/iter |
1.03 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: d26e6bf | Previous: b877570 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
3677570584.000023 ns/iter |
3361391374.9999256 ns/iter |
1.09 |
E2E_Compiler_ansible_meta |
72303180.5555618 ns/iter |
89371995.3333453 ns/iter |
0.81 |
E2E_Compiler_aws_cdk |
1306147.9287019956 ns/iter |
1482862.4095427087 ns/iter |
0.88 |
E2E_Compiler_babelrc |
10502898.230769757 ns/iter |
15103442.791044798 ns/iter |
0.70 |
E2E_Compiler_clang_format |
54664738.14285726 ns/iter |
54842241.66666535 ns/iter |
1.00 |
E2E_Compiler_cmake_presets |
1524319416.0000257 ns/iter |
1841311292.0000002 ns/iter |
0.83 |
E2E_Compiler_code_climate |
9813124.034483463 ns/iter |
11664957.40000073 ns/iter |
0.84 |
E2E_Compiler_cql2 |
199264208.33333698 ns/iter |
241590986.0000056 ns/iter |
0.82 |
E2E_Compiler_cspell |
215037402.66666684 ns/iter |
299873416.66666603 ns/iter |
0.72 |
E2E_Compiler_cypress |
29916118.05555294 ns/iter |
41266985.07142886 ns/iter |
0.72 |
E2E_Compiler_deno |
32831459.821429525 ns/iter |
37123193.749999925 ns/iter |
0.88 |
E2E_Compiler_dependabot |
13928761.701755207 ns/iter |
14585184.514284523 ns/iter |
0.95 |
E2E_Compiler_draft_04 |
70472343.7499979 ns/iter |
80856408.29999647 ns/iter |
0.87 |
E2E_Compiler_fabric_mod |
30213670.61904541 ns/iter |
31393101.434787244 ns/iter |
0.96 |
E2E_Compiler_geojson |
79444321.42856582 ns/iter |
94620802.00000855 ns/iter |
0.84 |
E2E_Compiler_gitpod_configuration |
27463291.66666749 ns/iter |
34898278.40909563 ns/iter |
0.79 |
E2E_Compiler_helm_chart_lock |
5121796.153845865 ns/iter |
5413037.499999973 ns/iter |
0.95 |
E2E_Compiler_importmap |
2022337.087209354 ns/iter |
1972784.3070652818 ns/iter |
1.03 |
E2E_Compiler_jasmine |
7037298.168832528 ns/iter |
11207175.600001004 ns/iter |
0.63 |
E2E_Compiler_jshintrc |
23705586.20689986 ns/iter |
26069449.99999996 ns/iter |
0.91 |
E2E_Compiler_jsconfig |
83794713.00000003 ns/iter |
79405949.11111829 ns/iter |
1.06 |
E2E_Compiler_krakend |
1079349124.999908 ns/iter |
1039807249.9999671 ns/iter |
1.04 |
E2E_Compiler_lazygit |
131523349.99999766 ns/iter |
168291624.99999484 ns/iter |
0.78 |
E2E_Compiler_lerna |
5348195.161765127 ns/iter |
7119939.705882965 ns/iter |
0.75 |
E2E_Compiler_nest_cli |
33938902.749999516 ns/iter |
65087718.75000008 ns/iter |
0.52 |
E2E_Compiler_omc |
2810255208.9999337 ns/iter |
2611198917.0000243 ns/iter |
1.08 |
E2E_Compiler_omnisharp |
19619860.025640123 ns/iter |
17390518.857141722 ns/iter |
1.13 |
E2E_Compiler_openapi |
1353725374.9999535 ns/iter |
1268033875.0000145 ns/iter |
1.07 |
E2E_Compiler_pre_commit_hooks |
11413031.818181645 ns/iter |
8146250.0000003 ns/iter |
1.40 |
E2E_Compiler_pulumi |
14223956.521739775 ns/iter |
12870853.723404465 ns/iter |
1.11 |
E2E_Compiler_semantic_release |
5816137.898810054 ns/iter |
4067679.285714283 ns/iter |
1.43 |
E2E_Compiler_stale |
6048210.688679516 ns/iter |
4268640.459119964 ns/iter |
1.42 |
E2E_Compiler_stylecop |
17734557.888887692 ns/iter |
16134000.000000054 ns/iter |
1.10 |
E2E_Compiler_tmuxinator |
6935812.8750006845 ns/iter |
5741106.670000136 ns/iter |
1.21 |
E2E_Compiler_ui5 |
411584270.5000432 ns/iter |
410918353.999989 ns/iter |
1.00 |
E2E_Compiler_ui5_manifest |
4795269666.999957 ns/iter |
5015667874.999963 ns/iter |
0.96 |
E2E_Compiler_unreal_engine_uproject |
17942937.04255508 ns/iter |
20405109.657896277 ns/iter |
0.88 |
E2E_Compiler_vercel |
55487781.24999861 ns/iter |
72318069.44445099 ns/iter |
0.77 |
E2E_Compiler_yamllint |
7609026.468749392 ns/iter |
9281642.936709339 ns/iter |
0.82 |
E2E_Evaluator_adaptivecard |
53483.216699999044 ns/iter |
49967.513882227744 ns/iter |
1.07 |
E2E_Evaluator_ansible_meta |
217605.35175474 ns/iter |
259122.77253666634 ns/iter |
0.84 |
E2E_Evaluator_aws_cdk |
51261.92500000571 ns/iter |
44185.048683635374 ns/iter |
1.16 |
E2E_Evaluator_babelrc |
108918.0688389217 ns/iter |
104545.818598452 ns/iter |
1.04 |
E2E_Evaluator_clang_format |
114902.91592860223 ns/iter |
96183.65702255911 ns/iter |
1.19 |
E2E_Evaluator_cmake_presets |
6854102.296551901 ns/iter |
6825275.420000025 ns/iter |
1.00 |
E2E_Evaluator_code_climate |
308645.0244841123 ns/iter |
258899.93222466463 ns/iter |
1.19 |
E2E_Evaluator_cql2 |
258081.51973302572 ns/iter |
304715.0706436598 ns/iter |
0.85 |
E2E_Evaluator_cspell |
724396.9081761158 ns/iter |
1041326.7868452517 ns/iter |
0.70 |
E2E_Evaluator_cypress |
213251.89058854728 ns/iter |
205195.62167750148 ns/iter |
1.04 |
E2E_Evaluator_deno |
380220.62431847246 ns/iter |
543728.382001821 ns/iter |
0.70 |
E2E_Evaluator_dependabot |
426371.8224680473 ns/iter |
520701.8797554837 ns/iter |
0.82 |
E2E_Evaluator_draft_04 |
7028916.288288553 ns/iter |
7435903.017240803 ns/iter |
0.95 |
E2E_Evaluator_fabric_mod |
1717324.3118556277 ns/iter |
2007334.0455839047 ns/iter |
0.86 |
E2E_Evaluator_geojson |
20271452.65908943 ns/iter |
13838135.423076035 ns/iter |
1.46 |
E2E_Evaluator_gitpod_configuration |
236114.67795547922 ns/iter |
192926.32700769778 ns/iter |
1.22 |
E2E_Evaluator_helm_chart_lock |
392220.03730799776 ns/iter |
260713.88163885014 ns/iter |
1.50 |
E2E_Evaluator_importmap |
68380.68453329182 ns/iter |
40304.93575273235 ns/iter |
1.70 |
E2E_Evaluator_jasmine |
114715.87756612476 ns/iter |
110715.98148147906 ns/iter |
1.04 |
E2E_Evaluator_jshintrc |
1107290.196743598 ns/iter |
960544.5804195656 ns/iter |
1.15 |
E2E_Evaluator_jsconfig |
516992.63359996624 ns/iter |
521862.25000002654 ns/iter |
0.99 |
E2E_Evaluator_krakend |
260866.60195483116 ns/iter |
251291.01256109605 ns/iter |
1.04 |
E2E_Evaluator_lazygit |
127027.599888688 ns/iter |
157075.0335353562 ns/iter |
0.81 |
E2E_Evaluator_lerna |
172160.64682850539 ns/iter |
148945.71930251588 ns/iter |
1.16 |
E2E_Evaluator_nest_cli |
199481.5628815572 ns/iter |
185208.73855278088 ns/iter |
1.08 |
E2E_Evaluator_omc |
23947.487047883333 ns/iter |
31495.657744915054 ns/iter |
0.76 |
E2E_Evaluator_omnisharp |
551295.8034800894 ns/iter |
756564.0076755518 ns/iter |
0.73 |
E2E_Evaluator_openapi |
13013600.911110897 ns/iter |
10491478.10169485 ns/iter |
1.24 |
E2E_Evaluator_pre_commit_hooks |
517618.13368627464 ns/iter |
371152.44070603565 ns/iter |
1.39 |
E2E_Evaluator_pulumi |
832522.830065274 ns/iter |
570345.0466926378 ns/iter |
1.46 |
E2E_Evaluator_semantic_release |
159025.50973964971 ns/iter |
94696.61376572386 ns/iter |
1.68 |
E2E_Evaluator_stale |
154797.0553971562 ns/iter |
107459.98662207591 ns/iter |
1.44 |
E2E_Evaluator_stylecop |
523517.4169999937 ns/iter |
320753.5797165321 ns/iter |
1.63 |
E2E_Evaluator_tmuxinator |
129692.36796733079 ns/iter |
85725.60326472775 ns/iter |
1.51 |
E2E_Evaluator_ui5 |
1021947.878824978 ns/iter |
660212.9972248042 ns/iter |
1.55 |
E2E_Evaluator_ui5_manifest |
3845954.7991069243 ns/iter |
4322688.9400921 ns/iter |
0.89 |
E2E_Evaluator_unreal_engine_uproject |
650038.8318356951 ns/iter |
575218.5340236137 ns/iter |
1.13 |
E2E_Evaluator_vercel |
382509.6736441442 ns/iter |
318271.4947089763 ns/iter |
1.20 |
E2E_Evaluator_yamllint |
17128.10682029119 ns/iter |
13850.853883611815 ns/iter |
1.24 |
Micro_Draft4_Meta_1_No_Callback |
303.2096140882364 ns/iter |
236.78599597894706 ns/iter |
1.28 |
Micro_Draft4_Required_Properties |
819.3612818776442 ns/iter |
562.8942858829239 ns/iter |
1.46 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
30.355172621601536 ns/iter |
26.447427634485354 ns/iter |
1.15 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
8.531356586588082 ns/iter |
9.568048501806052 ns/iter |
0.89 |
Micro_Draft4_Items_Schema |
474.760323253323 ns/iter |
502.0479999999452 ns/iter |
0.95 |
Micro_Draft4_Nested_Object |
2.9770650016334037 ns/iter |
3.1655983260038156 ns/iter |
0.94 |
Micro_Draft4_Properties_Triad_Optional |
675.1419467534332 ns/iter |
650.1274081656492 ns/iter |
1.04 |
Micro_Draft4_Properties_Triad_Closed |
500.9454976356028 ns/iter |
538.1854952708333 ns/iter |
0.93 |
Micro_Draft4_Properties_Triad_Required |
625.1640345394061 ns/iter |
652.7205907254179 ns/iter |
0.96 |
Micro_Draft4_Properties_Closed |
44.02638675268767 ns/iter |
48.267279366952565 ns/iter |
0.91 |
Micro_Draft4_Non_Recursive_Ref |
17.80672064633372 ns/iter |
18.589668399041905 ns/iter |
0.96 |
Micro_Draft4_Pattern_Properties_True |
140.1746745510607 ns/iter |
158.0874296806286 ns/iter |
0.89 |
Micro_Draft4_Ref_To_Single_Property |
7.325920224559707 ns/iter |
8.195341425023782 ns/iter |
0.89 |
Micro_Draft4_Additional_Properties_Type |
33.40803947367647 ns/iter |
35.330440616516036 ns/iter |
0.95 |
Micro_Draft4_Nested_Oneof |
64.14652854958163 ns/iter |
54.878218883175826 ns/iter |
1.17 |
Micro_Draft4_Short_Enum |
12.72313253281979 ns/iter |
9.018275985990014 ns/iter |
1.41 |
Micro_Draft4_Long_Enum |
25.68255696921811 ns/iter |
28.59553763167656 ns/iter |
0.90 |
Micro_Draft4_Long_Enum_Short_Strings |
13.79788930592942 ns/iter |
13.983276185234269 ns/iter |
0.99 |
Micro_Draft4_Type_Object |
6.609391135900159 ns/iter |
7.3470151384246805 ns/iter |
0.90 |
Micro_Draft4_Ref_Single_100 |
22358157.714283574 ns/iter |
20101597.212122656 ns/iter |
1.11 |
Micro_Draft4_Ref_Many_Nested |
9813323625.000067 ns/iter |
9922840208.000025 ns/iter |
0.99 |
Micro_Draft6_Property_Names |
98.48547406142731 ns/iter |
104.09238498910501 ns/iter |
0.95 |
Micro_Draft7_If_Then_Else |
26.434149160804086 ns/iter |
33.385696867029644 ns/iter |
0.79 |
Micro_2019_09_Unevaluated_Properties |
41.20885208166787 ns/iter |
38.93070170754456 ns/iter |
1.06 |
Micro_2020_12_Dynamic_Ref |
394.6684223260825 ns/iter |
440.39257414939306 ns/iter |
0.90 |
Micro_2020_12_Dynamic_Ref_Single |
5.716009292972422 ns/iter |
7.503893948815704 ns/iter |
0.76 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: e1a0f08 | Previous: b877570 | Ratio |
|---|---|---|---|
Micro_2020_12_Dynamic_Ref |
630.7785257583779 ns/iter |
615.7936014911473 ns/iter |
1.02 |
Micro_2020_12_Dynamic_Ref_Single |
11.998472389327974 ns/iter |
10.67559112139068 ns/iter |
1.12 |
Micro_2019_09_Unevaluated_Properties |
57.08992332877895 ns/iter |
54.34468269992609 ns/iter |
1.05 |
Micro_Draft7_If_Then_Else |
46.64650438022385 ns/iter |
45.49485530584541 ns/iter |
1.03 |
Micro_Draft6_Property_Names |
165.81489248977695 ns/iter |
159.20592980583416 ns/iter |
1.04 |
Micro_Draft4_Meta_1_No_Callback |
242.09817667587419 ns/iter |
242.60521355922486 ns/iter |
1.00 |
Micro_Draft4_Required_Properties |
539.0006947373297 ns/iter |
548.390208686535 ns/iter |
0.98 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
32.33672810701524 ns/iter |
31.80704398415485 ns/iter |
1.02 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
13.582325432619502 ns/iter |
12.94931724196269 ns/iter |
1.05 |
Micro_Draft4_Items_Schema |
513.0148118208836 ns/iter |
499.8723439187113 ns/iter |
1.03 |
Micro_Draft4_Nested_Object |
6.34460845006061 ns/iter |
6.029912310866859 ns/iter |
1.05 |
Micro_Draft4_Properties_Triad_Optional |
1108.6488087890305 ns/iter |
1026.2212654441785 ns/iter |
1.08 |
Micro_Draft4_Properties_Triad_Closed |
888.3887874715747 ns/iter |
818.8462086915272 ns/iter |
1.08 |
Micro_Draft4_Properties_Triad_Required |
1127.2960875715523 ns/iter |
1044.3046001578518 ns/iter |
1.08 |
Micro_Draft4_Properties_Closed |
78.35172823601447 ns/iter |
76.14435840034643 ns/iter |
1.03 |
Micro_Draft4_Non_Recursive_Ref |
14.125709386942699 ns/iter |
13.516819978459306 ns/iter |
1.05 |
Micro_Draft4_Pattern_Properties_True |
238.98778859107625 ns/iter |
249.6947565013706 ns/iter |
0.96 |
Micro_Draft4_Ref_To_Single_Property |
13.605549200162349 ns/iter |
12.984760428757744 ns/iter |
1.05 |
Micro_Draft4_Additional_Properties_Type |
17.11332153770354 ns/iter |
16.306526163493153 ns/iter |
1.05 |
Micro_Draft4_Nested_Oneof |
112.57599069580475 ns/iter |
114.05960778985646 ns/iter |
0.99 |
Micro_Draft4_Short_Enum |
18.719306921213047 ns/iter |
18.734104214989657 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
22.410693093078816 ns/iter |
24.427167155465103 ns/iter |
0.92 |
Micro_Draft4_Long_Enum_Short_Strings |
18.75329143992405 ns/iter |
18.723847335907994 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
11.954355789781866 ns/iter |
10.705972221505125 ns/iter |
1.12 |
Micro_Draft4_Ref_Single_100 |
17248943.390244476 ns/iter |
17137714.000000417 ns/iter |
1.01 |
Micro_Draft4_Ref_Many_Nested |
11343040038.000027 ns/iter |
10982495939.000046 ns/iter |
1.03 |
E2E_Compiler_adaptivecard |
2923998915.9999595 ns/iter |
2858479955.000007 ns/iter |
1.02 |
E2E_Compiler_ansible_meta |
67734383.18182136 ns/iter |
67287675.60000506 ns/iter |
1.01 |
E2E_Compiler_aws_cdk |
1283517.8697247487 ns/iter |
1257081.726618721 ns/iter |
1.02 |
E2E_Compiler_babelrc |
12429280.625001734 ns/iter |
12034862.947368644 ns/iter |
1.03 |
E2E_Compiler_clang_format |
56163454.583336644 ns/iter |
55088329.153844684 ns/iter |
1.02 |
E2E_Compiler_cmake_presets |
1707114267.999941 ns/iter |
1681744266.999999 ns/iter |
1.02 |
E2E_Compiler_code_climate |
8711856.135801662 ns/iter |
8530849.085365467 ns/iter |
1.02 |
E2E_Compiler_cql2 |
256948374.3333573 ns/iter |
256746243.3333579 ns/iter |
1.00 |
E2E_Compiler_cspell |
254363860.66667184 ns/iter |
250073507.00002465 ns/iter |
1.02 |
E2E_Compiler_cypress |
31592299.72727024 ns/iter |
30764771.913042117 ns/iter |
1.03 |
E2E_Compiler_deno |
28473378.375001818 ns/iter |
28056770.91999769 ns/iter |
1.01 |
E2E_Compiler_dependabot |
12240257.701755421 ns/iter |
12047035.086207667 ns/iter |
1.02 |
E2E_Compiler_draft_04 |
61014315.09090493 ns/iter |
59576334.166668706 ns/iter |
1.02 |
E2E_Compiler_fabric_mod |
24666837.21428759 ns/iter |
24244674.689655233 ns/iter |
1.02 |
E2E_Compiler_geojson |
61797173.81818054 ns/iter |
60886591.83332842 ns/iter |
1.01 |
E2E_Compiler_gitpod_configuration |
25616097.888890482 ns/iter |
25362106.285712115 ns/iter |
1.01 |
E2E_Compiler_helm_chart_lock |
4716060.21621661 ns/iter |
4666271.346666994 ns/iter |
1.01 |
E2E_Compiler_importmap |
1696993.4866829487 ns/iter |
1682258.9064746546 ns/iter |
1.01 |
E2E_Compiler_jasmine |
5848554.957983193 ns/iter |
5779821.685950616 ns/iter |
1.01 |
E2E_Compiler_jshintrc |
16878597.99999983 ns/iter |
16827728.07142945 ns/iter |
1.00 |
E2E_Compiler_jsconfig |
63097056.45454952 ns/iter |
62327119.81818862 ns/iter |
1.01 |
E2E_Compiler_krakend |
793556518.9999352 ns/iter |
792926901.9999765 ns/iter |
1.00 |
E2E_Compiler_lazygit |
120486292.99999903 ns/iter |
119790263.50000292 ns/iter |
1.01 |
E2E_Compiler_lerna |
6471554.889908851 ns/iter |
6446361.174312187 ns/iter |
1.00 |
E2E_Compiler_nest_cli |
36717956.2631583 ns/iter |
36610004.15789467 ns/iter |
1.00 |
E2E_Compiler_omc |
3319038016.999912 ns/iter |
3290586147.9999886 ns/iter |
1.01 |
E2E_Compiler_omnisharp |
21046634.0909079 ns/iter |
20928098.454543363 ns/iter |
1.01 |
E2E_Compiler_openapi |
1734840953.9999921 ns/iter |
1735139975.0000381 ns/iter |
1.00 |
E2E_Compiler_pre_commit_hooks |
9997244.4225348 ns/iter |
9873553.943661982 ns/iter |
1.01 |
E2E_Compiler_pulumi |
16346972.534884753 ns/iter |
16153037.767441124 ns/iter |
1.01 |
E2E_Compiler_semantic_release |
4631556.90066221 ns/iter |
4580577.02614342 ns/iter |
1.01 |
E2E_Compiler_stale |
4709100.342282018 ns/iter |
4687544.966667095 ns/iter |
1.00 |
E2E_Compiler_stylecop |
18085825.256408636 ns/iter |
17726145.45000124 ns/iter |
1.02 |
E2E_Compiler_tmuxinator |
6320352.072072416 ns/iter |
6255475.378378758 ns/iter |
1.01 |
E2E_Compiler_ui5 |
363957601.00003827 ns/iter |
358326444.9999888 ns/iter |
1.02 |
E2E_Compiler_ui5_manifest |
4810534839.999946 ns/iter |
4711104215.999967 ns/iter |
1.02 |
E2E_Compiler_unreal_engine_uproject |
18274268.131581027 ns/iter |
18152714.66666556 ns/iter |
1.01 |
E2E_Compiler_vercel |
59400631.25000468 ns/iter |
59072026.916671425 ns/iter |
1.01 |
E2E_Compiler_yamllint |
8073734.395349336 ns/iter |
8120730.862069702 ns/iter |
0.99 |
E2E_Evaluator_adaptivecard |
58128.44493854645 ns/iter |
57074.79451170291 ns/iter |
1.02 |
E2E_Evaluator_ansible_meta |
321278.8320258025 ns/iter |
315929.4179775397 ns/iter |
1.02 |
E2E_Evaluator_aws_cdk |
57836.43199002134 ns/iter |
56965.24067524218 ns/iter |
1.02 |
E2E_Evaluator_babelrc |
145829.9293249097 ns/iter |
142013.1140065543 ns/iter |
1.03 |
E2E_Evaluator_clang_format |
113120.74660336175 ns/iter |
104123.37453738296 ns/iter |
1.09 |
E2E_Evaluator_cmake_presets |
6397752.384615912 ns/iter |
5134440.299270598 ns/iter |
1.25 |
E2E_Evaluator_code_climate |
234709.10932477165 ns/iter |
222229.3613337878 ns/iter |
1.06 |
E2E_Evaluator_cql2 |
289532.13267405337 ns/iter |
287504.4771699636 ns/iter |
1.01 |
E2E_Evaluator_cspell |
1071249.793478156 ns/iter |
1051803.2190331856 ns/iter |
1.02 |
E2E_Evaluator_cypress |
174774.02118749963 ns/iter |
170234.4255371524 ns/iter |
1.03 |
E2E_Evaluator_deno |
589881.0042301605 ns/iter |
566067.7654619014 ns/iter |
1.04 |
E2E_Evaluator_dependabot |
477786.9364754076 ns/iter |
470865.9696151712 ns/iter |
1.01 |
E2E_Evaluator_draft_04 |
9557489.028169021 ns/iter |
7660682.807229943 ns/iter |
1.25 |
E2E_Evaluator_fabric_mod |
1346512.0465115814 ns/iter |
1374825.687622694 ns/iter |
0.98 |
E2E_Evaluator_geojson |
21010489.484848276 ns/iter |
20786619.242423482 ns/iter |
1.01 |
E2E_Evaluator_gitpod_configuration |
297216.7678724882 ns/iter |
289994.13787442906 ns/iter |
1.02 |
E2E_Evaluator_helm_chart_lock |
363435.07340860844 ns/iter |
352694.5089909638 ns/iter |
1.03 |
E2E_Evaluator_importmap |
61866.82599375612 ns/iter |
59351.213218018354 ns/iter |
1.04 |
E2E_Evaluator_jasmine |
140795.62535438762 ns/iter |
139384.55027934222 ns/iter |
1.01 |
E2E_Evaluator_jshintrc |
992630.6107193202 ns/iter |
954180.98369563 ns/iter |
1.04 |
E2E_Evaluator_jsconfig |
741532.844008178 ns/iter |
689095.9370079642 ns/iter |
1.08 |
E2E_Evaluator_krakend |
342393.68347064516 ns/iter |
324887.3362789984 ns/iter |
1.05 |
E2E_Evaluator_lazygit |
201394.3468274353 ns/iter |
198191.41720371935 ns/iter |
1.02 |
E2E_Evaluator_lerna |
155612.88699360678 ns/iter |
145423.54480134748 ns/iter |
1.07 |
E2E_Evaluator_nest_cli |
232910.90757164828 ns/iter |
227179.2786567648 ns/iter |
1.03 |
E2E_Evaluator_omc |
29076.017814036473 ns/iter |
29321.868225119302 ns/iter |
0.99 |
E2E_Evaluator_omnisharp |
547441.0705973333 ns/iter |
538216.6955502607 ns/iter |
1.02 |
E2E_Evaluator_openapi |
19471140.611108873 ns/iter |
16980788.124999434 ns/iter |
1.15 |
E2E_Evaluator_pre_commit_hooks |
531899.6757782705 ns/iter |
519806.4618235772 ns/iter |
1.02 |
E2E_Evaluator_pulumi |
829157.8879618839 ns/iter |
812264.5302324959 ns/iter |
1.02 |
E2E_Evaluator_semantic_release |
140547.27766837567 ns/iter |
133639.2898550722 ns/iter |
1.05 |
E2E_Evaluator_stale |
148069.8017026587 ns/iter |
143968.56021261285 ns/iter |
1.03 |
E2E_Evaluator_stylecop |
536680.2041602028 ns/iter |
522390.4239050017 ns/iter |
1.03 |
E2E_Evaluator_tmuxinator |
127889.20553215829 ns/iter |
126763.30378375546 ns/iter |
1.01 |
E2E_Evaluator_ui5 |
781053.4488635828 ns/iter |
753189.6652267032 ns/iter |
1.04 |
E2E_Evaluator_ui5_manifest |
5734053.338709227 ns/iter |
5056282.036495401 ns/iter |
1.13 |
E2E_Evaluator_unreal_engine_uproject |
710984.1483006994 ns/iter |
697433.9769770197 ns/iter |
1.02 |
E2E_Evaluator_vercel |
343309.6874999932 ns/iter |
346830.21386133914 ns/iter |
0.99 |
E2E_Evaluator_yamllint |
14386.266076888838 ns/iter |
13543.451544943096 ns/iter |
1.06 |
This comment was automatically generated by workflow using github-action-benchmark.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Mainly for pre-compilation, but inherit some other ones from the linked
branch too.
See: #374
Signed-off-by: Juan Cruz Viotti jv@jviotti.com