Upgrade the JSON Schema Test Suite to 4cf559962d6dd01aa576e9b8889d771df70d9e50#542
Merged
Conversation
…1df70d9e50` Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: 7a9943e | Previous: be74b45 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
2838785934.9999757 ns/iter |
2822905625.0000324 ns/iter |
1.01 |
E2E_Compiler_ansible_meta |
62521518.63636548 ns/iter |
63063991.09090741 ns/iter |
0.99 |
E2E_Compiler_aws_cdk |
1176850.871355081 ns/iter |
1179534.5420239985 ns/iter |
1.00 |
E2E_Compiler_babelrc |
11424862.622951223 ns/iter |
11433668.065573793 ns/iter |
1.00 |
E2E_Compiler_clang_format |
52542751.3846134 ns/iter |
52645046.15384497 ns/iter |
1.00 |
E2E_Compiler_cmake_presets |
1595219887.9999743 ns/iter |
1598202243.9999924 ns/iter |
1.00 |
E2E_Compiler_code_climate |
7922344.114941923 ns/iter |
7791536.613636135 ns/iter |
1.02 |
E2E_Compiler_cql2 |
227673240.66668 ns/iter |
232767328.66666332 ns/iter |
0.98 |
E2E_Compiler_cspell |
238399919.33332765 ns/iter |
239558565.3333304 ns/iter |
1.00 |
E2E_Compiler_cypress |
29202884.125001088 ns/iter |
29398173.29166772 ns/iter |
0.99 |
E2E_Compiler_deno |
26307505.44444414 ns/iter |
26838551.230768487 ns/iter |
0.98 |
E2E_Compiler_dependabot |
11161879.064516252 ns/iter |
11322395.573770672 ns/iter |
0.99 |
E2E_Compiler_draft_04 |
55364583.25000145 ns/iter |
56293920.50000111 ns/iter |
0.98 |
E2E_Compiler_fabric_mod |
22843892.87096782 ns/iter |
23114558.2903236 ns/iter |
0.99 |
E2E_Compiler_geojson |
55673559.25000092 ns/iter |
56470294.16666764 ns/iter |
0.99 |
E2E_Compiler_gitpod_configuration |
23921986.48275835 ns/iter |
23888154.62069064 ns/iter |
1.00 |
E2E_Compiler_helm_chart_lock |
4414145.174999718 ns/iter |
4380088.670807367 ns/iter |
1.01 |
E2E_Compiler_importmap |
1587799.322727273 ns/iter |
1597746.0293453676 ns/iter |
0.99 |
E2E_Compiler_jasmine |
5371431.376923177 ns/iter |
5402750.32812465 ns/iter |
0.99 |
E2E_Compiler_jshintrc |
15831331.386364542 ns/iter |
15810624.454545064 ns/iter |
1.00 |
E2E_Compiler_jsconfig |
58730368.333333634 ns/iter |
58181076.666665874 ns/iter |
1.01 |
E2E_Compiler_krakend |
747328410.0000228 ns/iter |
736550637.9999828 ns/iter |
1.01 |
E2E_Compiler_lazygit |
111730253.49999458 ns/iter |
112485881.99999668 ns/iter |
0.99 |
E2E_Compiler_lerna |
5940217.04273473 ns/iter |
5996319.456896955 ns/iter |
0.99 |
E2E_Compiler_nest_cli |
34222823.47619221 ns/iter |
34875446.30000059 ns/iter |
0.98 |
E2E_Compiler_omc |
2813523297.0000176 ns/iter |
2878787590.000002 ns/iter |
0.98 |
E2E_Compiler_omnisharp |
19837545.999999814 ns/iter |
19680156.305556 ns/iter |
1.01 |
E2E_Compiler_openapi |
1544953625.000005 ns/iter |
1573561767.9999905 ns/iter |
0.98 |
E2E_Compiler_pre_commit_hooks |
9201499.02666708 ns/iter |
9355348.688311316 ns/iter |
0.98 |
E2E_Compiler_pulumi |
15227907.521738583 ns/iter |
15076592.195651736 ns/iter |
1.01 |
E2E_Compiler_semantic_release |
4243046.630303084 ns/iter |
4240702.932926657 ns/iter |
1.00 |
E2E_Compiler_stale |
4377429.658227702 ns/iter |
4375363.037266859 ns/iter |
1.00 |
E2E_Compiler_stylecop |
16964258.951218642 ns/iter |
16788428.57142946 ns/iter |
1.01 |
E2E_Compiler_tmuxinator |
5850468.188033861 ns/iter |
5864330.958333141 ns/iter |
1.00 |
E2E_Compiler_ui5 |
351099628.00001425 ns/iter |
344136252.49999315 ns/iter |
1.02 |
E2E_Compiler_ui5_manifest |
4485811721.000005 ns/iter |
4514987331.999975 ns/iter |
0.99 |
E2E_Compiler_unreal_engine_uproject |
17127480.365853146 ns/iter |
17091432.19512282 ns/iter |
1.00 |
E2E_Compiler_vercel |
55534692.66666866 ns/iter |
56343290.99999983 ns/iter |
0.99 |
E2E_Compiler_yamllint |
7289058.239583331 ns/iter |
7257652.0312495055 ns/iter |
1.00 |
E2E_Evaluator_adaptivecard |
54220.42598646399 ns/iter |
52319.68932185551 ns/iter |
1.04 |
E2E_Evaluator_ansible_meta |
332038.4853146704 ns/iter |
326786.1759517181 ns/iter |
1.02 |
E2E_Evaluator_aws_cdk |
67596.24677090356 ns/iter |
68074.15331873234 ns/iter |
0.99 |
E2E_Evaluator_babelrc |
158808.9288296453 ns/iter |
160631.63855145048 ns/iter |
0.99 |
E2E_Evaluator_clang_format |
136469.99649873792 ns/iter |
135603.08483440196 ns/iter |
1.01 |
E2E_Evaluator_cmake_presets |
5295849.689393649 ns/iter |
6431861.865384401 ns/iter |
0.82 |
E2E_Evaluator_code_climate |
266589.65106545115 ns/iter |
274300.91511627496 ns/iter |
0.97 |
E2E_Evaluator_cql2 |
277791.6020488611 ns/iter |
278792.20188529574 ns/iter |
1.00 |
E2E_Evaluator_cspell |
995252.7911931888 ns/iter |
995680.3517730057 ns/iter |
1.00 |
E2E_Evaluator_cypress |
226069.446864679 ns/iter |
229184.1245516716 ns/iter |
0.99 |
E2E_Evaluator_deno |
570610.103843047 ns/iter |
568473.1735537144 ns/iter |
1.00 |
E2E_Evaluator_dependabot |
549831.3187250783 ns/iter |
559463.4285714276 ns/iter |
0.98 |
E2E_Evaluator_draft_04 |
8351508.207316861 ns/iter |
9858208.771428118 ns/iter |
0.85 |
E2E_Evaluator_fabric_mod |
1306834.3241252145 ns/iter |
1274968.2142856729 ns/iter |
1.02 |
E2E_Evaluator_geojson |
25428863.53845994 ns/iter |
25468403.071428724 ns/iter |
1.00 |
E2E_Evaluator_gitpod_configuration |
324766.8196644819 ns/iter |
331918.0942776715 ns/iter |
0.98 |
E2E_Evaluator_helm_chart_lock |
439226.8656998641 ns/iter |
441043.0469543343 ns/iter |
1.00 |
E2E_Evaluator_importmap |
70144.95031616786 ns/iter |
69490.91712050562 ns/iter |
1.01 |
E2E_Evaluator_jasmine |
168978.4781553341 ns/iter |
170131.1525259859 ns/iter |
0.99 |
E2E_Evaluator_jshintrc |
1314926.9108159984 ns/iter |
1306059.6373830887 ns/iter |
1.01 |
E2E_Evaluator_jsconfig |
692966.1714285731 ns/iter |
695132.7648221285 ns/iter |
1.00 |
E2E_Evaluator_krakend |
342165.6886374828 ns/iter |
342117.119395703 ns/iter |
1.00 |
E2E_Evaluator_lazygit |
224048.17787070392 ns/iter |
221570.4529374692 ns/iter |
1.01 |
E2E_Evaluator_lerna |
195073.8467920346 ns/iter |
193938.60385674477 ns/iter |
1.01 |
E2E_Evaluator_nest_cli |
250578.41841450921 ns/iter |
252263.90495266375 ns/iter |
0.99 |
E2E_Evaluator_omc |
29704.296364336857 ns/iter |
29865.32821341916 ns/iter |
0.99 |
E2E_Evaluator_omnisharp |
703809.0673366735 ns/iter |
709626.7487335461 ns/iter |
0.99 |
E2E_Evaluator_openapi |
18783180.974359754 ns/iter |
20968361.606061548 ns/iter |
0.90 |
E2E_Evaluator_pre_commit_hooks |
604004.0397923804 ns/iter |
622872.9535299358 ns/iter |
0.97 |
E2E_Evaluator_pulumi |
838752.9095295717 ns/iter |
877204.7745592158 ns/iter |
0.96 |
E2E_Evaluator_semantic_release |
137795.3832841659 ns/iter |
141591.9956079141 ns/iter |
0.97 |
E2E_Evaluator_stale |
163348.08619888485 ns/iter |
166268.44468034632 ns/iter |
0.98 |
E2E_Evaluator_stylecop |
524240.52438111254 ns/iter |
522946.9421487561 ns/iter |
1.00 |
E2E_Evaluator_tmuxinator |
136162.21329746305 ns/iter |
136581.2712097406 ns/iter |
1.00 |
E2E_Evaluator_ui5 |
762120.7893593844 ns/iter |
776872.9724061884 ns/iter |
0.98 |
E2E_Evaluator_ui5_manifest |
4799936.6506849285 ns/iter |
5559078.40476172 ns/iter |
0.86 |
E2E_Evaluator_unreal_engine_uproject |
678537.9583736833 ns/iter |
671880.722007712 ns/iter |
1.01 |
E2E_Evaluator_vercel |
392222.7165178744 ns/iter |
392012.6117908835 ns/iter |
1.00 |
E2E_Evaluator_yamllint |
15935.765053991596 ns/iter |
16474.74098531992 ns/iter |
0.97 |
Micro_Draft4_Meta_1_No_Callback |
279.23027963557047 ns/iter |
295.9669796605929 ns/iter |
0.94 |
Micro_Draft4_Required_Properties |
694.0845330778553 ns/iter |
692.9872804277297 ns/iter |
1.00 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
32.80860890361466 ns/iter |
32.80253680950552 ns/iter |
1.00 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
14.622297610086095 ns/iter |
14.63081570388828 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
631.93447297021 ns/iter |
617.29921816429 ns/iter |
1.02 |
Micro_Draft4_Nested_Object |
6.543221943335233 ns/iter |
6.824754884978412 ns/iter |
0.96 |
Micro_Draft4_Properties_Triad_Optional |
890.0387469405267 ns/iter |
890.8711872480724 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Closed |
700.3329159221427 ns/iter |
697.3509065656227 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Required |
922.9929291899097 ns/iter |
909.1316749242294 ns/iter |
1.02 |
Micro_Draft4_Properties_Closed |
90.46371079908185 ns/iter |
86.23762275746111 ns/iter |
1.05 |
Micro_Draft4_Non_Recursive_Ref |
33.5750764578278 ns/iter |
33.60584056816484 ns/iter |
1.00 |
Micro_Draft4_Pattern_Properties_True |
240.99744273414728 ns/iter |
244.19692499386628 ns/iter |
0.99 |
Micro_Draft4_Ref_To_Single_Property |
14.835297735950805 ns/iter |
14.637046831891116 ns/iter |
1.01 |
Micro_Draft4_Additional_Properties_Type |
62.53396061433371 ns/iter |
62.48049959775502 ns/iter |
1.00 |
Micro_Draft4_Nested_Oneof |
86.58510525819587 ns/iter |
86.50354977869823 ns/iter |
1.00 |
Micro_Draft4_Short_Enum |
17.492926817968574 ns/iter |
17.44353274155091 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
29.898367719921765 ns/iter |
21.47974556492265 ns/iter |
1.39 |
Micro_Draft4_Long_Enum_Short_Strings |
17.519028721070807 ns/iter |
17.43431789789941 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
11.821778037142396 ns/iter |
11.828983953880373 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
16450158.69047619 ns/iter |
16292949.83720863 ns/iter |
1.01 |
Micro_Draft4_Ref_Many_Nested |
10440895066.000053 ns/iter |
11166521920.99997 ns/iter |
0.94 |
Micro_Draft6_Property_Names |
144.91739549280632 ns/iter |
147.80610073185628 ns/iter |
0.98 |
Micro_Draft7_If_Then_Else |
42.02772874686121 ns/iter |
42.64112836052889 ns/iter |
0.99 |
Micro_2019_09_Unevaluated_Properties |
53.89058555127018 ns/iter |
61.081441824033675 ns/iter |
0.88 |
Micro_2020_12_Dynamic_Ref |
534.7302882081209 ns/iter |
533.7294578104395 ns/iter |
1.00 |
Micro_2020_12_Dynamic_Ref_Single |
11.823829779364043 ns/iter |
11.822153678245778 ns/iter |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: 7a9943e | Previous: be74b45 | Ratio |
|---|---|---|---|
Micro_2020_12_Dynamic_Ref |
643.2462613438312 ns/iter |
622.5513106927764 ns/iter |
1.03 |
Micro_2020_12_Dynamic_Ref_Single |
11.020987459970158 ns/iter |
10.668747796510095 ns/iter |
1.03 |
Micro_2019_09_Unevaluated_Properties |
57.38067444641876 ns/iter |
54.38107449163458 ns/iter |
1.06 |
Micro_Draft7_If_Then_Else |
48.11360461457444 ns/iter |
45.3967765846196 ns/iter |
1.06 |
Micro_Draft6_Property_Names |
167.3207271885844 ns/iter |
158.96251292142705 ns/iter |
1.05 |
Micro_Draft4_Meta_1_No_Callback |
258.255793432674 ns/iter |
248.4017852627472 ns/iter |
1.04 |
Micro_Draft4_Required_Properties |
570.9115093626182 ns/iter |
551.3746621208776 ns/iter |
1.04 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
32.48092990861693 ns/iter |
30.815150426442486 ns/iter |
1.05 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
13.626678571399614 ns/iter |
12.933867965324616 ns/iter |
1.05 |
Micro_Draft4_Items_Schema |
530.2771171693876 ns/iter |
508.55149028163163 ns/iter |
1.04 |
Micro_Draft4_Nested_Object |
6.093643888899277 ns/iter |
6.015946580759301 ns/iter |
1.01 |
Micro_Draft4_Properties_Triad_Optional |
1036.1317454425282 ns/iter |
1051.3557391065722 ns/iter |
0.99 |
Micro_Draft4_Properties_Triad_Closed |
824.6120246062545 ns/iter |
858.5978999905068 ns/iter |
0.96 |
Micro_Draft4_Properties_Triad_Required |
1043.182935424851 ns/iter |
1082.2959655337831 ns/iter |
0.96 |
Micro_Draft4_Properties_Closed |
78.67644124089205 ns/iter |
76.13715071447892 ns/iter |
1.03 |
Micro_Draft4_Non_Recursive_Ref |
14.203309441073584 ns/iter |
13.46025519846297 ns/iter |
1.06 |
Micro_Draft4_Pattern_Properties_True |
254.88610242602957 ns/iter |
244.96907763360184 ns/iter |
1.04 |
Micro_Draft4_Ref_To_Single_Property |
13.72552420206435 ns/iter |
12.961600819485463 ns/iter |
1.06 |
Micro_Draft4_Additional_Properties_Type |
17.29887353290448 ns/iter |
16.285864902110735 ns/iter |
1.06 |
Micro_Draft4_Nested_Oneof |
118.96522312441033 ns/iter |
113.82725077342532 ns/iter |
1.05 |
Micro_Draft4_Short_Enum |
18.88708246880214 ns/iter |
18.751887126322057 ns/iter |
1.01 |
Micro_Draft4_Long_Enum |
22.641915112506297 ns/iter |
24.488856080462448 ns/iter |
0.92 |
Micro_Draft4_Long_Enum_Short_Strings |
18.86894860028555 ns/iter |
18.781753189315715 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
11.019367155823797 ns/iter |
10.687389939725003 ns/iter |
1.03 |
Micro_Draft4_Ref_Single_100 |
17755609.75000019 ns/iter |
17331467.299999304 ns/iter |
1.02 |
Micro_Draft4_Ref_Many_Nested |
12196922800.999914 ns/iter |
11114610783.999979 ns/iter |
1.10 |
E2E_Compiler_adaptivecard |
2981215191.9999223 ns/iter |
2936669861.999917 ns/iter |
1.02 |
E2E_Compiler_ansible_meta |
68400782.39999911 ns/iter |
68643849.00000004 ns/iter |
1.00 |
E2E_Compiler_aws_cdk |
1301394.6141002572 ns/iter |
1309465.8644066532 ns/iter |
0.99 |
E2E_Compiler_babelrc |
12638769.374999827 ns/iter |
12844099.10909248 ns/iter |
0.98 |
E2E_Compiler_clang_format |
56746432.83333581 ns/iter |
57822740.16667088 ns/iter |
0.98 |
E2E_Compiler_cmake_presets |
1760945778.9999397 ns/iter |
1806506751.9999046 ns/iter |
0.97 |
E2E_Compiler_code_climate |
8774177.987500308 ns/iter |
8977786.858975215 ns/iter |
0.98 |
E2E_Compiler_cql2 |
264127652.33332416 ns/iter |
261284500.66668543 ns/iter |
1.01 |
E2E_Compiler_cspell |
259826425.6666501 ns/iter |
263554887.33330882 ns/iter |
0.99 |
E2E_Compiler_cypress |
32204990.409091104 ns/iter |
32073708.045448836 ns/iter |
1.00 |
E2E_Compiler_deno |
29032111.125000406 ns/iter |
29850594.583336946 ns/iter |
0.97 |
E2E_Compiler_dependabot |
12464889.714284563 ns/iter |
12683305.145455135 ns/iter |
0.98 |
E2E_Compiler_draft_04 |
61857404.818180256 ns/iter |
63108375.90909945 ns/iter |
0.98 |
E2E_Compiler_fabric_mod |
25037202.285716377 ns/iter |
24854103.03570948 ns/iter |
1.01 |
E2E_Compiler_geojson |
63450437.81818111 ns/iter |
63408209.454544045 ns/iter |
1.00 |
E2E_Compiler_gitpod_configuration |
25914736.22222414 ns/iter |
26021584.185181618 ns/iter |
1.00 |
E2E_Compiler_helm_chart_lock |
4780405.397260027 ns/iter |
4897906.951724696 ns/iter |
0.98 |
E2E_Compiler_importmap |
1726129.348894384 ns/iter |
1752917.0348259741 ns/iter |
0.98 |
E2E_Compiler_jasmine |
5922963.228813696 ns/iter |
5991674.982757606 ns/iter |
0.99 |
E2E_Compiler_jshintrc |
17264923.170731023 ns/iter |
17587968.050003156 ns/iter |
0.98 |
E2E_Compiler_jsconfig |
63451256.7272726 ns/iter |
64187828.9999857 ns/iter |
0.99 |
E2E_Compiler_krakend |
819418470.999949 ns/iter |
832243181.9999565 ns/iter |
0.98 |
E2E_Compiler_lazygit |
127509000.39998214 ns/iter |
124262288.33332212 ns/iter |
1.03 |
E2E_Compiler_lerna |
6583232.96116485 ns/iter |
6744688.961536948 ns/iter |
0.98 |
E2E_Compiler_nest_cli |
37199596.26315765 ns/iter |
38138579.16665913 ns/iter |
0.98 |
E2E_Compiler_omc |
3431145057.99997 ns/iter |
3362027420.9999933 ns/iter |
1.02 |
E2E_Compiler_omnisharp |
21442670.363636684 ns/iter |
21522365.5454517 ns/iter |
1.00 |
E2E_Compiler_openapi |
1806079206.0000494 ns/iter |
1754592544.9999232 ns/iter |
1.03 |
E2E_Compiler_pre_commit_hooks |
10153922.971014345 ns/iter |
10097717.55714155 ns/iter |
1.01 |
E2E_Compiler_pulumi |
16601578.357142985 ns/iter |
16604799.309523817 ns/iter |
1.00 |
E2E_Compiler_semantic_release |
4708116.496644743 ns/iter |
4769941.819999985 ns/iter |
0.99 |
E2E_Compiler_stale |
4821442.753424971 ns/iter |
4905371.195804406 ns/iter |
0.98 |
E2E_Compiler_stylecop |
18324553.578948826 ns/iter |
18712108.28947393 ns/iter |
0.98 |
E2E_Compiler_tmuxinator |
6465909.972476816 ns/iter |
6582809.05607545 ns/iter |
0.98 |
E2E_Compiler_ui5 |
375255102.4999775 ns/iter |
379012596.500047 ns/iter |
0.99 |
E2E_Compiler_ui5_manifest |
5011010025.000019 ns/iter |
4900197075.000051 ns/iter |
1.02 |
E2E_Compiler_unreal_engine_uproject |
18667256.3157889 ns/iter |
18976888.918918908 ns/iter |
0.98 |
E2E_Compiler_vercel |
61242227.45454104 ns/iter |
61140163.90909621 ns/iter |
1.00 |
E2E_Compiler_yamllint |
8257797.082352921 ns/iter |
8197035.3023258895 ns/iter |
1.01 |
E2E_Evaluator_adaptivecard |
56970.9694550781 ns/iter |
55040.23214427066 ns/iter |
1.04 |
E2E_Evaluator_ansible_meta |
327510.87260848144 ns/iter |
314182.6493682469 ns/iter |
1.04 |
E2E_Evaluator_aws_cdk |
59114.779145240354 ns/iter |
56705.91275546265 ns/iter |
1.04 |
E2E_Evaluator_babelrc |
146389.30175803488 ns/iter |
142752.18148965487 ns/iter |
1.03 |
E2E_Evaluator_clang_format |
106441.32209737119 ns/iter |
101910.09093562345 ns/iter |
1.04 |
E2E_Evaluator_cmake_presets |
5760376.040322238 ns/iter |
4955162.847826008 ns/iter |
1.16 |
E2E_Evaluator_code_climate |
229776.94017093958 ns/iter |
223805.6935691204 ns/iter |
1.03 |
E2E_Evaluator_cql2 |
287755.6527436612 ns/iter |
281266.2592137276 ns/iter |
1.02 |
E2E_Evaluator_cspell |
1062554.0500000445 ns/iter |
1033134.5029852 ns/iter |
1.03 |
E2E_Evaluator_cypress |
174401.76940353416 ns/iter |
171724.3019282462 ns/iter |
1.02 |
E2E_Evaluator_deno |
562660.9279935386 ns/iter |
562306.4172779145 ns/iter |
1.00 |
E2E_Evaluator_dependabot |
483978.1010309004 ns/iter |
472210.36700338963 ns/iter |
1.02 |
E2E_Evaluator_draft_04 |
10421918.552239405 ns/iter |
8675289.200002111 ns/iter |
1.20 |
E2E_Evaluator_fabric_mod |
1363694.4691357813 ns/iter |
1360360.3005891927 ns/iter |
1.00 |
E2E_Evaluator_geojson |
23296619.033336204 ns/iter |
21109477.51515541 ns/iter |
1.10 |
E2E_Evaluator_gitpod_configuration |
294405.5300799285 ns/iter |
290686.3037190095 ns/iter |
1.01 |
E2E_Evaluator_helm_chart_lock |
354672.08422663546 ns/iter |
353212.90867349657 ns/iter |
1.00 |
E2E_Evaluator_importmap |
60188.65490562737 ns/iter |
60164.50807025189 ns/iter |
1.00 |
E2E_Evaluator_jasmine |
144577.0399259117 ns/iter |
140302.02489443522 ns/iter |
1.03 |
E2E_Evaluator_jshintrc |
965014.1646092808 ns/iter |
951859.2639454125 ns/iter |
1.01 |
E2E_Evaluator_jsconfig |
702375.3709349913 ns/iter |
698357.8434342648 ns/iter |
1.01 |
E2E_Evaluator_krakend |
329101.519905182 ns/iter |
323902.39582366287 ns/iter |
1.02 |
E2E_Evaluator_lazygit |
191318.0745984334 ns/iter |
192534.84102559843 ns/iter |
0.99 |
E2E_Evaluator_lerna |
150541.24589100096 ns/iter |
146437.4216409798 ns/iter |
1.03 |
E2E_Evaluator_nest_cli |
233175.2527040727 ns/iter |
224660.57679948298 ns/iter |
1.04 |
E2E_Evaluator_omc |
29330.30069006439 ns/iter |
28470.97289927431 ns/iter |
1.03 |
E2E_Evaluator_omnisharp |
546980.8560312571 ns/iter |
545166.696664072 ns/iter |
1.00 |
E2E_Evaluator_openapi |
19808598.85294622 ns/iter |
18200794.350002524 ns/iter |
1.09 |
E2E_Evaluator_pre_commit_hooks |
535625.9475683434 ns/iter |
521603.4888227844 ns/iter |
1.03 |
E2E_Evaluator_pulumi |
840130.5095467815 ns/iter |
808285.3850575556 ns/iter |
1.04 |
E2E_Evaluator_semantic_release |
137138.2542272968 ns/iter |
136306.87348817056 ns/iter |
1.01 |
E2E_Evaluator_stale |
148580.49203355433 ns/iter |
142904.88983224513 ns/iter |
1.04 |
E2E_Evaluator_stylecop |
518436.71525667555 ns/iter |
505733.0196362851 ns/iter |
1.03 |
E2E_Evaluator_tmuxinator |
128236.64276661664 ns/iter |
126569.32261525077 ns/iter |
1.01 |
E2E_Evaluator_ui5 |
790946.4343891373 ns/iter |
761566.7879782534 ns/iter |
1.04 |
E2E_Evaluator_ui5_manifest |
5818258.610294351 ns/iter |
4904425.841726302 ns/iter |
1.19 |
E2E_Evaluator_unreal_engine_uproject |
702801.2595573213 ns/iter |
690662.9483103211 ns/iter |
1.02 |
E2E_Evaluator_vercel |
351597.06797580334 ns/iter |
344493.37285648356 ns/iter |
1.02 |
E2E_Evaluator_yamllint |
14179.230356520631 ns/iter |
13597.07635367872 ns/iter |
1.04 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: 7a9943e | Previous: be74b45 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
2957045584.0000706 ns/iter |
3550388290.99999 ns/iter |
0.83 |
E2E_Compiler_ansible_meta |
68742558.29999356 ns/iter |
87798963.50000627 ns/iter |
0.78 |
E2E_Compiler_aws_cdk |
1147941.1055362504 ns/iter |
1659226.8260870592 ns/iter |
0.69 |
E2E_Compiler_babelrc |
11374923.120689768 ns/iter |
14889017.960782956 ns/iter |
0.76 |
E2E_Compiler_clang_format |
53724804.19999875 ns/iter |
76818772.46154028 ns/iter |
0.70 |
E2E_Compiler_cmake_presets |
1612863082.9999793 ns/iter |
2094738874.9999619 ns/iter |
0.77 |
E2E_Compiler_code_climate |
8949600.524999823 ns/iter |
11743599.686276278 ns/iter |
0.76 |
E2E_Compiler_cql2 |
207905875.00001344 ns/iter |
298005138.66666734 ns/iter |
0.70 |
E2E_Compiler_cspell |
228240041.66667083 ns/iter |
298520291.49998313 ns/iter |
0.76 |
E2E_Compiler_cypress |
37164747.950004086 ns/iter |
42247690.06250284 ns/iter |
0.88 |
E2E_Compiler_deno |
28999989.58333564 ns/iter |
39674553.2777724 ns/iter |
0.73 |
E2E_Compiler_dependabot |
14635354.56862781 ns/iter |
16706464.999999752 ns/iter |
0.88 |
E2E_Compiler_draft_04 |
71939658.3000048 ns/iter |
74973458.33333687 ns/iter |
0.96 |
E2E_Compiler_fabric_mod |
24667748.44444225 ns/iter |
26699947.928571127 ns/iter |
0.92 |
E2E_Compiler_geojson |
75013886.36363903 ns/iter |
75725828.66666582 ns/iter |
0.99 |
E2E_Compiler_gitpod_configuration |
25880009.61538648 ns/iter |
28324379.150001276 ns/iter |
0.91 |
E2E_Compiler_helm_chart_lock |
5878736.250000429 ns/iter |
4884935.1214284655 ns/iter |
1.20 |
E2E_Compiler_importmap |
2172211.160714304 ns/iter |
1851867.1022445376 ns/iter |
1.17 |
E2E_Compiler_jasmine |
9313692.464285765 ns/iter |
7205109.693876581 ns/iter |
1.29 |
E2E_Compiler_jshintrc |
23219828.27272746 ns/iter |
21375953.57142865 ns/iter |
1.09 |
E2E_Compiler_jsconfig |
72853320.90000339 ns/iter |
73937791.66667022 ns/iter |
0.99 |
E2E_Compiler_krakend |
950298333.9999673 ns/iter |
1090164708.9999642 ns/iter |
0.87 |
E2E_Compiler_lazygit |
147674349.9999884 ns/iter |
172772258.40000483 ns/iter |
0.85 |
E2E_Compiler_lerna |
7016630.357797229 ns/iter |
7339486.822785793 ns/iter |
0.96 |
E2E_Compiler_nest_cli |
38045530.11111188 ns/iter |
43393104.18750131 ns/iter |
0.88 |
E2E_Compiler_omc |
3889830125.0000033 ns/iter |
3797636000.0000114 ns/iter |
1.02 |
E2E_Compiler_omnisharp |
22177363.86666805 ns/iter |
24588913.461535905 ns/iter |
0.90 |
E2E_Compiler_openapi |
1421474291.9999707 ns/iter |
1697616374.9999387 ns/iter |
0.84 |
E2E_Compiler_pre_commit_hooks |
9942359.708860796 ns/iter |
11851563.883332498 ns/iter |
0.84 |
E2E_Compiler_pulumi |
14436803.921568092 ns/iter |
18664660.888889432 ns/iter |
0.77 |
E2E_Compiler_semantic_release |
5047438.482352738 ns/iter |
5105696.94244587 ns/iter |
0.99 |
E2E_Compiler_stale |
5944677.845529137 ns/iter |
6145565.437037071 ns/iter |
0.97 |
E2E_Compiler_stylecop |
19830888.451613117 ns/iter |
24340487.393939123 ns/iter |
0.81 |
E2E_Compiler_tmuxinator |
6536727.941177194 ns/iter |
6603726.71568684 ns/iter |
0.99 |
E2E_Compiler_ui5 |
422447937.49995327 ns/iter |
474195103.999989 ns/iter |
0.89 |
E2E_Compiler_ui5_manifest |
5291068166.000059 ns/iter |
5708689415.99997 ns/iter |
0.93 |
E2E_Compiler_unreal_engine_uproject |
16176951.704546189 ns/iter |
20894276.17142649 ns/iter |
0.77 |
E2E_Compiler_vercel |
56339961.83333541 ns/iter |
86858505.12499371 ns/iter |
0.65 |
E2E_Compiler_yamllint |
8222468.4999995055 ns/iter |
11881887.421052676 ns/iter |
0.69 |
E2E_Evaluator_adaptivecard |
50448.71884161377 ns/iter |
67801.10839999907 ns/iter |
0.74 |
E2E_Evaluator_ansible_meta |
281420.2692459489 ns/iter |
326636.43235292594 ns/iter |
0.86 |
E2E_Evaluator_aws_cdk |
56479.2898669786 ns/iter |
56744.41119302318 ns/iter |
1.00 |
E2E_Evaluator_babelrc |
112617.17627591625 ns/iter |
132712.19604551292 ns/iter |
0.85 |
E2E_Evaluator_clang_format |
119486.30066555973 ns/iter |
117030.64892335032 ns/iter |
1.02 |
E2E_Evaluator_cmake_presets |
3619824.264248818 ns/iter |
4906608.598425346 ns/iter |
0.74 |
E2E_Evaluator_code_climate |
200803.1412742219 ns/iter |
223075.4796988411 ns/iter |
0.90 |
E2E_Evaluator_cql2 |
292416.4166666619 ns/iter |
258437.62460459143 ns/iter |
1.13 |
E2E_Evaluator_cspell |
880624.7490953006 ns/iter |
888425.9129213282 ns/iter |
0.99 |
E2E_Evaluator_cypress |
202827.09503583613 ns/iter |
254683.07401926795 ns/iter |
0.80 |
E2E_Evaluator_deno |
511987.6669999712 ns/iter |
651503.2125550968 ns/iter |
0.79 |
E2E_Evaluator_dependabot |
541932.743029431 ns/iter |
542740.4580000256 ns/iter |
1.00 |
E2E_Evaluator_draft_04 |
7716759.94318147 ns/iter |
7876353.448275051 ns/iter |
0.98 |
E2E_Evaluator_fabric_mod |
1912767.6470588995 ns/iter |
1969537.3757578887 ns/iter |
0.97 |
E2E_Evaluator_geojson |
16885215.081082284 ns/iter |
25075181.818181135 ns/iter |
0.67 |
E2E_Evaluator_gitpod_configuration |
253275.59192201484 ns/iter |
332029.7706198286 ns/iter |
0.76 |
E2E_Evaluator_helm_chart_lock |
319539.69137673744 ns/iter |
363744.8544177154 ns/iter |
0.88 |
E2E_Evaluator_importmap |
46692.753389282334 ns/iter |
53280.6290999929 ns/iter |
0.88 |
E2E_Evaluator_jasmine |
141760.4636630715 ns/iter |
139378.5281059784 ns/iter |
1.02 |
E2E_Evaluator_jshintrc |
1337501.6920473555 ns/iter |
1287960.8043476765 ns/iter |
1.04 |
E2E_Evaluator_jsconfig |
676611.1236462472 ns/iter |
708637.3225508208 ns/iter |
0.95 |
E2E_Evaluator_krakend |
343748.330139372 ns/iter |
247816.10310786194 ns/iter |
1.39 |
E2E_Evaluator_lazygit |
158363.787678218 ns/iter |
164056.6714490518 ns/iter |
0.97 |
E2E_Evaluator_lerna |
150811.63319761786 ns/iter |
189269.37126245323 ns/iter |
0.80 |
E2E_Evaluator_nest_cli |
162836.064467461 ns/iter |
171077.72556391524 ns/iter |
0.95 |
E2E_Evaluator_omc |
18602.757137053886 ns/iter |
22278.63286198952 ns/iter |
0.84 |
E2E_Evaluator_omnisharp |
419806.2727826151 ns/iter |
528814.0830000429 ns/iter |
0.79 |
E2E_Evaluator_openapi |
11196890.41096012 ns/iter |
14342589.285712663 ns/iter |
0.78 |
E2E_Evaluator_pre_commit_hooks |
366873.91378386517 ns/iter |
499424.29439890175 ns/iter |
0.73 |
E2E_Evaluator_pulumi |
570072.8975791235 ns/iter |
655386.0329776902 ns/iter |
0.87 |
E2E_Evaluator_semantic_release |
89525.16056519216 ns/iter |
111935.00241700982 ns/iter |
0.80 |
E2E_Evaluator_stale |
110702.55433328496 ns/iter |
120160.56980004335 ns/iter |
0.92 |
E2E_Evaluator_stylecop |
322659.38189847337 ns/iter |
323219.44973792345 ns/iter |
1.00 |
E2E_Evaluator_tmuxinator |
84133.7334933957 ns/iter |
86163.81923538935 ns/iter |
0.98 |
E2E_Evaluator_ui5 |
555789.5956191735 ns/iter |
612895.1856738803 ns/iter |
0.91 |
E2E_Evaluator_ui5_manifest |
3006534.4928231393 ns/iter |
3466281.2911392394 ns/iter |
0.87 |
E2E_Evaluator_unreal_engine_uproject |
427980.93093090295 ns/iter |
493492.0963035337 ns/iter |
0.87 |
E2E_Evaluator_vercel |
238811.44142557448 ns/iter |
347960.2502017642 ns/iter |
0.69 |
E2E_Evaluator_yamllint |
12554.383753993552 ns/iter |
18230.551671309237 ns/iter |
0.69 |
Micro_Draft4_Meta_1_No_Callback |
208.8281745892592 ns/iter |
263.93642655853716 ns/iter |
0.79 |
Micro_Draft4_Required_Properties |
547.4047305229991 ns/iter |
766.2244122486748 ns/iter |
0.71 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
28.469882020071456 ns/iter |
32.7926552403804 ns/iter |
0.87 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
7.984374661042325 ns/iter |
9.291276518428974 ns/iter |
0.86 |
Micro_Draft4_Items_Schema |
488.530504103468 ns/iter |
665.6663686761643 ns/iter |
0.73 |
Micro_Draft4_Nested_Object |
3.110139113829487 ns/iter |
4.389983410907091 ns/iter |
0.71 |
Micro_Draft4_Properties_Triad_Optional |
734.8174950445612 ns/iter |
948.7412803979973 ns/iter |
0.77 |
Micro_Draft4_Properties_Triad_Closed |
579.9207616231291 ns/iter |
694.6285908175184 ns/iter |
0.83 |
Micro_Draft4_Properties_Triad_Required |
721.6569535425162 ns/iter |
944.9995440463408 ns/iter |
0.76 |
Micro_Draft4_Properties_Closed |
58.357116676144365 ns/iter |
63.0959282242966 ns/iter |
0.92 |
Micro_Draft4_Non_Recursive_Ref |
20.172430058735454 ns/iter |
23.382408049736938 ns/iter |
0.86 |
Micro_Draft4_Pattern_Properties_True |
185.38573314852587 ns/iter |
181.09306776020532 ns/iter |
1.02 |
Micro_Draft4_Ref_To_Single_Property |
11.789102482446829 ns/iter |
7.7411203750441775 ns/iter |
1.52 |
Micro_Draft4_Additional_Properties_Type |
43.71630740036205 ns/iter |
36.004177248158186 ns/iter |
1.21 |
Micro_Draft4_Nested_Oneof |
64.91608426512688 ns/iter |
58.407087828517206 ns/iter |
1.11 |
Micro_Draft4_Short_Enum |
10.404563314891643 ns/iter |
20.079611239103524 ns/iter |
0.52 |
Micro_Draft4_Long_Enum |
27.619919993357673 ns/iter |
31.26008197272913 ns/iter |
0.88 |
Micro_Draft4_Long_Enum_Short_Strings |
11.702105892569621 ns/iter |
14.412438361719081 ns/iter |
0.81 |
Micro_Draft4_Type_Object |
5.697352915138875 ns/iter |
7.725317306610561 ns/iter |
0.74 |
Micro_Draft4_Ref_Single_100 |
16382613.525001943 ns/iter |
33618526.679997556 ns/iter |
0.49 |
Micro_Draft4_Ref_Many_Nested |
9417536583.999891 ns/iter |
15961329291.000084 ns/iter |
0.59 |
Micro_Draft6_Property_Names |
125.19618459615022 ns/iter |
123.8607382200278 ns/iter |
1.01 |
Micro_Draft7_If_Then_Else |
29.3774070485874 ns/iter |
35.305750368237 ns/iter |
0.83 |
Micro_2019_09_Unevaluated_Properties |
47.39596290334506 ns/iter |
47.32060477704183 ns/iter |
1.00 |
Micro_2020_12_Dynamic_Ref |
692.897796800899 ns/iter |
482.39985996343404 ns/iter |
1.44 |
Micro_2020_12_Dynamic_Ref_Single |
8.943700323351043 ns/iter |
7.150343562941561 ns/iter |
1.25 |
This comment was automatically generated by workflow using github-action-benchmark.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com