Skip to content

Upgrade the JSON Schema Test Suite to 4cf559962d6dd01aa576e9b8889d771df70d9e50#542

Merged
jviotti merged 1 commit into
mainfrom
test-suite-new-5
Oct 30, 2025
Merged

Upgrade the JSON Schema Test Suite to 4cf559962d6dd01aa576e9b8889d771df70d9e50#542
jviotti merged 1 commit into
mainfrom
test-suite-new-5

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented Oct 30, 2025

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

…1df70d9e50`

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 7a9943e Previous: be74b45 Ratio
E2E_Compiler_adaptivecard 2838785934.9999757 ns/iter 2822905625.0000324 ns/iter 1.01
E2E_Compiler_ansible_meta 62521518.63636548 ns/iter 63063991.09090741 ns/iter 0.99
E2E_Compiler_aws_cdk 1176850.871355081 ns/iter 1179534.5420239985 ns/iter 1.00
E2E_Compiler_babelrc 11424862.622951223 ns/iter 11433668.065573793 ns/iter 1.00
E2E_Compiler_clang_format 52542751.3846134 ns/iter 52645046.15384497 ns/iter 1.00
E2E_Compiler_cmake_presets 1595219887.9999743 ns/iter 1598202243.9999924 ns/iter 1.00
E2E_Compiler_code_climate 7922344.114941923 ns/iter 7791536.613636135 ns/iter 1.02
E2E_Compiler_cql2 227673240.66668 ns/iter 232767328.66666332 ns/iter 0.98
E2E_Compiler_cspell 238399919.33332765 ns/iter 239558565.3333304 ns/iter 1.00
E2E_Compiler_cypress 29202884.125001088 ns/iter 29398173.29166772 ns/iter 0.99
E2E_Compiler_deno 26307505.44444414 ns/iter 26838551.230768487 ns/iter 0.98
E2E_Compiler_dependabot 11161879.064516252 ns/iter 11322395.573770672 ns/iter 0.99
E2E_Compiler_draft_04 55364583.25000145 ns/iter 56293920.50000111 ns/iter 0.98
E2E_Compiler_fabric_mod 22843892.87096782 ns/iter 23114558.2903236 ns/iter 0.99
E2E_Compiler_geojson 55673559.25000092 ns/iter 56470294.16666764 ns/iter 0.99
E2E_Compiler_gitpod_configuration 23921986.48275835 ns/iter 23888154.62069064 ns/iter 1.00
E2E_Compiler_helm_chart_lock 4414145.174999718 ns/iter 4380088.670807367 ns/iter 1.01
E2E_Compiler_importmap 1587799.322727273 ns/iter 1597746.0293453676 ns/iter 0.99
E2E_Compiler_jasmine 5371431.376923177 ns/iter 5402750.32812465 ns/iter 0.99
E2E_Compiler_jshintrc 15831331.386364542 ns/iter 15810624.454545064 ns/iter 1.00
E2E_Compiler_jsconfig 58730368.333333634 ns/iter 58181076.666665874 ns/iter 1.01
E2E_Compiler_krakend 747328410.0000228 ns/iter 736550637.9999828 ns/iter 1.01
E2E_Compiler_lazygit 111730253.49999458 ns/iter 112485881.99999668 ns/iter 0.99
E2E_Compiler_lerna 5940217.04273473 ns/iter 5996319.456896955 ns/iter 0.99
E2E_Compiler_nest_cli 34222823.47619221 ns/iter 34875446.30000059 ns/iter 0.98
E2E_Compiler_omc 2813523297.0000176 ns/iter 2878787590.000002 ns/iter 0.98
E2E_Compiler_omnisharp 19837545.999999814 ns/iter 19680156.305556 ns/iter 1.01
E2E_Compiler_openapi 1544953625.000005 ns/iter 1573561767.9999905 ns/iter 0.98
E2E_Compiler_pre_commit_hooks 9201499.02666708 ns/iter 9355348.688311316 ns/iter 0.98
E2E_Compiler_pulumi 15227907.521738583 ns/iter 15076592.195651736 ns/iter 1.01
E2E_Compiler_semantic_release 4243046.630303084 ns/iter 4240702.932926657 ns/iter 1.00
E2E_Compiler_stale 4377429.658227702 ns/iter 4375363.037266859 ns/iter 1.00
E2E_Compiler_stylecop 16964258.951218642 ns/iter 16788428.57142946 ns/iter 1.01
E2E_Compiler_tmuxinator 5850468.188033861 ns/iter 5864330.958333141 ns/iter 1.00
E2E_Compiler_ui5 351099628.00001425 ns/iter 344136252.49999315 ns/iter 1.02
E2E_Compiler_ui5_manifest 4485811721.000005 ns/iter 4514987331.999975 ns/iter 0.99
E2E_Compiler_unreal_engine_uproject 17127480.365853146 ns/iter 17091432.19512282 ns/iter 1.00
E2E_Compiler_vercel 55534692.66666866 ns/iter 56343290.99999983 ns/iter 0.99
E2E_Compiler_yamllint 7289058.239583331 ns/iter 7257652.0312495055 ns/iter 1.00
E2E_Evaluator_adaptivecard 54220.42598646399 ns/iter 52319.68932185551 ns/iter 1.04
E2E_Evaluator_ansible_meta 332038.4853146704 ns/iter 326786.1759517181 ns/iter 1.02
E2E_Evaluator_aws_cdk 67596.24677090356 ns/iter 68074.15331873234 ns/iter 0.99
E2E_Evaluator_babelrc 158808.9288296453 ns/iter 160631.63855145048 ns/iter 0.99
E2E_Evaluator_clang_format 136469.99649873792 ns/iter 135603.08483440196 ns/iter 1.01
E2E_Evaluator_cmake_presets 5295849.689393649 ns/iter 6431861.865384401 ns/iter 0.82
E2E_Evaluator_code_climate 266589.65106545115 ns/iter 274300.91511627496 ns/iter 0.97
E2E_Evaluator_cql2 277791.6020488611 ns/iter 278792.20188529574 ns/iter 1.00
E2E_Evaluator_cspell 995252.7911931888 ns/iter 995680.3517730057 ns/iter 1.00
E2E_Evaluator_cypress 226069.446864679 ns/iter 229184.1245516716 ns/iter 0.99
E2E_Evaluator_deno 570610.103843047 ns/iter 568473.1735537144 ns/iter 1.00
E2E_Evaluator_dependabot 549831.3187250783 ns/iter 559463.4285714276 ns/iter 0.98
E2E_Evaluator_draft_04 8351508.207316861 ns/iter 9858208.771428118 ns/iter 0.85
E2E_Evaluator_fabric_mod 1306834.3241252145 ns/iter 1274968.2142856729 ns/iter 1.02
E2E_Evaluator_geojson 25428863.53845994 ns/iter 25468403.071428724 ns/iter 1.00
E2E_Evaluator_gitpod_configuration 324766.8196644819 ns/iter 331918.0942776715 ns/iter 0.98
E2E_Evaluator_helm_chart_lock 439226.8656998641 ns/iter 441043.0469543343 ns/iter 1.00
E2E_Evaluator_importmap 70144.95031616786 ns/iter 69490.91712050562 ns/iter 1.01
E2E_Evaluator_jasmine 168978.4781553341 ns/iter 170131.1525259859 ns/iter 0.99
E2E_Evaluator_jshintrc 1314926.9108159984 ns/iter 1306059.6373830887 ns/iter 1.01
E2E_Evaluator_jsconfig 692966.1714285731 ns/iter 695132.7648221285 ns/iter 1.00
E2E_Evaluator_krakend 342165.6886374828 ns/iter 342117.119395703 ns/iter 1.00
E2E_Evaluator_lazygit 224048.17787070392 ns/iter 221570.4529374692 ns/iter 1.01
E2E_Evaluator_lerna 195073.8467920346 ns/iter 193938.60385674477 ns/iter 1.01
E2E_Evaluator_nest_cli 250578.41841450921 ns/iter 252263.90495266375 ns/iter 0.99
E2E_Evaluator_omc 29704.296364336857 ns/iter 29865.32821341916 ns/iter 0.99
E2E_Evaluator_omnisharp 703809.0673366735 ns/iter 709626.7487335461 ns/iter 0.99
E2E_Evaluator_openapi 18783180.974359754 ns/iter 20968361.606061548 ns/iter 0.90
E2E_Evaluator_pre_commit_hooks 604004.0397923804 ns/iter 622872.9535299358 ns/iter 0.97
E2E_Evaluator_pulumi 838752.9095295717 ns/iter 877204.7745592158 ns/iter 0.96
E2E_Evaluator_semantic_release 137795.3832841659 ns/iter 141591.9956079141 ns/iter 0.97
E2E_Evaluator_stale 163348.08619888485 ns/iter 166268.44468034632 ns/iter 0.98
E2E_Evaluator_stylecop 524240.52438111254 ns/iter 522946.9421487561 ns/iter 1.00
E2E_Evaluator_tmuxinator 136162.21329746305 ns/iter 136581.2712097406 ns/iter 1.00
E2E_Evaluator_ui5 762120.7893593844 ns/iter 776872.9724061884 ns/iter 0.98
E2E_Evaluator_ui5_manifest 4799936.6506849285 ns/iter 5559078.40476172 ns/iter 0.86
E2E_Evaluator_unreal_engine_uproject 678537.9583736833 ns/iter 671880.722007712 ns/iter 1.01
E2E_Evaluator_vercel 392222.7165178744 ns/iter 392012.6117908835 ns/iter 1.00
E2E_Evaluator_yamllint 15935.765053991596 ns/iter 16474.74098531992 ns/iter 0.97
Micro_Draft4_Meta_1_No_Callback 279.23027963557047 ns/iter 295.9669796605929 ns/iter 0.94
Micro_Draft4_Required_Properties 694.0845330778553 ns/iter 692.9872804277297 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 32.80860890361466 ns/iter 32.80253680950552 ns/iter 1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match 14.622297610086095 ns/iter 14.63081570388828 ns/iter 1.00
Micro_Draft4_Items_Schema 631.93447297021 ns/iter 617.29921816429 ns/iter 1.02
Micro_Draft4_Nested_Object 6.543221943335233 ns/iter 6.824754884978412 ns/iter 0.96
Micro_Draft4_Properties_Triad_Optional 890.0387469405267 ns/iter 890.8711872480724 ns/iter 1.00
Micro_Draft4_Properties_Triad_Closed 700.3329159221427 ns/iter 697.3509065656227 ns/iter 1.00
Micro_Draft4_Properties_Triad_Required 922.9929291899097 ns/iter 909.1316749242294 ns/iter 1.02
Micro_Draft4_Properties_Closed 90.46371079908185 ns/iter 86.23762275746111 ns/iter 1.05
Micro_Draft4_Non_Recursive_Ref 33.5750764578278 ns/iter 33.60584056816484 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 240.99744273414728 ns/iter 244.19692499386628 ns/iter 0.99
Micro_Draft4_Ref_To_Single_Property 14.835297735950805 ns/iter 14.637046831891116 ns/iter 1.01
Micro_Draft4_Additional_Properties_Type 62.53396061433371 ns/iter 62.48049959775502 ns/iter 1.00
Micro_Draft4_Nested_Oneof 86.58510525819587 ns/iter 86.50354977869823 ns/iter 1.00
Micro_Draft4_Short_Enum 17.492926817968574 ns/iter 17.44353274155091 ns/iter 1.00
Micro_Draft4_Long_Enum 29.898367719921765 ns/iter 21.47974556492265 ns/iter 1.39
Micro_Draft4_Long_Enum_Short_Strings 17.519028721070807 ns/iter 17.43431789789941 ns/iter 1.00
Micro_Draft4_Type_Object 11.821778037142396 ns/iter 11.828983953880373 ns/iter 1.00
Micro_Draft4_Ref_Single_100 16450158.69047619 ns/iter 16292949.83720863 ns/iter 1.01
Micro_Draft4_Ref_Many_Nested 10440895066.000053 ns/iter 11166521920.99997 ns/iter 0.94
Micro_Draft6_Property_Names 144.91739549280632 ns/iter 147.80610073185628 ns/iter 0.98
Micro_Draft7_If_Then_Else 42.02772874686121 ns/iter 42.64112836052889 ns/iter 0.99
Micro_2019_09_Unevaluated_Properties 53.89058555127018 ns/iter 61.081441824033675 ns/iter 0.88
Micro_2020_12_Dynamic_Ref 534.7302882081209 ns/iter 533.7294578104395 ns/iter 1.00
Micro_2020_12_Dynamic_Ref_Single 11.823829779364043 ns/iter 11.822153678245778 ns/iter 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 7a9943e Previous: be74b45 Ratio
Micro_2020_12_Dynamic_Ref 643.2462613438312 ns/iter 622.5513106927764 ns/iter 1.03
Micro_2020_12_Dynamic_Ref_Single 11.020987459970158 ns/iter 10.668747796510095 ns/iter 1.03
Micro_2019_09_Unevaluated_Properties 57.38067444641876 ns/iter 54.38107449163458 ns/iter 1.06
Micro_Draft7_If_Then_Else 48.11360461457444 ns/iter 45.3967765846196 ns/iter 1.06
Micro_Draft6_Property_Names 167.3207271885844 ns/iter 158.96251292142705 ns/iter 1.05
Micro_Draft4_Meta_1_No_Callback 258.255793432674 ns/iter 248.4017852627472 ns/iter 1.04
Micro_Draft4_Required_Properties 570.9115093626182 ns/iter 551.3746621208776 ns/iter 1.04
Micro_Draft4_Many_Optional_Properties_Minimal_Match 32.48092990861693 ns/iter 30.815150426442486 ns/iter 1.05
Micro_Draft4_Few_Optional_Properties_Minimal_Match 13.626678571399614 ns/iter 12.933867965324616 ns/iter 1.05
Micro_Draft4_Items_Schema 530.2771171693876 ns/iter 508.55149028163163 ns/iter 1.04
Micro_Draft4_Nested_Object 6.093643888899277 ns/iter 6.015946580759301 ns/iter 1.01
Micro_Draft4_Properties_Triad_Optional 1036.1317454425282 ns/iter 1051.3557391065722 ns/iter 0.99
Micro_Draft4_Properties_Triad_Closed 824.6120246062545 ns/iter 858.5978999905068 ns/iter 0.96
Micro_Draft4_Properties_Triad_Required 1043.182935424851 ns/iter 1082.2959655337831 ns/iter 0.96
Micro_Draft4_Properties_Closed 78.67644124089205 ns/iter 76.13715071447892 ns/iter 1.03
Micro_Draft4_Non_Recursive_Ref 14.203309441073584 ns/iter 13.46025519846297 ns/iter 1.06
Micro_Draft4_Pattern_Properties_True 254.88610242602957 ns/iter 244.96907763360184 ns/iter 1.04
Micro_Draft4_Ref_To_Single_Property 13.72552420206435 ns/iter 12.961600819485463 ns/iter 1.06
Micro_Draft4_Additional_Properties_Type 17.29887353290448 ns/iter 16.285864902110735 ns/iter 1.06
Micro_Draft4_Nested_Oneof 118.96522312441033 ns/iter 113.82725077342532 ns/iter 1.05
Micro_Draft4_Short_Enum 18.88708246880214 ns/iter 18.751887126322057 ns/iter 1.01
Micro_Draft4_Long_Enum 22.641915112506297 ns/iter 24.488856080462448 ns/iter 0.92
Micro_Draft4_Long_Enum_Short_Strings 18.86894860028555 ns/iter 18.781753189315715 ns/iter 1.00
Micro_Draft4_Type_Object 11.019367155823797 ns/iter 10.687389939725003 ns/iter 1.03
Micro_Draft4_Ref_Single_100 17755609.75000019 ns/iter 17331467.299999304 ns/iter 1.02
Micro_Draft4_Ref_Many_Nested 12196922800.999914 ns/iter 11114610783.999979 ns/iter 1.10
E2E_Compiler_adaptivecard 2981215191.9999223 ns/iter 2936669861.999917 ns/iter 1.02
E2E_Compiler_ansible_meta 68400782.39999911 ns/iter 68643849.00000004 ns/iter 1.00
E2E_Compiler_aws_cdk 1301394.6141002572 ns/iter 1309465.8644066532 ns/iter 0.99
E2E_Compiler_babelrc 12638769.374999827 ns/iter 12844099.10909248 ns/iter 0.98
E2E_Compiler_clang_format 56746432.83333581 ns/iter 57822740.16667088 ns/iter 0.98
E2E_Compiler_cmake_presets 1760945778.9999397 ns/iter 1806506751.9999046 ns/iter 0.97
E2E_Compiler_code_climate 8774177.987500308 ns/iter 8977786.858975215 ns/iter 0.98
E2E_Compiler_cql2 264127652.33332416 ns/iter 261284500.66668543 ns/iter 1.01
E2E_Compiler_cspell 259826425.6666501 ns/iter 263554887.33330882 ns/iter 0.99
E2E_Compiler_cypress 32204990.409091104 ns/iter 32073708.045448836 ns/iter 1.00
E2E_Compiler_deno 29032111.125000406 ns/iter 29850594.583336946 ns/iter 0.97
E2E_Compiler_dependabot 12464889.714284563 ns/iter 12683305.145455135 ns/iter 0.98
E2E_Compiler_draft_04 61857404.818180256 ns/iter 63108375.90909945 ns/iter 0.98
E2E_Compiler_fabric_mod 25037202.285716377 ns/iter 24854103.03570948 ns/iter 1.01
E2E_Compiler_geojson 63450437.81818111 ns/iter 63408209.454544045 ns/iter 1.00
E2E_Compiler_gitpod_configuration 25914736.22222414 ns/iter 26021584.185181618 ns/iter 1.00
E2E_Compiler_helm_chart_lock 4780405.397260027 ns/iter 4897906.951724696 ns/iter 0.98
E2E_Compiler_importmap 1726129.348894384 ns/iter 1752917.0348259741 ns/iter 0.98
E2E_Compiler_jasmine 5922963.228813696 ns/iter 5991674.982757606 ns/iter 0.99
E2E_Compiler_jshintrc 17264923.170731023 ns/iter 17587968.050003156 ns/iter 0.98
E2E_Compiler_jsconfig 63451256.7272726 ns/iter 64187828.9999857 ns/iter 0.99
E2E_Compiler_krakend 819418470.999949 ns/iter 832243181.9999565 ns/iter 0.98
E2E_Compiler_lazygit 127509000.39998214 ns/iter 124262288.33332212 ns/iter 1.03
E2E_Compiler_lerna 6583232.96116485 ns/iter 6744688.961536948 ns/iter 0.98
E2E_Compiler_nest_cli 37199596.26315765 ns/iter 38138579.16665913 ns/iter 0.98
E2E_Compiler_omc 3431145057.99997 ns/iter 3362027420.9999933 ns/iter 1.02
E2E_Compiler_omnisharp 21442670.363636684 ns/iter 21522365.5454517 ns/iter 1.00
E2E_Compiler_openapi 1806079206.0000494 ns/iter 1754592544.9999232 ns/iter 1.03
E2E_Compiler_pre_commit_hooks 10153922.971014345 ns/iter 10097717.55714155 ns/iter 1.01
E2E_Compiler_pulumi 16601578.357142985 ns/iter 16604799.309523817 ns/iter 1.00
E2E_Compiler_semantic_release 4708116.496644743 ns/iter 4769941.819999985 ns/iter 0.99
E2E_Compiler_stale 4821442.753424971 ns/iter 4905371.195804406 ns/iter 0.98
E2E_Compiler_stylecop 18324553.578948826 ns/iter 18712108.28947393 ns/iter 0.98
E2E_Compiler_tmuxinator 6465909.972476816 ns/iter 6582809.05607545 ns/iter 0.98
E2E_Compiler_ui5 375255102.4999775 ns/iter 379012596.500047 ns/iter 0.99
E2E_Compiler_ui5_manifest 5011010025.000019 ns/iter 4900197075.000051 ns/iter 1.02
E2E_Compiler_unreal_engine_uproject 18667256.3157889 ns/iter 18976888.918918908 ns/iter 0.98
E2E_Compiler_vercel 61242227.45454104 ns/iter 61140163.90909621 ns/iter 1.00
E2E_Compiler_yamllint 8257797.082352921 ns/iter 8197035.3023258895 ns/iter 1.01
E2E_Evaluator_adaptivecard 56970.9694550781 ns/iter 55040.23214427066 ns/iter 1.04
E2E_Evaluator_ansible_meta 327510.87260848144 ns/iter 314182.6493682469 ns/iter 1.04
E2E_Evaluator_aws_cdk 59114.779145240354 ns/iter 56705.91275546265 ns/iter 1.04
E2E_Evaluator_babelrc 146389.30175803488 ns/iter 142752.18148965487 ns/iter 1.03
E2E_Evaluator_clang_format 106441.32209737119 ns/iter 101910.09093562345 ns/iter 1.04
E2E_Evaluator_cmake_presets 5760376.040322238 ns/iter 4955162.847826008 ns/iter 1.16
E2E_Evaluator_code_climate 229776.94017093958 ns/iter 223805.6935691204 ns/iter 1.03
E2E_Evaluator_cql2 287755.6527436612 ns/iter 281266.2592137276 ns/iter 1.02
E2E_Evaluator_cspell 1062554.0500000445 ns/iter 1033134.5029852 ns/iter 1.03
E2E_Evaluator_cypress 174401.76940353416 ns/iter 171724.3019282462 ns/iter 1.02
E2E_Evaluator_deno 562660.9279935386 ns/iter 562306.4172779145 ns/iter 1.00
E2E_Evaluator_dependabot 483978.1010309004 ns/iter 472210.36700338963 ns/iter 1.02
E2E_Evaluator_draft_04 10421918.552239405 ns/iter 8675289.200002111 ns/iter 1.20
E2E_Evaluator_fabric_mod 1363694.4691357813 ns/iter 1360360.3005891927 ns/iter 1.00
E2E_Evaluator_geojson 23296619.033336204 ns/iter 21109477.51515541 ns/iter 1.10
E2E_Evaluator_gitpod_configuration 294405.5300799285 ns/iter 290686.3037190095 ns/iter 1.01
E2E_Evaluator_helm_chart_lock 354672.08422663546 ns/iter 353212.90867349657 ns/iter 1.00
E2E_Evaluator_importmap 60188.65490562737 ns/iter 60164.50807025189 ns/iter 1.00
E2E_Evaluator_jasmine 144577.0399259117 ns/iter 140302.02489443522 ns/iter 1.03
E2E_Evaluator_jshintrc 965014.1646092808 ns/iter 951859.2639454125 ns/iter 1.01
E2E_Evaluator_jsconfig 702375.3709349913 ns/iter 698357.8434342648 ns/iter 1.01
E2E_Evaluator_krakend 329101.519905182 ns/iter 323902.39582366287 ns/iter 1.02
E2E_Evaluator_lazygit 191318.0745984334 ns/iter 192534.84102559843 ns/iter 0.99
E2E_Evaluator_lerna 150541.24589100096 ns/iter 146437.4216409798 ns/iter 1.03
E2E_Evaluator_nest_cli 233175.2527040727 ns/iter 224660.57679948298 ns/iter 1.04
E2E_Evaluator_omc 29330.30069006439 ns/iter 28470.97289927431 ns/iter 1.03
E2E_Evaluator_omnisharp 546980.8560312571 ns/iter 545166.696664072 ns/iter 1.00
E2E_Evaluator_openapi 19808598.85294622 ns/iter 18200794.350002524 ns/iter 1.09
E2E_Evaluator_pre_commit_hooks 535625.9475683434 ns/iter 521603.4888227844 ns/iter 1.03
E2E_Evaluator_pulumi 840130.5095467815 ns/iter 808285.3850575556 ns/iter 1.04
E2E_Evaluator_semantic_release 137138.2542272968 ns/iter 136306.87348817056 ns/iter 1.01
E2E_Evaluator_stale 148580.49203355433 ns/iter 142904.88983224513 ns/iter 1.04
E2E_Evaluator_stylecop 518436.71525667555 ns/iter 505733.0196362851 ns/iter 1.03
E2E_Evaluator_tmuxinator 128236.64276661664 ns/iter 126569.32261525077 ns/iter 1.01
E2E_Evaluator_ui5 790946.4343891373 ns/iter 761566.7879782534 ns/iter 1.04
E2E_Evaluator_ui5_manifest 5818258.610294351 ns/iter 4904425.841726302 ns/iter 1.19
E2E_Evaluator_unreal_engine_uproject 702801.2595573213 ns/iter 690662.9483103211 ns/iter 1.02
E2E_Evaluator_vercel 351597.06797580334 ns/iter 344493.37285648356 ns/iter 1.02
E2E_Evaluator_yamllint 14179.230356520631 ns/iter 13597.07635367872 ns/iter 1.04

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 7a9943e Previous: be74b45 Ratio
E2E_Compiler_adaptivecard 2957045584.0000706 ns/iter 3550388290.99999 ns/iter 0.83
E2E_Compiler_ansible_meta 68742558.29999356 ns/iter 87798963.50000627 ns/iter 0.78
E2E_Compiler_aws_cdk 1147941.1055362504 ns/iter 1659226.8260870592 ns/iter 0.69
E2E_Compiler_babelrc 11374923.120689768 ns/iter 14889017.960782956 ns/iter 0.76
E2E_Compiler_clang_format 53724804.19999875 ns/iter 76818772.46154028 ns/iter 0.70
E2E_Compiler_cmake_presets 1612863082.9999793 ns/iter 2094738874.9999619 ns/iter 0.77
E2E_Compiler_code_climate 8949600.524999823 ns/iter 11743599.686276278 ns/iter 0.76
E2E_Compiler_cql2 207905875.00001344 ns/iter 298005138.66666734 ns/iter 0.70
E2E_Compiler_cspell 228240041.66667083 ns/iter 298520291.49998313 ns/iter 0.76
E2E_Compiler_cypress 37164747.950004086 ns/iter 42247690.06250284 ns/iter 0.88
E2E_Compiler_deno 28999989.58333564 ns/iter 39674553.2777724 ns/iter 0.73
E2E_Compiler_dependabot 14635354.56862781 ns/iter 16706464.999999752 ns/iter 0.88
E2E_Compiler_draft_04 71939658.3000048 ns/iter 74973458.33333687 ns/iter 0.96
E2E_Compiler_fabric_mod 24667748.44444225 ns/iter 26699947.928571127 ns/iter 0.92
E2E_Compiler_geojson 75013886.36363903 ns/iter 75725828.66666582 ns/iter 0.99
E2E_Compiler_gitpod_configuration 25880009.61538648 ns/iter 28324379.150001276 ns/iter 0.91
E2E_Compiler_helm_chart_lock 5878736.250000429 ns/iter 4884935.1214284655 ns/iter 1.20
E2E_Compiler_importmap 2172211.160714304 ns/iter 1851867.1022445376 ns/iter 1.17
E2E_Compiler_jasmine 9313692.464285765 ns/iter 7205109.693876581 ns/iter 1.29
E2E_Compiler_jshintrc 23219828.27272746 ns/iter 21375953.57142865 ns/iter 1.09
E2E_Compiler_jsconfig 72853320.90000339 ns/iter 73937791.66667022 ns/iter 0.99
E2E_Compiler_krakend 950298333.9999673 ns/iter 1090164708.9999642 ns/iter 0.87
E2E_Compiler_lazygit 147674349.9999884 ns/iter 172772258.40000483 ns/iter 0.85
E2E_Compiler_lerna 7016630.357797229 ns/iter 7339486.822785793 ns/iter 0.96
E2E_Compiler_nest_cli 38045530.11111188 ns/iter 43393104.18750131 ns/iter 0.88
E2E_Compiler_omc 3889830125.0000033 ns/iter 3797636000.0000114 ns/iter 1.02
E2E_Compiler_omnisharp 22177363.86666805 ns/iter 24588913.461535905 ns/iter 0.90
E2E_Compiler_openapi 1421474291.9999707 ns/iter 1697616374.9999387 ns/iter 0.84
E2E_Compiler_pre_commit_hooks 9942359.708860796 ns/iter 11851563.883332498 ns/iter 0.84
E2E_Compiler_pulumi 14436803.921568092 ns/iter 18664660.888889432 ns/iter 0.77
E2E_Compiler_semantic_release 5047438.482352738 ns/iter 5105696.94244587 ns/iter 0.99
E2E_Compiler_stale 5944677.845529137 ns/iter 6145565.437037071 ns/iter 0.97
E2E_Compiler_stylecop 19830888.451613117 ns/iter 24340487.393939123 ns/iter 0.81
E2E_Compiler_tmuxinator 6536727.941177194 ns/iter 6603726.71568684 ns/iter 0.99
E2E_Compiler_ui5 422447937.49995327 ns/iter 474195103.999989 ns/iter 0.89
E2E_Compiler_ui5_manifest 5291068166.000059 ns/iter 5708689415.99997 ns/iter 0.93
E2E_Compiler_unreal_engine_uproject 16176951.704546189 ns/iter 20894276.17142649 ns/iter 0.77
E2E_Compiler_vercel 56339961.83333541 ns/iter 86858505.12499371 ns/iter 0.65
E2E_Compiler_yamllint 8222468.4999995055 ns/iter 11881887.421052676 ns/iter 0.69
E2E_Evaluator_adaptivecard 50448.71884161377 ns/iter 67801.10839999907 ns/iter 0.74
E2E_Evaluator_ansible_meta 281420.2692459489 ns/iter 326636.43235292594 ns/iter 0.86
E2E_Evaluator_aws_cdk 56479.2898669786 ns/iter 56744.41119302318 ns/iter 1.00
E2E_Evaluator_babelrc 112617.17627591625 ns/iter 132712.19604551292 ns/iter 0.85
E2E_Evaluator_clang_format 119486.30066555973 ns/iter 117030.64892335032 ns/iter 1.02
E2E_Evaluator_cmake_presets 3619824.264248818 ns/iter 4906608.598425346 ns/iter 0.74
E2E_Evaluator_code_climate 200803.1412742219 ns/iter 223075.4796988411 ns/iter 0.90
E2E_Evaluator_cql2 292416.4166666619 ns/iter 258437.62460459143 ns/iter 1.13
E2E_Evaluator_cspell 880624.7490953006 ns/iter 888425.9129213282 ns/iter 0.99
E2E_Evaluator_cypress 202827.09503583613 ns/iter 254683.07401926795 ns/iter 0.80
E2E_Evaluator_deno 511987.6669999712 ns/iter 651503.2125550968 ns/iter 0.79
E2E_Evaluator_dependabot 541932.743029431 ns/iter 542740.4580000256 ns/iter 1.00
E2E_Evaluator_draft_04 7716759.94318147 ns/iter 7876353.448275051 ns/iter 0.98
E2E_Evaluator_fabric_mod 1912767.6470588995 ns/iter 1969537.3757578887 ns/iter 0.97
E2E_Evaluator_geojson 16885215.081082284 ns/iter 25075181.818181135 ns/iter 0.67
E2E_Evaluator_gitpod_configuration 253275.59192201484 ns/iter 332029.7706198286 ns/iter 0.76
E2E_Evaluator_helm_chart_lock 319539.69137673744 ns/iter 363744.8544177154 ns/iter 0.88
E2E_Evaluator_importmap 46692.753389282334 ns/iter 53280.6290999929 ns/iter 0.88
E2E_Evaluator_jasmine 141760.4636630715 ns/iter 139378.5281059784 ns/iter 1.02
E2E_Evaluator_jshintrc 1337501.6920473555 ns/iter 1287960.8043476765 ns/iter 1.04
E2E_Evaluator_jsconfig 676611.1236462472 ns/iter 708637.3225508208 ns/iter 0.95
E2E_Evaluator_krakend 343748.330139372 ns/iter 247816.10310786194 ns/iter 1.39
E2E_Evaluator_lazygit 158363.787678218 ns/iter 164056.6714490518 ns/iter 0.97
E2E_Evaluator_lerna 150811.63319761786 ns/iter 189269.37126245323 ns/iter 0.80
E2E_Evaluator_nest_cli 162836.064467461 ns/iter 171077.72556391524 ns/iter 0.95
E2E_Evaluator_omc 18602.757137053886 ns/iter 22278.63286198952 ns/iter 0.84
E2E_Evaluator_omnisharp 419806.2727826151 ns/iter 528814.0830000429 ns/iter 0.79
E2E_Evaluator_openapi 11196890.41096012 ns/iter 14342589.285712663 ns/iter 0.78
E2E_Evaluator_pre_commit_hooks 366873.91378386517 ns/iter 499424.29439890175 ns/iter 0.73
E2E_Evaluator_pulumi 570072.8975791235 ns/iter 655386.0329776902 ns/iter 0.87
E2E_Evaluator_semantic_release 89525.16056519216 ns/iter 111935.00241700982 ns/iter 0.80
E2E_Evaluator_stale 110702.55433328496 ns/iter 120160.56980004335 ns/iter 0.92
E2E_Evaluator_stylecop 322659.38189847337 ns/iter 323219.44973792345 ns/iter 1.00
E2E_Evaluator_tmuxinator 84133.7334933957 ns/iter 86163.81923538935 ns/iter 0.98
E2E_Evaluator_ui5 555789.5956191735 ns/iter 612895.1856738803 ns/iter 0.91
E2E_Evaluator_ui5_manifest 3006534.4928231393 ns/iter 3466281.2911392394 ns/iter 0.87
E2E_Evaluator_unreal_engine_uproject 427980.93093090295 ns/iter 493492.0963035337 ns/iter 0.87
E2E_Evaluator_vercel 238811.44142557448 ns/iter 347960.2502017642 ns/iter 0.69
E2E_Evaluator_yamllint 12554.383753993552 ns/iter 18230.551671309237 ns/iter 0.69
Micro_Draft4_Meta_1_No_Callback 208.8281745892592 ns/iter 263.93642655853716 ns/iter 0.79
Micro_Draft4_Required_Properties 547.4047305229991 ns/iter 766.2244122486748 ns/iter 0.71
Micro_Draft4_Many_Optional_Properties_Minimal_Match 28.469882020071456 ns/iter 32.7926552403804 ns/iter 0.87
Micro_Draft4_Few_Optional_Properties_Minimal_Match 7.984374661042325 ns/iter 9.291276518428974 ns/iter 0.86
Micro_Draft4_Items_Schema 488.530504103468 ns/iter 665.6663686761643 ns/iter 0.73
Micro_Draft4_Nested_Object 3.110139113829487 ns/iter 4.389983410907091 ns/iter 0.71
Micro_Draft4_Properties_Triad_Optional 734.8174950445612 ns/iter 948.7412803979973 ns/iter 0.77
Micro_Draft4_Properties_Triad_Closed 579.9207616231291 ns/iter 694.6285908175184 ns/iter 0.83
Micro_Draft4_Properties_Triad_Required 721.6569535425162 ns/iter 944.9995440463408 ns/iter 0.76
Micro_Draft4_Properties_Closed 58.357116676144365 ns/iter 63.0959282242966 ns/iter 0.92
Micro_Draft4_Non_Recursive_Ref 20.172430058735454 ns/iter 23.382408049736938 ns/iter 0.86
Micro_Draft4_Pattern_Properties_True 185.38573314852587 ns/iter 181.09306776020532 ns/iter 1.02
Micro_Draft4_Ref_To_Single_Property 11.789102482446829 ns/iter 7.7411203750441775 ns/iter 1.52
Micro_Draft4_Additional_Properties_Type 43.71630740036205 ns/iter 36.004177248158186 ns/iter 1.21
Micro_Draft4_Nested_Oneof 64.91608426512688 ns/iter 58.407087828517206 ns/iter 1.11
Micro_Draft4_Short_Enum 10.404563314891643 ns/iter 20.079611239103524 ns/iter 0.52
Micro_Draft4_Long_Enum 27.619919993357673 ns/iter 31.26008197272913 ns/iter 0.88
Micro_Draft4_Long_Enum_Short_Strings 11.702105892569621 ns/iter 14.412438361719081 ns/iter 0.81
Micro_Draft4_Type_Object 5.697352915138875 ns/iter 7.725317306610561 ns/iter 0.74
Micro_Draft4_Ref_Single_100 16382613.525001943 ns/iter 33618526.679997556 ns/iter 0.49
Micro_Draft4_Ref_Many_Nested 9417536583.999891 ns/iter 15961329291.000084 ns/iter 0.59
Micro_Draft6_Property_Names 125.19618459615022 ns/iter 123.8607382200278 ns/iter 1.01
Micro_Draft7_If_Then_Else 29.3774070485874 ns/iter 35.305750368237 ns/iter 0.83
Micro_2019_09_Unevaluated_Properties 47.39596290334506 ns/iter 47.32060477704183 ns/iter 1.00
Micro_2020_12_Dynamic_Ref 692.897796800899 ns/iter 482.39985996343404 ns/iter 1.44
Micro_2020_12_Dynamic_Ref_Single 8.943700323351043 ns/iter 7.150343562941561 ns/iter 1.25

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit 078d953 into main Oct 30, 2025
13 checks passed
@jviotti jviotti deleted the test-suite-new-5 branch October 30, 2025 13:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant