Skip to content

Upgrade JSON Schema Test Suite to latest#548

Merged
jviotti merged 1 commit into
mainfrom
suite-new
Nov 11, 2025
Merged

Upgrade JSON Schema Test Suite to latest#548
jviotti merged 1 commit into
mainfrom
suite-new

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented Nov 10, 2025

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 75f3cda Previous: 182df37 Ratio
E2E_Compiler_adaptivecard 2592143353.0000114 ns/iter 2856230185.999948 ns/iter 0.91
E2E_Compiler_ansible_meta 57298471.58333475 ns/iter 61280624.636367515 ns/iter 0.94
E2E_Compiler_aws_cdk 1071866.162790723 ns/iter 1173707.6369747547 ns/iter 0.91
E2E_Compiler_babelrc 10600382.181817994 ns/iter 11310139.213114819 ns/iter 0.94
E2E_Compiler_clang_format 46938817.49999816 ns/iter 51030334.07142935 ns/iter 0.92
E2E_Compiler_cmake_presets 1455548212.999986 ns/iter 1586459565.000041 ns/iter 0.92
E2E_Compiler_code_climate 7304967.074467887 ns/iter 7775044.865168771 ns/iter 0.94
E2E_Compiler_cql2 207358408.6666642 ns/iter 225428309.66667303 ns/iter 0.92
E2E_Compiler_cspell 218998317.3333303 ns/iter 242435275.33332098 ns/iter 0.90
E2E_Compiler_cypress 27282694.76923209 ns/iter 29039772.66666639 ns/iter 0.94
E2E_Compiler_deno 24363671.96551812 ns/iter 26311263.407409217 ns/iter 0.93
E2E_Compiler_dependabot 10265516.55882332 ns/iter 11116849.238095572 ns/iter 0.92
E2E_Compiler_draft_04 50630214.14285832 ns/iter 55177856.692304984 ns/iter 0.92
E2E_Compiler_fabric_mod 20878528.24242494 ns/iter 22733592.612903595 ns/iter 0.92
E2E_Compiler_geojson 50308711.21428504 ns/iter 54844487.92307936 ns/iter 0.92
E2E_Compiler_gitpod_configuration 21775876.843751263 ns/iter 23536742.13333458 ns/iter 0.93
E2E_Compiler_helm_chart_lock 4043767.0228571477 ns/iter 4388161.592356745 ns/iter 0.92
E2E_Compiler_importmap 1482553.389690711 ns/iter 1564069.1968325258 ns/iter 0.95
E2E_Compiler_jasmine 4908959.818181642 ns/iter 5307530.160305461 ns/iter 0.92
E2E_Compiler_jshintrc 14434966.795919053 ns/iter 15225404.000000255 ns/iter 0.95
E2E_Compiler_jsconfig 52863124.15384705 ns/iter 57203297.749997735 ns/iter 0.92
E2E_Compiler_krakend 680897146.0000066 ns/iter 756023628.9999694 ns/iter 0.90
E2E_Compiler_lazygit 100515985.57142986 ns/iter 109617405.49999869 ns/iter 0.92
E2E_Compiler_lerna 5502908.2992126765 ns/iter 5883466.45299126 ns/iter 0.94
E2E_Compiler_nest_cli 30893123.17391214 ns/iter 33549359.666665167 ns/iter 0.92
E2E_Compiler_omc 2531656225.9999957 ns/iter 2773636753.9999948 ns/iter 0.91
E2E_Compiler_omnisharp 17851924.66666657 ns/iter 19232504.416666847 ns/iter 0.93
E2E_Compiler_openapi 1384184293.9999652 ns/iter 1496502278.0000367 ns/iter 0.92
E2E_Compiler_pre_commit_hooks 8386112.313253334 ns/iter 8986338.49999952 ns/iter 0.93
E2E_Compiler_pulumi 13847204.941176489 ns/iter 14916099.851063792 ns/iter 0.93
E2E_Compiler_semantic_release 3876251.544444484 ns/iter 4201811.461538611 ns/iter 0.92
E2E_Compiler_stale 4359026.310558939 ns/iter 4662145.939597095 ns/iter 0.93
E2E_Compiler_stylecop 15426499.659091838 ns/iter 16826044.238095097 ns/iter 0.92
E2E_Compiler_tmuxinator 5361132.435114225 ns/iter 5767315.302520974 ns/iter 0.93
E2E_Compiler_ui5 313420793.99999535 ns/iter 348881395.5000012 ns/iter 0.90
E2E_Compiler_ui5_manifest 4113120494.000043 ns/iter 4549854078.999999 ns/iter 0.90
E2E_Compiler_unreal_engine_uproject 15770218.704545869 ns/iter 16900929.51219512 ns/iter 0.93
E2E_Compiler_vercel 50832559.14285749 ns/iter 55471532.99999781 ns/iter 0.92
E2E_Compiler_yamllint 8058081.540230239 ns/iter 8660145.358025018 ns/iter 0.93
E2E_Evaluator_adaptivecard 49785.84547230331 ns/iter 53907.759007082685 ns/iter 0.92
E2E_Evaluator_ansible_meta 298381.81788750016 ns/iter 311539.55338079005 ns/iter 0.96
E2E_Evaluator_aws_cdk 64113.54264259214 ns/iter 69603.78058328359 ns/iter 0.92
E2E_Evaluator_babelrc 149716.19509098367 ns/iter 161302.52497687496 ns/iter 0.93
E2E_Evaluator_clang_format 126676.6589048552 ns/iter 137584.62969659508 ns/iter 0.92
E2E_Evaluator_cmake_presets 4783312.700680334 ns/iter 5341715.424000086 ns/iter 0.90
E2E_Evaluator_code_climate 256717.9476327215 ns/iter 271477.519577116 ns/iter 0.95
E2E_Evaluator_cql2 238472.27453670502 ns/iter 265756.0415396367 ns/iter 0.90
E2E_Evaluator_cspell 583645.0346283712 ns/iter 637466.3924977364 ns/iter 0.92
E2E_Evaluator_cypress 214510.10866912152 ns/iter 231462.56878306976 ns/iter 0.93
E2E_Evaluator_deno 355470.8451349962 ns/iter 384248.7484798161 ns/iter 0.93
E2E_Evaluator_dependabot 514866.2595588275 ns/iter 561632.951277938 ns/iter 0.92
E2E_Evaluator_draft_04 7381571.27173931 ns/iter 9506292.17808212 ns/iter 0.78
E2E_Evaluator_fabric_mod 863717.7006134978 ns/iter 943565.1567567473 ns/iter 0.92
E2E_Evaluator_geojson 23203981.599999677 ns/iter 26060410.148149747 ns/iter 0.89
E2E_Evaluator_gitpod_configuration 293704.51516411424 ns/iter 319797.6810737281 ns/iter 0.92
E2E_Evaluator_helm_chart_lock 402008.0153933971 ns/iter 440744.3567807438 ns/iter 0.91
E2E_Evaluator_importmap 63575.24683600094 ns/iter 69635.99346275986 ns/iter 0.91
E2E_Evaluator_jasmine 152121.24123844184 ns/iter 164714.7567947541 ns/iter 0.92
E2E_Evaluator_jshintrc 1223881.5295139025 ns/iter 1320464.7849056744 ns/iter 0.93
E2E_Evaluator_jsconfig 473215.5602164958 ns/iter 515171.1953010564 ns/iter 0.92
E2E_Evaluator_krakend 240559.94355955275 ns/iter 264266.13069908175 ns/iter 0.91
E2E_Evaluator_lazygit 174067.9954694182 ns/iter 189624.43309198142 ns/iter 0.92
E2E_Evaluator_lerna 186365.57481800672 ns/iter 204570.9701967466 ns/iter 0.91
E2E_Evaluator_nest_cli 233321.88125417044 ns/iter 253247.4240028764 ns/iter 0.92
E2E_Evaluator_omc 27713.997886845267 ns/iter 31707.214870458323 ns/iter 0.87
E2E_Evaluator_omnisharp 658464.969896529 ns/iter 720469.5927834879 ns/iter 0.91
E2E_Evaluator_openapi 13079130.961538855 ns/iter 16536682.425000038 ns/iter 0.79
E2E_Evaluator_pre_commit_hooks 540842.8772200586 ns/iter 588655.9324894618 ns/iter 0.92
E2E_Evaluator_pulumi 801125.0660694519 ns/iter 871262.6583850415 ns/iter 0.92
E2E_Evaluator_semantic_release 130150.96219930846 ns/iter 143793.09987869352 ns/iter 0.91
E2E_Evaluator_stale 157582.25517552858 ns/iter 173152.11154888125 ns/iter 0.91
E2E_Evaluator_stylecop 332942.5786223413 ns/iter 364539.5854545455 ns/iter 0.91
E2E_Evaluator_tmuxinator 122406.15541601175 ns/iter 135071.5291738831 ns/iter 0.91
E2E_Evaluator_ui5 644597.6113657351 ns/iter 694373.4351297504 ns/iter 0.93
E2E_Evaluator_ui5_manifest 3076542.389140377 ns/iter 3451579.924242449 ns/iter 0.89
E2E_Evaluator_unreal_engine_uproject 497788.0497803616 ns/iter 554714.3890649594 ns/iter 0.90
E2E_Evaluator_vercel 353885.5200202641 ns/iter 383685.1426211276 ns/iter 0.92
E2E_Evaluator_yamllint 15273.052519315781 ns/iter 16754.325085747183 ns/iter 0.91
Micro_Draft4_Meta_1_No_Callback 266.57534918401734 ns/iter 282.1688489846269 ns/iter 0.94
Micro_Draft4_Required_Properties 623.6385224344702 ns/iter 676.7155933556493 ns/iter 0.92
Micro_Draft4_Many_Optional_Properties_Minimal_Match 33.95807433542906 ns/iter 36.72042550602305 ns/iter 0.92
Micro_Draft4_Few_Optional_Properties_Minimal_Match 14.381071095908405 ns/iter 15.55674719316336 ns/iter 0.92
Micro_Draft4_Items_Schema 578.4976905379627 ns/iter 636.7843468504215 ns/iter 0.91
Micro_Draft4_Nested_Object 6.905954055372882 ns/iter 7.467281083311589 ns/iter 0.92
Micro_Draft4_Properties_Triad_Optional 356.6894074130045 ns/iter 389.98033408507894 ns/iter 0.91
Micro_Draft4_Properties_Triad_Closed 297.6157729270046 ns/iter 323.52635314064446 ns/iter 0.92
Micro_Draft4_Properties_Triad_Required 350.356833103993 ns/iter 379.13232094949313 ns/iter 0.92
Micro_Draft4_Properties_Closed 79.10054955870208 ns/iter 83.8374170766749 ns/iter 0.94
Micro_Draft4_Non_Recursive_Ref 29.002965201833778 ns/iter 31.44396792807069 ns/iter 0.92
Micro_Draft4_Pattern_Properties_True 247.0387964896634 ns/iter 267.9884160247873 ns/iter 0.92
Micro_Draft4_Ref_To_Single_Property 14.380218662791197 ns/iter 15.55948550607193 ns/iter 0.92
Micro_Draft4_Additional_Properties_Type 51.740680176589976 ns/iter 56.05924651748343 ns/iter 0.92
Micro_Draft4_Nested_Oneof 82.69801294534876 ns/iter 89.63150906901143 ns/iter 0.92
Micro_Draft4_Short_Enum 16.634759152158217 ns/iter 18.04672445146676 ns/iter 0.92
Micro_Draft4_Long_Enum 21.575515549654092 ns/iter 23.335507357747403 ns/iter 0.92
Micro_Draft4_Long_Enum_Short_Strings 16.933253666103067 ns/iter 18.387086801186985 ns/iter 0.92
Micro_Draft4_Type_Object 12.059384941840543 ns/iter 13.062122547253004 ns/iter 0.92
Micro_Draft4_Ref_Single_100 15216258.2608701 ns/iter 16337521.139535002 ns/iter 0.93
Micro_Draft4_Ref_Many_Nested 8801021744.000025 ns/iter 10242113105.000044 ns/iter 0.86
Micro_Draft6_Property_Names 128.23469191234193 ns/iter 138.57112993395694 ns/iter 0.93
Micro_Draft7_If_Then_Else 40.598783310165935 ns/iter 43.90127509701723 ns/iter 0.92
Micro_2019_09_Unevaluated_Properties 50.31214670989954 ns/iter 54.9254960715962 ns/iter 0.92
Micro_2020_12_Dynamic_Ref 504.9646324306695 ns/iter 540.1221429108929 ns/iter 0.93
Micro_2020_12_Dynamic_Ref_Single 12.065521225586126 ns/iter 13.072161596647966 ns/iter 0.92
Micro_2020_12_Simple_Output_Mask 129855.03402612587 ns/iter 145949.71233160142 ns/iter 0.89
Micro_2020_12_Simple_Output_Annotations 155308.9841420105 ns/iter 177464.1443970909 ns/iter 0.88

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 75f3cda Previous: 182df37 Ratio
E2E_Compiler_adaptivecard 3243996707.9999404 ns/iter 2838207208.0000854 ns/iter 1.14
E2E_Compiler_ansible_meta 72353237.49999908 ns/iter 65066465.33333083 ns/iter 1.11
E2E_Compiler_aws_cdk 1280900.257713294 ns/iter 1140075.011251818 ns/iter 1.12
E2E_Compiler_babelrc 12700797.413793711 ns/iter 11214118.264704479 ns/iter 1.13
E2E_Compiler_clang_format 53080145.857141554 ns/iter 44846851.562496684 ns/iter 1.18
E2E_Compiler_cmake_presets 1969900541.0000155 ns/iter 1420706874.9999506 ns/iter 1.39
E2E_Compiler_code_climate 8648551.666666815 ns/iter 9246106.692306876 ns/iter 0.94
E2E_Compiler_cql2 202555791.75000092 ns/iter 224278805.66666165 ns/iter 0.90
E2E_Compiler_cspell 248341403.00000247 ns/iter 315711458.33330166 ns/iter 0.79
E2E_Compiler_cypress 49528219.263158076 ns/iter 34304645.83333206 ns/iter 1.44
E2E_Compiler_deno 40890779.76190462 ns/iter 28900501.555557203 ns/iter 1.41
E2E_Compiler_dependabot 12579342.313725362 ns/iter 10669961.148649335 ns/iter 1.18
E2E_Compiler_draft_04 67954888.91666916 ns/iter 56189180.58332649 ns/iter 1.21
E2E_Compiler_fabric_mod 27895665.178570133 ns/iter 21467230.2631578 ns/iter 1.30
E2E_Compiler_geojson 85316356.44444829 ns/iter 58021743.61538339 ns/iter 1.47
E2E_Compiler_gitpod_configuration 27321104.16666937 ns/iter 20699818.548384808 ns/iter 1.32
E2E_Compiler_helm_chart_lock 4579625.000000036 ns/iter 3669611.7197802127 ns/iter 1.25
E2E_Compiler_importmap 1782028.8602794614 ns/iter 1401626.5930436216 ns/iter 1.27
E2E_Compiler_jasmine 7590993.469879794 ns/iter 5162563.110293577 ns/iter 1.47
E2E_Compiler_jshintrc 21223034.00000192 ns/iter 16189590.42553178 ns/iter 1.31
E2E_Compiler_jsconfig 71028382.54544705 ns/iter 53756895.89999411 ns/iter 1.32
E2E_Compiler_krakend 967071125.000075 ns/iter 705081875.000019 ns/iter 1.37
E2E_Compiler_lazygit 144955991.59999985 ns/iter 107853053.57142404 ns/iter 1.34
E2E_Compiler_lerna 6953957.386364415 ns/iter 5130349.170000273 ns/iter 1.36
E2E_Compiler_nest_cli 38372222.222228125 ns/iter 29295987.1538432 ns/iter 1.31
E2E_Compiler_omc 3584308292.0000596 ns/iter 2651892999.999973 ns/iter 1.35
E2E_Compiler_omnisharp 24797307.692311347 ns/iter 19686156.25000041 ns/iter 1.26
E2E_Compiler_openapi 1570004874.999995 ns/iter 1322442667.0000184 ns/iter 1.19
E2E_Compiler_pre_commit_hooks 9939657.742856005 ns/iter 9427656.901234064 ns/iter 1.05
E2E_Compiler_pulumi 18349879.073170774 ns/iter 14689441.351852868 ns/iter 1.25
E2E_Compiler_semantic_release 4997511.055555494 ns/iter 4019456.123529942 ns/iter 1.24
E2E_Compiler_stale 5897696.887324189 ns/iter 4539524.604027083 ns/iter 1.30
E2E_Compiler_stylecop 20985705.818178978 ns/iter 14811548.913042849 ns/iter 1.42
E2E_Compiler_tmuxinator 5942620.049504422 ns/iter 4877790.492957315 ns/iter 1.22
E2E_Compiler_ui5 386890937.49997026 ns/iter 285198499.9999786 ns/iter 1.36
E2E_Compiler_ui5_manifest 4659716499.999945 ns/iter 3809625250.000067 ns/iter 1.22
E2E_Compiler_unreal_engine_uproject 19312923.97499931 ns/iter 14846026.522726355 ns/iter 1.30
E2E_Compiler_vercel 68490285.30768919 ns/iter 55310072.91666394 ns/iter 1.24
E2E_Compiler_yamllint 10989477.272727126 ns/iter 11075567.773332296 ns/iter 0.99
E2E_Evaluator_adaptivecard 43254.83926128768 ns/iter 54579.08489697601 ns/iter 0.79
E2E_Evaluator_ansible_meta 225827.06052312316 ns/iter 254848.5655765889 ns/iter 0.89
E2E_Evaluator_aws_cdk 58584.59708885793 ns/iter 49850.99763772189 ns/iter 1.18
E2E_Evaluator_babelrc 131668.6574491945 ns/iter 115934.30278422704 ns/iter 1.14
E2E_Evaluator_clang_format 140479.47519056013 ns/iter 132129.4330489307 ns/iter 1.06
E2E_Evaluator_cmake_presets 3971003.0437960005 ns/iter 3982215.207446295 ns/iter 1.00
E2E_Evaluator_code_climate 195250.62780934604 ns/iter 167595.89125238577 ns/iter 1.17
E2E_Evaluator_cql2 252208.5640484817 ns/iter 167329.68063096923 ns/iter 1.51
E2E_Evaluator_cspell 652114.3364929127 ns/iter 505943.47356049594 ns/iter 1.29
E2E_Evaluator_cypress 275090.0081917493 ns/iter 177763.42429579725 ns/iter 1.55
E2E_Evaluator_deno 398825.27013424505 ns/iter 329659.5158459531 ns/iter 1.21
E2E_Evaluator_dependabot 456597.2533936752 ns/iter 350044.2296258443 ns/iter 1.30
E2E_Evaluator_draft_04 7471131.609756091 ns/iter 7268804.195121455 ns/iter 1.03
E2E_Evaluator_fabric_mod 772414.4034206219 ns/iter 612622.9713043793 ns/iter 1.26
E2E_Evaluator_geojson 17552567.857144043 ns/iter 15131814.723405752 ns/iter 1.16
E2E_Evaluator_gitpod_configuration 248108.38674031114 ns/iter 209445.37037038084 ns/iter 1.18
E2E_Evaluator_helm_chart_lock 320607.1237363688 ns/iter 274668.40231861826 ns/iter 1.17
E2E_Evaluator_importmap 50507.15102974975 ns/iter 40890.34543097508 ns/iter 1.24
E2E_Evaluator_jasmine 123558.35696360546 ns/iter 108124.14436726585 ns/iter 1.14
E2E_Evaluator_jshintrc 1172740.2614108818 ns/iter 1146252.410488375 ns/iter 1.02
E2E_Evaluator_jsconfig 394811.44359946024 ns/iter 405242.1681006249 ns/iter 0.97
E2E_Evaluator_krakend 174856.31426311593 ns/iter 293160.3407021864 ns/iter 0.60
E2E_Evaluator_lazygit 119085.9117750965 ns/iter 186375.3910955935 ns/iter 0.64
E2E_Evaluator_lerna 155046.14797863184 ns/iter 239677.2369089997 ns/iter 0.65
E2E_Evaluator_nest_cli 172206.8336409889 ns/iter 315521.59837653075 ns/iter 0.55
E2E_Evaluator_omc 23289.45247001525 ns/iter 27373.2264636206 ns/iter 0.85
E2E_Evaluator_omnisharp 563489.0420000147 ns/iter 505313.6669999958 ns/iter 1.12
E2E_Evaluator_openapi 11526208.338710282 ns/iter 10363188.838709902 ns/iter 1.11
E2E_Evaluator_pre_commit_hooks 486573.38435374666 ns/iter 513858.2990749938 ns/iter 0.95
E2E_Evaluator_pulumi 684426.1621315782 ns/iter 608635.6294859739 ns/iter 1.12
E2E_Evaluator_semantic_release 108022.2633543899 ns/iter 97795.144157805 ns/iter 1.10
E2E_Evaluator_stale 136462.01711808288 ns/iter 107084.9217851656 ns/iter 1.27
E2E_Evaluator_stylecop 369199.5579567647 ns/iter 217149.43778111757 ns/iter 1.70
E2E_Evaluator_tmuxinator 119201.09698948624 ns/iter 81999.23929268176 ns/iter 1.45
E2E_Evaluator_ui5 553217.528448319 ns/iter 402976.992409868 ns/iter 1.37
E2E_Evaluator_ui5_manifest 2400077.986725596 ns/iter 2416025.259067471 ns/iter 0.99
E2E_Evaluator_unreal_engine_uproject 410806.3871748526 ns/iter 398074.39473684283 ns/iter 1.03
E2E_Evaluator_vercel 264337.8474836958 ns/iter 266391.8229665042 ns/iter 0.99
E2E_Evaluator_yamllint 11804.258575198599 ns/iter 17290.749578614897 ns/iter 0.68
Micro_Draft4_Meta_1_No_Callback 229.24908345395073 ns/iter 260.8764959309176 ns/iter 0.88
Micro_Draft4_Required_Properties 485.481427279613 ns/iter 508.078388766035 ns/iter 0.96
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.720935565061623 ns/iter 21.029909842715092 ns/iter 1.03
Micro_Draft4_Few_Optional_Properties_Minimal_Match 7.289943451793453 ns/iter 7.146009457636902 ns/iter 1.02
Micro_Draft4_Items_Schema 446.20671245022515 ns/iter 432.1158126609901 ns/iter 1.03
Micro_Draft4_Nested_Object 3.2796609422669993 ns/iter 2.6787855460422794 ns/iter 1.22
Micro_Draft4_Properties_Triad_Optional 460.68228406267315 ns/iter 295.06984200175907 ns/iter 1.56
Micro_Draft4_Properties_Triad_Closed 376.0005782495926 ns/iter 251.30603888057655 ns/iter 1.50
Micro_Draft4_Properties_Triad_Required 455.3707056759893 ns/iter 302.23691933719755 ns/iter 1.51
Micro_Draft4_Properties_Closed 57.4524733055239 ns/iter 47.608756980039885 ns/iter 1.21
Micro_Draft4_Non_Recursive_Ref 18.858482351535525 ns/iter 17.5707342570485 ns/iter 1.07
Micro_Draft4_Pattern_Properties_True 162.996216107577 ns/iter 144.98692968700223 ns/iter 1.12
Micro_Draft4_Ref_To_Single_Property 7.468843807084322 ns/iter 7.049136488094365 ns/iter 1.06
Micro_Draft4_Additional_Properties_Type 33.651098772416915 ns/iter 33.31964655182313 ns/iter 1.01
Micro_Draft4_Nested_Oneof 54.43913646684107 ns/iter 54.73953335543458 ns/iter 0.99
Micro_Draft4_Short_Enum 9.156785702104523 ns/iter 9.10894357638927 ns/iter 1.01
Micro_Draft4_Long_Enum 23.033543287983385 ns/iter 22.481033699225698 ns/iter 1.02
Micro_Draft4_Long_Enum_Short_Strings 10.514049677066751 ns/iter 10.16247871674676 ns/iter 1.03
Micro_Draft4_Type_Object 5.604653640081837 ns/iter 5.3681049569410195 ns/iter 1.04
Micro_Draft4_Ref_Single_100 16896279.48780426 ns/iter 16228191.476191765 ns/iter 1.04
Micro_Draft4_Ref_Many_Nested 9771391499.999935 ns/iter 8524542375.00001 ns/iter 1.15
Micro_Draft6_Property_Names 107.40210332240586 ns/iter 102.23532037362578 ns/iter 1.05
Micro_Draft7_If_Then_Else 28.965788938072173 ns/iter 26.873287833110012 ns/iter 1.08
Micro_2019_09_Unevaluated_Properties 37.319238020953684 ns/iter 40.41426633633832 ns/iter 0.92
Micro_2020_12_Dynamic_Ref 424.0312518547637 ns/iter 469.6784053643939 ns/iter 0.90
Micro_2020_12_Dynamic_Ref_Single 5.443160291747589 ns/iter 5.9987006511063035 ns/iter 0.91
Micro_2020_12_Simple_Output_Mask 136554.15197806663 ns/iter 135346.5346892592 ns/iter 1.01
Micro_2020_12_Simple_Output_Annotations 154659.4227782578 ns/iter 191135.2845654158 ns/iter 0.81

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 75f3cda Previous: 182df37 Ratio
Micro_2020_12_Dynamic_Ref 618.5838546580771 ns/iter 613.2776404857065 ns/iter 1.01
Micro_2020_12_Dynamic_Ref_Single 10.36954924862816 ns/iter 10.364745893767406 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 142083.5284341406 ns/iter 139369.81792940514 ns/iter 1.02
Micro_2020_12_Simple_Output_Annotations 172198.4266437807 ns/iter 171172.79897535595 ns/iter 1.01
Micro_2019_09_Unevaluated_Properties 53.73412880797132 ns/iter 53.810038832028354 ns/iter 1.00
Micro_Draft7_If_Then_Else 45.59367944897355 ns/iter 45.64594493749213 ns/iter 1.00
Micro_Draft6_Property_Names 174.15484860624397 ns/iter 174.1743822756613 ns/iter 1.00
Micro_Draft4_Meta_1_No_Callback 248.47984404099765 ns/iter 247.6904668677835 ns/iter 1.00
Micro_Draft4_Required_Properties 549.5814997786823 ns/iter 548.733314177453 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 30.95782542735633 ns/iter 30.998889529554972 ns/iter 1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match 12.892815517862505 ns/iter 12.911180468344604 ns/iter 1.00
Micro_Draft4_Items_Schema 506.2273160000359 ns/iter 496.50563583593765 ns/iter 1.02
Micro_Draft4_Nested_Object 5.680828684582904 ns/iter 5.679515842083263 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 509.839096075155 ns/iter 541.825969863121 ns/iter 0.94
Micro_Draft4_Properties_Triad_Closed 408.4253702197834 ns/iter 418.8093329171981 ns/iter 0.98
Micro_Draft4_Properties_Triad_Required 552.3684959999855 ns/iter 506.2747393240327 ns/iter 1.09
Micro_Draft4_Properties_Closed 76.66110836444557 ns/iter 76.88027277294141 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 13.56678134957691 ns/iter 13.502064605710153 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 284.0540975034459 ns/iter 284.0436545666027 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 13.023857697299832 ns/iter 12.925815625353977 ns/iter 1.01
Micro_Draft4_Additional_Properties_Type 15.993150688221698 ns/iter 15.997169216518095 ns/iter 1.00
Micro_Draft4_Nested_Oneof 110.70344318741378 ns/iter 110.48051245856988 ns/iter 1.00
Micro_Draft4_Short_Enum 18.721717075953904 ns/iter 18.73232717502909 ns/iter 1.00
Micro_Draft4_Long_Enum 22.586768386493443 ns/iter 22.607162531609568 ns/iter 1.00
Micro_Draft4_Long_Enum_Short_Strings 18.73234346829787 ns/iter 18.74078389644784 ns/iter 1.00
Micro_Draft4_Type_Object 10.384426267976995 ns/iter 10.362844862664522 ns/iter 1.00
Micro_Draft4_Ref_Single_100 17432516.85000189 ns/iter 17430216.463414423 ns/iter 1.00
Micro_Draft4_Ref_Many_Nested 11136807137.000006 ns/iter 11642935889 ns/iter 0.96
E2E_Compiler_adaptivecard 2921330394.0000515 ns/iter 2947990950.9999514 ns/iter 0.99
E2E_Compiler_ansible_meta 67391125.6999986 ns/iter 68156831.6000039 ns/iter 0.99
E2E_Compiler_aws_cdk 1287535.12500001 ns/iter 1269250.784420129 ns/iter 1.01
E2E_Compiler_babelrc 12484551.21428549 ns/iter 12271567.228070349 ns/iter 1.02
E2E_Compiler_clang_format 56248218.24999534 ns/iter 55823413.15384663 ns/iter 1.01
E2E_Compiler_cmake_presets 1713334558.999918 ns/iter 1716927707.9999573 ns/iter 1.00
E2E_Compiler_code_climate 9000958.820512878 ns/iter 8630435.283950849 ns/iter 1.04
E2E_Compiler_cql2 258100579.66665074 ns/iter 259708730.99997032 ns/iter 0.99
E2E_Compiler_cspell 255210445.3333186 ns/iter 255500238.3332976 ns/iter 1.00
E2E_Compiler_cypress 31781774.681819156 ns/iter 31518316.181818176 ns/iter 1.01
E2E_Compiler_deno 28716538.74999917 ns/iter 28644481.9999997 ns/iter 1.00
E2E_Compiler_dependabot 12362980.64912246 ns/iter 12163625.448275479 ns/iter 1.02
E2E_Compiler_draft_04 64761318.5454516 ns/iter 60687836.66666869 ns/iter 1.07
E2E_Compiler_fabric_mod 24700371.571429156 ns/iter 24538477.17241184 ns/iter 1.01
E2E_Compiler_geojson 61633640.99999895 ns/iter 62479202.72726953 ns/iter 0.99
E2E_Compiler_gitpod_configuration 27077490.42307866 ns/iter 25467664.407406792 ns/iter 1.06
E2E_Compiler_helm_chart_lock 4835170.108844049 ns/iter 4684308.711409278 ns/iter 1.03
E2E_Compiler_importmap 1703278.3975609408 ns/iter 1682776.689156811 ns/iter 1.01
E2E_Compiler_jasmine 6099532.783333453 ns/iter 5811704.247933952 ns/iter 1.05
E2E_Compiler_jshintrc 17592592.097560376 ns/iter 16783103.999998838 ns/iter 1.05
E2E_Compiler_jsconfig 62581182.818172984 ns/iter 63540016.63636278 ns/iter 0.98
E2E_Compiler_krakend 798473356.000045 ns/iter 801396542.0000204 ns/iter 1.00
E2E_Compiler_lazygit 121680957.00000472 ns/iter 120126300.50001387 ns/iter 1.01
E2E_Compiler_lerna 6548402.738317406 ns/iter 6457443.657407365 ns/iter 1.01
E2E_Compiler_nest_cli 36966670.68420897 ns/iter 36709081.157895476 ns/iter 1.01
E2E_Compiler_omc 3359324536.000031 ns/iter 3309023875.9999695 ns/iter 1.02
E2E_Compiler_omnisharp 21366057.6363626 ns/iter 21155954.72727102 ns/iter 1.01
E2E_Compiler_openapi 1735093637.0000908 ns/iter 1752816746.0000076 ns/iter 0.99
E2E_Compiler_pre_commit_hooks 10045467.28571378 ns/iter 9930651.112676648 ns/iter 1.01
E2E_Compiler_pulumi 16527649.261904895 ns/iter 16357287.837211007 ns/iter 1.01
E2E_Compiler_semantic_release 4681236.740000258 ns/iter 4639896.125827995 ns/iter 1.01
E2E_Compiler_stale 5172174.858209114 ns/iter 5101254.68115908 ns/iter 1.01
E2E_Compiler_stylecop 18276413.57894998 ns/iter 18026964.769229054 ns/iter 1.01
E2E_Compiler_tmuxinator 6416718.76146804 ns/iter 6355529.621622416 ns/iter 1.01
E2E_Compiler_ui5 364695791.000031 ns/iter 367376844.99996704 ns/iter 0.99
E2E_Compiler_ui5_manifest 4818193446.00001 ns/iter 4811891328.000002 ns/iter 1.00
E2E_Compiler_unreal_engine_uproject 18285026.210525014 ns/iter 18124452.447367683 ns/iter 1.01
E2E_Compiler_vercel 59799782.99999782 ns/iter 59374563.83333028 ns/iter 1.01
E2E_Compiler_yamllint 10084085.869564569 ns/iter 10020367.591549292 ns/iter 1.01
E2E_Evaluator_adaptivecard 55141.01250297119 ns/iter 55741.60553717645 ns/iter 0.99
E2E_Evaluator_ansible_meta 294868.8500830364 ns/iter 299026.88120493473 ns/iter 0.99
E2E_Evaluator_aws_cdk 57228.69449135538 ns/iter 55815.4129868063 ns/iter 1.03
E2E_Evaluator_babelrc 139860.66407341268 ns/iter 141727.2947347514 ns/iter 0.99
E2E_Evaluator_clang_format 103459.2166789611 ns/iter 106732.04128508526 ns/iter 0.97
E2E_Evaluator_cmake_presets 5069450.3740465 ns/iter 5600675.532257759 ns/iter 0.91
E2E_Evaluator_code_climate 221430.61284110986 ns/iter 224540.81306019216 ns/iter 0.99
E2E_Evaluator_cql2 266191.1864854281 ns/iter 270658.90540020517 ns/iter 0.98
E2E_Evaluator_cspell 543280.812598465 ns/iter 548457.7906422885 ns/iter 0.99
E2E_Evaluator_cypress 166938.6669056095 ns/iter 168161.3783138358 ns/iter 0.99
E2E_Evaluator_deno 353160.14379745116 ns/iter 351618.28767821676 ns/iter 1.00
E2E_Evaluator_dependabot 485885.41334251803 ns/iter 479084.97664837836 ns/iter 1.01
E2E_Evaluator_draft_04 7522258.204819838 ns/iter 8383177.293333877 ns/iter 0.90
E2E_Evaluator_fabric_mod 910162.1960785362 ns/iter 949368.7068493895 ns/iter 0.96
E2E_Evaluator_geojson 20974014.818179827 ns/iter 21546235.687502246 ns/iter 0.97
E2E_Evaluator_gitpod_configuration 287274.7415914588 ns/iter 290115.030995146 ns/iter 0.99
E2E_Evaluator_helm_chart_lock 347306.62951959664 ns/iter 344341.41510366125 ns/iter 1.01
E2E_Evaluator_importmap 59381.08443160073 ns/iter 59394.42134783186 ns/iter 1.00
E2E_Evaluator_jasmine 139841.0637795148 ns/iter 139836.68669697785 ns/iter 1.00
E2E_Evaluator_jshintrc 962006.2752421598 ns/iter 967117.6889818426 ns/iter 0.99
E2E_Evaluator_jsconfig 469466.29289541254 ns/iter 460237.9537157822 ns/iter 1.02
E2E_Evaluator_krakend 240081.58732346314 ns/iter 240305.5468695692 ns/iter 1.00
E2E_Evaluator_lazygit 171889.46057993083 ns/iter 174414.44866634134 ns/iter 0.99
E2E_Evaluator_lerna 148302.18170293374 ns/iter 146042.12089274914 ns/iter 1.02
E2E_Evaluator_nest_cli 227919.4762972566 ns/iter 226931.01426720576 ns/iter 1.00
E2E_Evaluator_omc 28736.221338739637 ns/iter 28933.363344581958 ns/iter 0.99
E2E_Evaluator_omnisharp 541952.5528771114 ns/iter 547526.8868954699 ns/iter 0.99
E2E_Evaluator_openapi 12913413.249999795 ns/iter 14675065.571428346 ns/iter 0.88
E2E_Evaluator_pre_commit_hooks 542416.9772191611 ns/iter 540869.9421296761 ns/iter 1.00
E2E_Evaluator_pulumi 824171.707346031 ns/iter 815206.803030307 ns/iter 1.01
E2E_Evaluator_semantic_release 136523.22914194796 ns/iter 137411.1140720906 ns/iter 0.99
E2E_Evaluator_stale 147234.062670314 ns/iter 144323.09071905722 ns/iter 1.02
E2E_Evaluator_stylecop 342161.2253999198 ns/iter 342548.72604066646 ns/iter 1.00
E2E_Evaluator_tmuxinator 125962.09654178556 ns/iter 125152.57308171412 ns/iter 1.01
E2E_Evaluator_ui5 662413.7128440436 ns/iter 643415.2965009278 ns/iter 1.03
E2E_Evaluator_ui5_manifest 3131155.099999784 ns/iter 3077547.461883404 ns/iter 1.02
E2E_Evaluator_unreal_engine_uproject 507477.11950147344 ns/iter 496481.1042415489 ns/iter 1.02
E2E_Evaluator_vercel 357062.9807594903 ns/iter 351639.4997481032 ns/iter 1.02
E2E_Evaluator_yamllint 13591.66889043785 ns/iter 13584.22027294013 ns/iter 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit deba89c into main Nov 11, 2025
13 checks passed
@jviotti jviotti deleted the suite-new branch November 11, 2025 12:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant