Skip to content

Upgrade JSON Schema Test Suite to cabbd65c08891f57aaa80c6fb804f6bb687edc52#541

Merged
jviotti merged 1 commit into
mainfrom
test-suite-upgrade-4
Oct 30, 2025
Merged

Upgrade JSON Schema Test Suite to cabbd65c08891f57aaa80c6fb804f6bb687edc52#541
jviotti merged 1 commit into
mainfrom
test-suite-upgrade-4

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented Oct 29, 2025

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

…7edc52`

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 2de2b62 Previous: a039780 Ratio
E2E_Compiler_adaptivecard 2913928970.000029 ns/iter 2573905985.9999995 ns/iter 1.13
E2E_Compiler_ansible_meta 68019434.99999651 ns/iter 54541149.230767764 ns/iter 1.25
E2E_Compiler_aws_cdk 1166322.943238671 ns/iter 1075676.2229101874 ns/iter 1.08
E2E_Compiler_babelrc 11629607.34426238 ns/iter 10269124.32352928 ns/iter 1.13
E2E_Compiler_clang_format 55648442.923073225 ns/iter 46116215.46666811 ns/iter 1.21
E2E_Compiler_cmake_presets 1648684219.0000174 ns/iter 1434381375.0000153 ns/iter 1.15
E2E_Compiler_code_climate 7962949.847058767 ns/iter 7115249.010101394 ns/iter 1.12
E2E_Compiler_cql2 245727133.999992 ns/iter 216937042.66666222 ns/iter 1.13
E2E_Compiler_cspell 243836664.6666547 ns/iter 212408447.00001085 ns/iter 1.15
E2E_Compiler_cypress 30032922.260869306 ns/iter 26511784.192306407 ns/iter 1.13
E2E_Compiler_deno 27439747.807691745 ns/iter 23607554.033333145 ns/iter 1.16
E2E_Compiler_dependabot 11713421.161290178 ns/iter 10015392.671428053 ns/iter 1.17
E2E_Compiler_draft_04 56705616.00000212 ns/iter 50987172.21428777 ns/iter 1.11
E2E_Compiler_fabric_mod 23498383.793104228 ns/iter 20621183.32352892 ns/iter 1.14
E2E_Compiler_geojson 61533722.08333489 ns/iter 49487578.21428476 ns/iter 1.24
E2E_Compiler_gitpod_configuration 24416824.896551874 ns/iter 21002188.45454506 ns/iter 1.16
E2E_Compiler_helm_chart_lock 4353481.155279392 ns/iter 3912585.202247203 ns/iter 1.11
E2E_Compiler_importmap 1587450.2511312645 ns/iter 1412160.8704454184 ns/iter 1.12
E2E_Compiler_jasmine 5358345.496124316 ns/iter 4874199.36805564 ns/iter 1.10
E2E_Compiler_jshintrc 16115369.418604437 ns/iter 13895027.639999852 ns/iter 1.16
E2E_Compiler_jsconfig 60589908.54545631 ns/iter 50293232.07142917 ns/iter 1.20
E2E_Compiler_krakend 783836778.0000226 ns/iter 655930932.9999791 ns/iter 1.19
E2E_Compiler_lazygit 110297710.33333683 ns/iter 97631459.42857169 ns/iter 1.13
E2E_Compiler_lerna 5918811.228813627 ns/iter 5333766.143939063 ns/iter 1.11
E2E_Compiler_nest_cli 35433298.7499987 ns/iter 30344687.565218464 ns/iter 1.17
E2E_Compiler_omc 2882632088.0000367 ns/iter 2490866127.9999933 ns/iter 1.16
E2E_Compiler_omnisharp 20012464.285714164 ns/iter 17332707.97500097 ns/iter 1.15
E2E_Compiler_openapi 1677905355.9999967 ns/iter 1460751555.9999912 ns/iter 1.15
E2E_Compiler_pre_commit_hooks 9173588.416666847 ns/iter 8113357.720930026 ns/iter 1.13
E2E_Compiler_pulumi 15130159.787234217 ns/iter 13451746.269231318 ns/iter 1.12
E2E_Compiler_semantic_release 4298838.048780648 ns/iter 3850101.1878450867 ns/iter 1.12
E2E_Compiler_stale 4326857.337499845 ns/iter 3928379.905027933 ns/iter 1.10
E2E_Compiler_stylecop 17272211.268292964 ns/iter 14777378.000000378 ns/iter 1.17
E2E_Compiler_tmuxinator 5827398.13333338 ns/iter 5322900.196969554 ns/iter 1.09
E2E_Compiler_ui5 367054371.49998945 ns/iter 306372027.9999984 ns/iter 1.20
E2E_Compiler_ui5_manifest 4636847665.000005 ns/iter 4039716074.000012 ns/iter 1.15
E2E_Compiler_unreal_engine_uproject 17251888.341463212 ns/iter 15045948.148936272 ns/iter 1.15
E2E_Compiler_vercel 57822535.272727944 ns/iter 49133497.42857268 ns/iter 1.18
E2E_Compiler_yamllint 7496853.9789474085 ns/iter 6500207.675926019 ns/iter 1.15
E2E_Evaluator_adaptivecard 53300.10367918174 ns/iter 47982.59569214025 ns/iter 1.11
E2E_Evaluator_ansible_meta 338333.2866541392 ns/iter 290573.5352523974 ns/iter 1.16
E2E_Evaluator_aws_cdk 68111.51727494142 ns/iter 57699.05747316251 ns/iter 1.18
E2E_Evaluator_babelrc 161598.00100426818 ns/iter 136771.6577864802 ns/iter 1.18
E2E_Evaluator_clang_format 135732.59647764743 ns/iter 130430.89014240788 ns/iter 1.04
E2E_Evaluator_cmake_presets 7692947.194444573 ns/iter 5092678.1417913325 ns/iter 1.51
E2E_Evaluator_code_climate 274118.8855232095 ns/iter 282043.42965929885 ns/iter 0.97
E2E_Evaluator_cql2 276124.8278016344 ns/iter 239572.42309008774 ns/iter 1.15
E2E_Evaluator_cspell 1023539.7643678187 ns/iter 885488.4483627267 ns/iter 1.16
E2E_Evaluator_cypress 231994.6343063342 ns/iter 215672.26301199614 ns/iter 1.08
E2E_Evaluator_deno 576135.7529643835 ns/iter 574613.2039636708 ns/iter 1.00
E2E_Evaluator_dependabot 562185.5638382476 ns/iter 535944.6219324948 ns/iter 1.05
E2E_Evaluator_draft_04 11656950.223880358 ns/iter 7968928.388235032 ns/iter 1.46
E2E_Evaluator_fabric_mod 1322964.4714549016 ns/iter 1263864.4593128744 ns/iter 1.05
E2E_Evaluator_geojson 29060858.038462814 ns/iter 21739263.843750577 ns/iter 1.34
E2E_Evaluator_gitpod_configuration 331393.19643716543 ns/iter 307585.6011433608 ns/iter 1.08
E2E_Evaluator_helm_chart_lock 464092.10301836237 ns/iter 465444.6183510718 ns/iter 1.00
E2E_Evaluator_importmap 76107.98876526025 ns/iter 57634.48682569969 ns/iter 1.32
E2E_Evaluator_jasmine 170477.21513173153 ns/iter 137191.91956735522 ns/iter 1.24
E2E_Evaluator_jshintrc 1311001.029906518 ns/iter 1260638.023423424 ns/iter 1.04
E2E_Evaluator_jsconfig 705248.5366336828 ns/iter 643431.2368663732 ns/iter 1.10
E2E_Evaluator_krakend 347939.8585365865 ns/iter 311398.54585929215 ns/iter 1.12
E2E_Evaluator_lazygit 218818.80234400765 ns/iter 181582.56846473433 ns/iter 1.21
E2E_Evaluator_lerna 195717.74593836474 ns/iter 189132.2110661353 ns/iter 1.03
E2E_Evaluator_nest_cli 259336.50910471843 ns/iter 242240.8143939266 ns/iter 1.07
E2E_Evaluator_omc 29595.45163753591 ns/iter 27870.287456865066 ns/iter 1.06
E2E_Evaluator_omnisharp 727449.2513089047 ns/iter 625760.4165915512 ns/iter 1.16
E2E_Evaluator_openapi 23233013.92857096 ns/iter 17776364.71052652 ns/iter 1.31
E2E_Evaluator_pre_commit_hooks 620499.2406562585 ns/iter 588068.0557940217 ns/iter 1.06
E2E_Evaluator_pulumi 858609.7554744156 ns/iter 870009.2218044862 ns/iter 0.99
E2E_Evaluator_semantic_release 142695.23801548296 ns/iter 124066.76446355869 ns/iter 1.15
E2E_Evaluator_stale 170834.03320681982 ns/iter 152001.61120996132 ns/iter 1.12
E2E_Evaluator_stylecop 521046.30280648137 ns/iter 476503.8842975307 ns/iter 1.09
E2E_Evaluator_tmuxinator 137300.4631599769 ns/iter 120708.4041842524 ns/iter 1.14
E2E_Evaluator_ui5 793727.7326839863 ns/iter 686759.014705859 ns/iter 1.16
E2E_Evaluator_ui5_manifest 4989505.29357786 ns/iter 4359390.012499986 ns/iter 1.14
E2E_Evaluator_unreal_engine_uproject 679918.2735294069 ns/iter 618950.6424134733 ns/iter 1.10
E2E_Evaluator_vercel 396042.4425580117 ns/iter 392361.8037120411 ns/iter 1.01
E2E_Evaluator_yamllint 16631.965795613873 ns/iter 13365.070760542943 ns/iter 1.24
Micro_Draft4_Meta_1_No_Callback 280.76177400181393 ns/iter 270.9947075999547 ns/iter 1.04
Micro_Draft4_Required_Properties 704.5607869892933 ns/iter 630.4315593880746 ns/iter 1.12
Micro_Draft4_Many_Optional_Properties_Minimal_Match 32.82114678043098 ns/iter 34.815051699762265 ns/iter 0.94
Micro_Draft4_Few_Optional_Properties_Minimal_Match 14.63823116900008 ns/iter 12.131486119995916 ns/iter 1.21
Micro_Draft4_Items_Schema 631.0522965262641 ns/iter 567.118020057932 ns/iter 1.11
Micro_Draft4_Nested_Object 6.659208497236443 ns/iter 4.610193646386635 ns/iter 1.44
Micro_Draft4_Properties_Triad_Optional 906.5745141254142 ns/iter 908.1021855001854 ns/iter 1.00
Micro_Draft4_Properties_Triad_Closed 700.3345806953328 ns/iter 724.1131855297016 ns/iter 0.97
Micro_Draft4_Properties_Triad_Required 912.801925923034 ns/iter 894.8988187393642 ns/iter 1.02
Micro_Draft4_Properties_Closed 86.30835599122092 ns/iter 80.36423001444913 ns/iter 1.07
Micro_Draft4_Non_Recursive_Ref 33.612485747235574 ns/iter 22.25758506489283 ns/iter 1.51
Micro_Draft4_Pattern_Properties_True 241.9313962460992 ns/iter 192.90145809614498 ns/iter 1.25
Micro_Draft4_Ref_To_Single_Property 14.632630571075806 ns/iter 11.876669594652022 ns/iter 1.23
Micro_Draft4_Additional_Properties_Type 62.671424246408705 ns/iter 39.56419558448796 ns/iter 1.58
Micro_Draft4_Nested_Oneof 86.56772933448579 ns/iter 72.60881146437572 ns/iter 1.19
Micro_Draft4_Short_Enum 17.445190277349845 ns/iter 16.23221794176979 ns/iter 1.07
Micro_Draft4_Long_Enum 21.49294316838087 ns/iter 16.81651847471081 ns/iter 1.28
Micro_Draft4_Long_Enum_Short_Strings 17.46151150381768 ns/iter 16.21485122393271 ns/iter 1.08
Micro_Draft4_Type_Object 11.833466319039328 ns/iter 8.416704286583325 ns/iter 1.41
Micro_Draft4_Ref_Single_100 16490890.714286316 ns/iter 15815718.727273004 ns/iter 1.04
Micro_Draft4_Ref_Many_Nested 12773320811.999952 ns/iter 10456232220.999994 ns/iter 1.22
Micro_Draft6_Property_Names 147.18073219396106 ns/iter 142.99374190556793 ns/iter 1.03
Micro_Draft7_If_Then_Else 42.09576028542606 ns/iter 36.20703645641297 ns/iter 1.16
Micro_2019_09_Unevaluated_Properties 53.89468506086361 ns/iter 46.76809395849117 ns/iter 1.15
Micro_2020_12_Dynamic_Ref 528.5151990375932 ns/iter 537.0902871417326 ns/iter 0.98
Micro_2020_12_Dynamic_Ref_Single 11.821021487122648 ns/iter 8.389163162422951 ns/iter 1.41

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 2de2b62 Previous: a039780 Ratio
E2E_Compiler_adaptivecard 2514484541.999991 ns/iter 3103147124.999964 ns/iter 0.81
E2E_Compiler_ansible_meta 59431223.45454619 ns/iter 70810439.77777629 ns/iter 0.84
E2E_Compiler_aws_cdk 1134117.9420506242 ns/iter 1286861.1387755997 ns/iter 0.88
E2E_Compiler_babelrc 10358070.777778309 ns/iter 13686262.25490186 ns/iter 0.76
E2E_Compiler_clang_format 44239986.937498085 ns/iter 59397545.90000348 ns/iter 0.74
E2E_Compiler_cmake_presets 1559379083.000067 ns/iter 1766919583.0000036 ns/iter 0.88
E2E_Compiler_code_climate 8554012.784091212 ns/iter 8249279.22077937 ns/iter 1.04
E2E_Compiler_cql2 178421958.24999863 ns/iter 213500645.99999997 ns/iter 0.84
E2E_Compiler_cspell 232881805.33332554 ns/iter 218385027.6666514 ns/iter 1.07
E2E_Compiler_cypress 34567412.50000164 ns/iter 33024536.2173944 ns/iter 1.05
E2E_Compiler_deno 28026682.29166727 ns/iter 26456350.296299476 ns/iter 1.06
E2E_Compiler_dependabot 11804986.11111106 ns/iter 9830836.191781601 ns/iter 1.20
E2E_Compiler_draft_04 61661855.76923383 ns/iter 52910392.85714305 ns/iter 1.17
E2E_Compiler_fabric_mod 22611468.424239926 ns/iter 19352369.194444284 ns/iter 1.17
E2E_Compiler_geojson 61943930.5833301 ns/iter 64403569.416668914 ns/iter 0.96
E2E_Compiler_gitpod_configuration 26109541.645162668 ns/iter 19892345.214287844 ns/iter 1.31
E2E_Compiler_helm_chart_lock 4195371.509676842 ns/iter 3363344.211111199 ns/iter 1.25
E2E_Compiler_importmap 1312396.3717693472 ns/iter 1647013.6285045738 ns/iter 0.80
E2E_Compiler_jasmine 5553952.162963301 ns/iter 6606507.791209149 ns/iter 0.84
E2E_Compiler_jshintrc 17406702.534884084 ns/iter 20060715.457144137 ns/iter 0.87
E2E_Compiler_jsconfig 70864800.00000392 ns/iter 83724805.55556194 ns/iter 0.85
E2E_Compiler_krakend 950575292.0000532 ns/iter 967687583.0000427 ns/iter 0.98
E2E_Compiler_lazygit 122688758.39999965 ns/iter 144853499.99999925 ns/iter 0.85
E2E_Compiler_lerna 6330732.142857312 ns/iter 6153990.025641412 ns/iter 1.03
E2E_Compiler_nest_cli 28233363.320000533 ns/iter 35810752.210522875 ns/iter 0.79
E2E_Compiler_omc 2722900959.0000715 ns/iter 2860466624.999958 ns/iter 0.95
E2E_Compiler_omnisharp 22446962.029411733 ns/iter 17396780.225001864 ns/iter 1.29
E2E_Compiler_openapi 1825307124.9999948 ns/iter 1411346457.9999118 ns/iter 1.29
E2E_Compiler_pre_commit_hooks 10343496.12000066 ns/iter 8876221.385542039 ns/iter 1.17
E2E_Compiler_pulumi 18554638.297872618 ns/iter 13410031.43396255 ns/iter 1.38
E2E_Compiler_semantic_release 5562125.379629767 ns/iter 4036820.8804351203 ns/iter 1.38
E2E_Compiler_stale 6935308.080808755 ns/iter 4552064.22929915 ns/iter 1.52
E2E_Compiler_stylecop 25212290.375002056 ns/iter 16450648.133331925 ns/iter 1.53
E2E_Compiler_tmuxinator 8706920.34313789 ns/iter 5403593.421052439 ns/iter 1.61
E2E_Compiler_ui5 550930624.9999782 ns/iter 1190263957.9999459 ns/iter 0.46
E2E_Compiler_ui5_manifest 6069612540.9999695 ns/iter 7171439458.000009 ns/iter 0.85
E2E_Compiler_unreal_engine_uproject 24094828.857142504 ns/iter 21975689.941177066 ns/iter 1.10
E2E_Compiler_vercel 76917729.19999948 ns/iter 82682026.45454246 ns/iter 0.93
E2E_Compiler_yamllint 8551830.500000402 ns/iter 10300736.559139706 ns/iter 0.83
E2E_Evaluator_adaptivecard 61677.29827533286 ns/iter 46515.86227842644 ns/iter 1.33
E2E_Evaluator_ansible_meta 311954.94393381337 ns/iter 209150.28584096377 ns/iter 1.49
E2E_Evaluator_aws_cdk 62071.45067982874 ns/iter 42833.66587296819 ns/iter 1.45
E2E_Evaluator_babelrc 139201.18992605645 ns/iter 105770.37234043019 ns/iter 1.32
E2E_Evaluator_clang_format 121942.15814586834 ns/iter 102601.53934248442 ns/iter 1.19
E2E_Evaluator_cmake_presets 4254046.474358848 ns/iter 4756902.068376617 ns/iter 0.89
E2E_Evaluator_code_climate 225121.39721061147 ns/iter 242470.9277978433 ns/iter 0.93
E2E_Evaluator_cql2 238859.76868883718 ns/iter 222173.10048025273 ns/iter 1.08
E2E_Evaluator_cspell 855499.5990396771 ns/iter 678345.9866518254 ns/iter 1.26
E2E_Evaluator_cypress 201071.6149952547 ns/iter 158610.18690783955 ns/iter 1.27
E2E_Evaluator_deno 537969.9850857572 ns/iter 386582.9067388538 ns/iter 1.39
E2E_Evaluator_dependabot 473111.05877924705 ns/iter 353818.84949117375 ns/iter 1.34
E2E_Evaluator_draft_04 8269734.374999871 ns/iter 6158414.880341934 ns/iter 1.34
E2E_Evaluator_fabric_mod 2157984.5938373585 ns/iter 1476558.8187918393 ns/iter 1.46
E2E_Evaluator_geojson 17703011.02941202 ns/iter 18618065.489797153 ns/iter 0.95
E2E_Evaluator_gitpod_configuration 273781.4777310919 ns/iter 341464.27562147257 ns/iter 0.80
E2E_Evaluator_helm_chart_lock 404292.0523160907 ns/iter 610522.1921005772 ns/iter 0.66
E2E_Evaluator_importmap 55318.25503858849 ns/iter 74346.18882252919 ns/iter 0.74
E2E_Evaluator_jasmine 125617.83854166034 ns/iter 157046.81454993627 ns/iter 0.80
E2E_Evaluator_jshintrc 1412195.9133449253 ns/iter 1539887.4183125221 ns/iter 0.92
E2E_Evaluator_jsconfig 711874.0546392351 ns/iter 881379.6303418772 ns/iter 0.81
E2E_Evaluator_krakend 303937.67248145933 ns/iter 294095.5613874996 ns/iter 1.03
E2E_Evaluator_lazygit 214362.03063382287 ns/iter 204043.7703074296 ns/iter 1.05
E2E_Evaluator_lerna 171817.20592681933 ns/iter 183972.27123771692 ns/iter 0.93
E2E_Evaluator_nest_cli 190252.09052295817 ns/iter 225532.7203189676 ns/iter 0.84
E2E_Evaluator_omc 19613.52722340972 ns/iter 20352.429953782605 ns/iter 0.96
E2E_Evaluator_omnisharp 448517.09427831526 ns/iter 595169.7784931831 ns/iter 0.75
E2E_Evaluator_openapi 10753699.730158255 ns/iter 15021381.6600035 ns/iter 0.72
E2E_Evaluator_pre_commit_hooks 402077.84637026046 ns/iter 419043.7668012176 ns/iter 0.96
E2E_Evaluator_pulumi 634939.1534391308 ns/iter 585230.2009456664 ns/iter 1.08
E2E_Evaluator_semantic_release 122953.33070035755 ns/iter 95434.91655971715 ns/iter 1.29
E2E_Evaluator_stale 141144.35754077704 ns/iter 109635.00105407112 ns/iter 1.29
E2E_Evaluator_stylecop 404419.9591968913 ns/iter 313187.9770992223 ns/iter 1.29
E2E_Evaluator_tmuxinator 96865.85322785388 ns/iter 84274.4048711617 ns/iter 1.15
E2E_Evaluator_ui5 667381.736448567 ns/iter 583514.3919034852 ns/iter 1.14
E2E_Evaluator_ui5_manifest 3648406.9085710347 ns/iter 3780657.9178075762 ns/iter 0.97
E2E_Evaluator_unreal_engine_uproject 503017.12500004214 ns/iter 610351.2433758029 ns/iter 0.82
E2E_Evaluator_vercel 265188.52162945195 ns/iter 361125.1653439437 ns/iter 0.73
E2E_Evaluator_yamllint 12172.725250993952 ns/iter 16094.664072657812 ns/iter 0.76
Micro_Draft4_Meta_1_No_Callback 200.6737329866264 ns/iter 244.25471906702765 ns/iter 0.82
Micro_Draft4_Required_Properties 493.289249806165 ns/iter 532.170678084392 ns/iter 0.93
Micro_Draft4_Many_Optional_Properties_Minimal_Match 29.068784264670064 ns/iter 26.283736395316087 ns/iter 1.11
Micro_Draft4_Few_Optional_Properties_Minimal_Match 8.703547317046617 ns/iter 8.799964498613887 ns/iter 0.99
Micro_Draft4_Items_Schema 511.0420534634296 ns/iter 567.8718750000371 ns/iter 0.90
Micro_Draft4_Nested_Object 3.044012260750287 ns/iter 3.4263199021951034 ns/iter 0.89
Micro_Draft4_Properties_Triad_Optional 819.0373207464932 ns/iter 809.6365318306881 ns/iter 1.01
Micro_Draft4_Properties_Triad_Closed 672.8526143722461 ns/iter 570.345311991733 ns/iter 1.18
Micro_Draft4_Properties_Triad_Required 758.259169295007 ns/iter 872.3279470373808 ns/iter 0.87
Micro_Draft4_Properties_Closed 54.70222767937336 ns/iter 52.35839404049589 ns/iter 1.04
Micro_Draft4_Non_Recursive_Ref 20.750124182899867 ns/iter 18.57899033611267 ns/iter 1.12
Micro_Draft4_Pattern_Properties_True 205.18268145249664 ns/iter 168.81654097144272 ns/iter 1.22
Micro_Draft4_Ref_To_Single_Property 8.042598164195061 ns/iter 7.378496529717742 ns/iter 1.09
Micro_Draft4_Additional_Properties_Type 35.553551002817265 ns/iter 36.678055518235 ns/iter 0.97
Micro_Draft4_Nested_Oneof 54.6557323515101 ns/iter 54.3980958264985 ns/iter 1.00
Micro_Draft4_Short_Enum 8.931518667970167 ns/iter 9.334069972421654 ns/iter 0.96
Micro_Draft4_Long_Enum 22.773483371249178 ns/iter 23.61213089813281 ns/iter 0.96
Micro_Draft4_Long_Enum_Short_Strings 10.177275111512524 ns/iter 11.709768449242034 ns/iter 0.87
Micro_Draft4_Type_Object 5.402098887939346 ns/iter 5.988029605654244 ns/iter 0.90
Micro_Draft4_Ref_Single_100 15868319.113637466 ns/iter 25192927.062505532 ns/iter 0.63
Micro_Draft4_Ref_Many_Nested 8984002042.000042 ns/iter 11347087915.999964 ns/iter 0.79
Micro_Draft6_Property_Names 102.08711354905532 ns/iter 102.85294096455978 ns/iter 0.99
Micro_Draft7_If_Then_Else 28.31347106268138 ns/iter 28.871163965996775 ns/iter 0.98
Micro_2019_09_Unevaluated_Properties 36.375183078582964 ns/iter 36.7117244131326 ns/iter 0.99
Micro_2020_12_Dynamic_Ref 421.251994182143 ns/iter 418.84656447660154 ns/iter 1.01
Micro_2020_12_Dynamic_Ref_Single 5.415928890961463 ns/iter 6.405646125531506 ns/iter 0.85

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 2de2b62 Previous: a039780 Ratio
Micro_2020_12_Dynamic_Ref 627.6185216454949 ns/iter 621.0638271470357 ns/iter 1.01
Micro_2020_12_Dynamic_Ref_Single 10.666426507129321 ns/iter 10.765587880636607 ns/iter 0.99
Micro_2019_09_Unevaluated_Properties 54.03902664230936 ns/iter 54.023442242698344 ns/iter 1.00
Micro_Draft7_If_Then_Else 46.16235309697917 ns/iter 45.390708030806195 ns/iter 1.02
Micro_Draft6_Property_Names 159.20390655713413 ns/iter 158.83354788403722 ns/iter 1.00
Micro_Draft4_Meta_1_No_Callback 260.0657344115311 ns/iter 247.4698890159503 ns/iter 1.05
Micro_Draft4_Required_Properties 551.9271031725676 ns/iter 551.4131704547065 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 30.94232774795858 ns/iter 31.203842415655394 ns/iter 0.99
Micro_Draft4_Few_Optional_Properties_Minimal_Match 12.939388674493367 ns/iter 12.930360572476818 ns/iter 1.00
Micro_Draft4_Items_Schema 513.4855042855298 ns/iter 504.1844290000199 ns/iter 1.02
Micro_Draft4_Nested_Object 6.013478361069152 ns/iter 5.994894979589838 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 1023.011060390479 ns/iter 1026.0482748884524 ns/iter 1.00
Micro_Draft4_Properties_Triad_Closed 813.6956282512946 ns/iter 815.468466650238 ns/iter 1.00
Micro_Draft4_Properties_Triad_Required 1033.1674705746957 ns/iter 1052.7749375228157 ns/iter 0.98
Micro_Draft4_Properties_Closed 76.07841359591683 ns/iter 76.04272416017322 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 13.475463291520589 ns/iter 13.46482452763411 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 243.83343415972308 ns/iter 244.00816799710725 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 12.98228910419195 ns/iter 12.937113981883762 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 16.292892239956114 ns/iter 16.300240737973272 ns/iter 1.00
Micro_Draft4_Nested_Oneof 114.09775966089046 ns/iter 114.0887592142636 ns/iter 1.00
Micro_Draft4_Short_Enum 18.732045100546095 ns/iter 18.87211624267196 ns/iter 0.99
Micro_Draft4_Long_Enum 22.079118035398345 ns/iter 22.10047012254739 ns/iter 1.00
Micro_Draft4_Long_Enum_Short_Strings 18.735698814511853 ns/iter 18.71970343897667 ns/iter 1.00
Micro_Draft4_Type_Object 10.687104971868918 ns/iter 10.68024943270718 ns/iter 1.00
Micro_Draft4_Ref_Single_100 17463760.39999973 ns/iter 17442708.849998213 ns/iter 1.00
Micro_Draft4_Ref_Many_Nested 12762831883.000217 ns/iter 11894591550.000086 ns/iter 1.07
E2E_Compiler_adaptivecard 3040994674.9998655 ns/iter 2979803417.999847 ns/iter 1.02
E2E_Compiler_ansible_meta 70184272.9999953 ns/iter 68423275.39998223 ns/iter 1.03
E2E_Compiler_aws_cdk 1314634.5332102922 ns/iter 1282682.553072993 ns/iter 1.02
E2E_Compiler_babelrc 12651114.872729026 ns/iter 12488152.000003083 ns/iter 1.01
E2E_Compiler_clang_format 58063628.66665419 ns/iter 56571186.83332858 ns/iter 1.03
E2E_Compiler_cmake_presets 1761145256.9999528 ns/iter 1738273805.0000625 ns/iter 1.01
E2E_Compiler_code_climate 8819591.645570781 ns/iter 8684088.987654742 ns/iter 1.02
E2E_Compiler_cql2 270389835.6666438 ns/iter 260783706.33331358 ns/iter 1.04
E2E_Compiler_cspell 260338021.66671193 ns/iter 257553852.99999034 ns/iter 1.01
E2E_Compiler_cypress 31934436.363640502 ns/iter 31819155.863641676 ns/iter 1.00
E2E_Compiler_deno 28844265.62499698 ns/iter 29006708.916663606 ns/iter 0.99
E2E_Compiler_dependabot 12311597.298245639 ns/iter 12336588.321427858 ns/iter 1.00
E2E_Compiler_draft_04 61063980.66666922 ns/iter 61207179.90909891 ns/iter 1.00
E2E_Compiler_fabric_mod 24893396.32142316 ns/iter 24849149.10715068 ns/iter 1.00
E2E_Compiler_geojson 62836394.90908916 ns/iter 63013086.90909867 ns/iter 1.00
E2E_Compiler_gitpod_configuration 25853368.000003617 ns/iter 25810386.629624795 ns/iter 1.00
E2E_Compiler_helm_chart_lock 4759636.734693881 ns/iter 4725102.7702695625 ns/iter 1.01
E2E_Compiler_importmap 1706973.7677262258 ns/iter 1699074.2560975798 ns/iter 1.00
E2E_Compiler_jasmine 5878068.403362015 ns/iter 5850486.958333553 ns/iter 1.00
E2E_Compiler_jshintrc 17115567.707317427 ns/iter 17069518.024388853 ns/iter 1.00
E2E_Compiler_jsconfig 62442917.181814745 ns/iter 63419036.63635342 ns/iter 0.98
E2E_Compiler_krakend 805403505.9999478 ns/iter 807673488.9998534 ns/iter 1.00
E2E_Compiler_lazygit 120589365.00000073 ns/iter 122624604.99997966 ns/iter 0.98
E2E_Compiler_lerna 6542248.448599863 ns/iter 6531485.775701534 ns/iter 1.00
E2E_Compiler_nest_cli 37032104.315788895 ns/iter 37161043.105267085 ns/iter 1.00
E2E_Compiler_omc 3321407012.999998 ns/iter 3371226228.0000687 ns/iter 0.99
E2E_Compiler_omnisharp 21202725.18181716 ns/iter 21046710.151515733 ns/iter 1.01
E2E_Compiler_openapi 1738516898.999933 ns/iter 1769908403.0000448 ns/iter 0.98
E2E_Compiler_pre_commit_hooks 9980560.300001733 ns/iter 9940740.042252336 ns/iter 1.00
E2E_Compiler_pulumi 16439039.651162982 ns/iter 16507381.046510492 ns/iter 1.00
E2E_Compiler_semantic_release 4801849.446666893 ns/iter 4638428.437085276 ns/iter 1.04
E2E_Compiler_stale 4703050.8263882585 ns/iter 4728610.601351168 ns/iter 0.99
E2E_Compiler_stylecop 17920068.794870906 ns/iter 18166368.051284876 ns/iter 0.99
E2E_Compiler_tmuxinator 6380917.245455334 ns/iter 6392508.871559009 ns/iter 1.00
E2E_Compiler_ui5 370965647.5000429 ns/iter 372553507.00002056 ns/iter 1.00
E2E_Compiler_ui5_manifest 4828447226.9999695 ns/iter 4879860809.0000925 ns/iter 0.99
E2E_Compiler_unreal_engine_uproject 18473102.31579214 ns/iter 18436426.973685708 ns/iter 1.00
E2E_Compiler_vercel 60025491.66667374 ns/iter 61358768.00001163 ns/iter 0.98
E2E_Compiler_yamllint 8141651.406977279 ns/iter 8038405.0919532785 ns/iter 1.01
E2E_Evaluator_adaptivecard 56353.45545907635 ns/iter 56783.276173719154 ns/iter 0.99
E2E_Evaluator_ansible_meta 316849.0332573667 ns/iter 317434.8019801835 ns/iter 1.00
E2E_Evaluator_aws_cdk 58470.09655854611 ns/iter 56556.68533332996 ns/iter 1.03
E2E_Evaluator_babelrc 141231.8128571463 ns/iter 143312.53173312015 ns/iter 0.99
E2E_Evaluator_clang_format 104083.37486924324 ns/iter 103028.19696972061 ns/iter 1.01
E2E_Evaluator_cmake_presets 5226373.2892554775 ns/iter 5805097.26984156 ns/iter 0.90
E2E_Evaluator_code_climate 224736.40347494493 ns/iter 225492.49680514404 ns/iter 1.00
E2E_Evaluator_cql2 288236.1417972427 ns/iter 282220.8285023856 ns/iter 1.02
E2E_Evaluator_cspell 1048234.6641789372 ns/iter 1040068.6927709328 ns/iter 1.01
E2E_Evaluator_cypress 171236.94429449257 ns/iter 169880.34820776814 ns/iter 1.01
E2E_Evaluator_deno 561940.1244914754 ns/iter 563554.8707594188 ns/iter 1.00
E2E_Evaluator_dependabot 494656.0162601338 ns/iter 473215.7319035016 ns/iter 1.05
E2E_Evaluator_draft_04 8464062.32467534 ns/iter 9441860.6527774 ns/iter 0.90
E2E_Evaluator_fabric_mod 1395372.4234592947 ns/iter 1388426.2936504197 ns/iter 1.01
E2E_Evaluator_geojson 21124048.303032726 ns/iter 21149493.545456633 ns/iter 1.00
E2E_Evaluator_gitpod_configuration 294282.41108356055 ns/iter 291132.8098006254 ns/iter 1.01
E2E_Evaluator_helm_chart_lock 360973.913223194 ns/iter 354738.68981253623 ns/iter 1.02
E2E_Evaluator_importmap 61775.74185903878 ns/iter 58519.54376101524 ns/iter 1.06
E2E_Evaluator_jasmine 140443.69070512848 ns/iter 140110.23079990022 ns/iter 1.00
E2E_Evaluator_jshintrc 956142.796703254 ns/iter 968237.6284155009 ns/iter 0.99
E2E_Evaluator_jsconfig 709874.7789784457 ns/iter 694815.4355949436 ns/iter 1.02
E2E_Evaluator_krakend 333616.60264272307 ns/iter 331172.74372100015 ns/iter 1.01
E2E_Evaluator_lazygit 191176.71444049306 ns/iter 190478.62786930654 ns/iter 1.00
E2E_Evaluator_lerna 147546.60397075184 ns/iter 146680.45948220123 ns/iter 1.01
E2E_Evaluator_nest_cli 227521.85931439453 ns/iter 226400.96511629736 ns/iter 1.00
E2E_Evaluator_omc 28784.166638983093 ns/iter 28691.077859703575 ns/iter 1.00
E2E_Evaluator_omnisharp 540501.0824262257 ns/iter 551393.1828210658 ns/iter 0.98
E2E_Evaluator_openapi 17542788.270272493 ns/iter 18638291.86841988 ns/iter 0.94
E2E_Evaluator_pre_commit_hooks 521686.7239583272 ns/iter 519099.7559523342 ns/iter 1.00
E2E_Evaluator_pulumi 811032.6205306805 ns/iter 809033.4876326321 ns/iter 1.00
E2E_Evaluator_semantic_release 135665.13678975677 ns/iter 137359.50047285724 ns/iter 0.99
E2E_Evaluator_stale 144375.84200705483 ns/iter 143611.7084524041 ns/iter 1.01
E2E_Evaluator_stylecop 512411.29053548217 ns/iter 502689.11947857455 ns/iter 1.02
E2E_Evaluator_tmuxinator 125962.08197903857 ns/iter 124869.52624090142 ns/iter 1.01
E2E_Evaluator_ui5 761940.617391217 ns/iter 751609.6606190449 ns/iter 1.01
E2E_Evaluator_ui5_manifest 5093092.98473204 ns/iter 5154384.093022895 ns/iter 0.99
E2E_Evaluator_unreal_engine_uproject 697933.0862403571 ns/iter 687995.4576771349 ns/iter 1.01
E2E_Evaluator_vercel 341957.38356167276 ns/iter 340500.6595331155 ns/iter 1.00
E2E_Evaluator_yamllint 13679.552035760318 ns/iter 13551.982197906089 ns/iter 1.01

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit be74b45 into main Oct 30, 2025
13 checks passed
@jviotti jviotti deleted the test-suite-upgrade-4 branch October 30, 2025 00:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant