Skip to content

Support 2019-09 format assertion behind a compiler tweak#837

Merged
jviotti merged 2 commits into
mainfrom
2019-09-formats
May 29, 2026
Merged

Support 2019-09 format assertion behind a compiler tweak#837
jviotti merged 2 commits into
mainfrom
2019-09-formats

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented May 29, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 3 files

Tip: cubic can generate docs of your entire codebase and keep them up to date. Try it here.

Re-trigger cubic

Comment thread src/compiler/default_compiler_draft3.h
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 29, 2026

🤖 Augment PR Summary

Summary: This PR enables JSON Schema draft 2019-09 format to be treated as an assertion when Tweaks::format_assertion is enabled, instead of rejecting the tweak for that dialect.

Changes:

  • Extends compiler_draft3_validation_format to compile format into AssertionStringType for draft 2019-09 when the tweak is active (mapping the standard 2019-09 formats to ValueStringType).
  • In exhaustive mode, additionally emits the usual format annotation (guarded to string instances) when the assertion path is used.
  • Keeps throwing a compiler error for format_assertion under the 2020-12 format-annotation vocabulary (still unsupported here).
  • Replaces the prior “tweak not supported” evaluator tests for 2019-09 with comprehensive success/failure coverage across supported formats, modes, and instance types.
  • Updates the JSON Schema Official Test Suite registration to run the draft 2019-09 optional format suite with .format_assertion = true enabled.

Technical Notes: The new assertion compilation uses the existing AssertionStringType evaluator behavior (no-op for non-strings) and retains annotation emission in exhaustive mode for recognized formats.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 6937b52 Previous: a774160 Ratio
Schema_Iterator_ISO_Language 3010837.8008474004 ns/iter 3010303.559322137 ns/iter 1.00
Schema_Tracker_ISO_Language 4799881.349315113 ns/iter 4725796.417808583 ns/iter 1.02
Schema_Tracker_ISO_Language_To_JSON 20466830.647064053 ns/iter 20574299.970589623 ns/iter 0.99
Schema_Frame_WoT_References 5269680.458647934 ns/iter 5210206.902984791 ns/iter 1.01
Schema_Frame_OMC_References 21398788.363636743 ns/iter 21473855.8484848 ns/iter 1.00
Schema_Frame_OMC_Locations 19667166.69444521 ns/iter 19785491.085713148 ns/iter 0.99
Schema_Frame_ISO_Language_Locations 100088551.66665854 ns/iter 104254360.66666786 ns/iter 0.96
Schema_Frame_KrakenD_References 38969125.83333132 ns/iter 45019817.83333678 ns/iter 0.87
Schema_Frame_KrakenD_Reachable 547336492.0001131 ns/iter 649687868.0000008 ns/iter 0.84
Schema_Frame_ISO_Language_Locations_To_JSON 117039254.66667897 ns/iter 124117145.83333832 ns/iter 0.94
Schema_Frame_Many_Resources_References 365199648.4999245 ns/iter 391569329.00004905 ns/iter 0.93
Schema_Bundle_Meta_2020_12 1741731.460205826 ns/iter 1735446.9506166044 ns/iter 1.00
Schema_Format_ISO_Language_To_JSON 105691212.14293124 ns/iter 119476916.33332624 ns/iter 0.88
E2E_Compiler_adaptivecard 62246272.63635408 ns/iter 69685672.49999751 ns/iter 0.89
E2E_Compiler_ansible_meta 29619230.79166695 ns/iter 29900317.60869581 ns/iter 0.99
E2E_Compiler_aws_cdk 390052.36505290243 ns/iter 390698.1831378919 ns/iter 1.00
E2E_Compiler_babelrc 2645839.120754626 ns/iter 2639457.267924575 ns/iter 1.00
E2E_Compiler_clang_format 18787651.83783872 ns/iter 18767428.459458075 ns/iter 1.00
E2E_Compiler_cmake_presets 26234063.888885565 ns/iter 26866205.07692029 ns/iter 0.98
E2E_Compiler_code_climate 2657997.8441065294 ns/iter 2659911.9543725154 ns/iter 1.00
E2E_Compiler_cql2 13073654.444442414 ns/iter 13239814.943397436 ns/iter 0.99
E2E_Compiler_cspell 23547116.65516961 ns/iter 23589664.310344264 ns/iter 1.00
E2E_Compiler_cypress 4051854.1734097768 ns/iter 4103358.511764889 ns/iter 0.99
E2E_Compiler_deno 8040589.091954633 ns/iter 7967079.295454482 ns/iter 1.01
E2E_Compiler_dependabot 4012304.8160913982 ns/iter 3998994.7701154305 ns/iter 1.00
E2E_Compiler_draft_04 2778265.7857137057 ns/iter 2773074.912698442 ns/iter 1.00
E2E_Compiler_fabric_mod 4888732.74125867 ns/iter 4882688.590277616 ns/iter 1.00
E2E_Compiler_geojson 22526332.354837287 ns/iter 22675634.32257791 ns/iter 0.99
E2E_Compiler_gitpod_configuration 5059259.74637622 ns/iter 5057804.258992272 ns/iter 1.00
E2E_Compiler_helm_chart_lock 735475.0513090068 ns/iter 729374.5541666396 ns/iter 1.01
E2E_Compiler_importmap 295625.1285412408 ns/iter 293753.0774382335 ns/iter 1.01
E2E_Compiler_jasmine 1405462.26209663 ns/iter 1407438.7815630168 ns/iter 1.00
E2E_Compiler_jshintrc 4505036.483870725 ns/iter 4490957.551281437 ns/iter 1.00
E2E_Compiler_jsconfig 22232187.781249024 ns/iter 23086518.000002712 ns/iter 0.96
E2E_Compiler_krakend 141415973.9999832 ns/iter 159649132.2500242 ns/iter 0.89
E2E_Compiler_lazygit 33843631.23808769 ns/iter 33973659.42856552 ns/iter 1.00
E2E_Compiler_lerna 1651906.8231130678 ns/iter 1662136.542654049 ns/iter 0.99
E2E_Compiler_nest_cli 7627134.793477561 ns/iter 7667436.208791244 ns/iter 0.99
E2E_Compiler_omc 158157117.7500223 ns/iter 175091913.50001174 ns/iter 0.90
E2E_Compiler_omnisharp 6904240.539216409 ns/iter 6922532.960396722 ns/iter 1.00
E2E_Compiler_openapi 25902271.296302017 ns/iter 25821130.814813808 ns/iter 1.00
E2E_Compiler_pre_commit_hooks 5413219.376922686 ns/iter 5413919.46153978 ns/iter 1.00
E2E_Compiler_pulumi 4132705.3529411224 ns/iter 4125516.494047772 ns/iter 1.00
E2E_Compiler_semantic_release 1613949.790322286 ns/iter 1611340.0435784536 ns/iter 1.00
E2E_Compiler_stale 1613790.4013758798 ns/iter 1602591.977064511 ns/iter 1.01
E2E_Compiler_stylecop 6388007.1999991825 ns/iter 6238800.901785778 ns/iter 1.02
E2E_Compiler_tmuxinator 1992270.6761360846 ns/iter 1999648.548571713 ns/iter 1.00
E2E_Compiler_ui5 47364294.06666502 ns/iter 48189913.20000047 ns/iter 0.98
E2E_Compiler_ui5_manifest 309780409.5000356 ns/iter 337543751.9999878 ns/iter 0.92
E2E_Compiler_unreal_engine_uproject 4710690.635134425 ns/iter 4853867.398648273 ns/iter 0.97
E2E_Compiler_users_array 813091.4867051931 ns/iter 821940.0223265358 ns/iter 0.99
E2E_Compiler_vercel 12643500.999998156 ns/iter 12780948.072726129 ns/iter 0.99
E2E_Compiler_yamllint 355939.9629064897 ns/iter 360652.1615542086 ns/iter 0.99
E2E_Evaluator_adaptivecard 24676.72946687514 ns/iter 26353.32138205428 ns/iter 0.94
E2E_Evaluator_ansible_meta 240759.04286197986 ns/iter 244168.21906405015 ns/iter 0.99
E2E_Evaluator_aws_cdk 51024.43236859154 ns/iter 50795.73127531103 ns/iter 1.00
E2E_Evaluator_babelrc 107076.764733112 ns/iter 107701.66425380364 ns/iter 0.99
E2E_Evaluator_cerebrum_criminal_case 989251.845938191 ns/iter 1027966.959459509 ns/iter 0.96
E2E_Evaluator_clang_format 117402.90476189478 ns/iter 121760.60139248086 ns/iter 0.96
E2E_Evaluator_cmake_presets 4215432.587878957 ns/iter 4407968.622517246 ns/iter 0.96
E2E_Evaluator_code_climate 186891.61873817418 ns/iter 181497.82833717452 ns/iter 1.03
E2E_Evaluator_cql2 211530.6440677562 ns/iter 220216.65991405296 ns/iter 0.96
E2E_Evaluator_cspell 578768.3679011901 ns/iter 576159.8436987125 ns/iter 1.00
E2E_Evaluator_cypress 191050.75923884567 ns/iter 189753.67799835143 ns/iter 1.01
E2E_Evaluator_deno 312948.4031319153 ns/iter 312187.3767653646 ns/iter 1.00
E2E_Evaluator_dependabot 323166.2661103031 ns/iter 324093.85392738826 ns/iter 1.00
E2E_Evaluator_draft_04 9474093.173913797 ns/iter 9029459.845069269 ns/iter 1.05
E2E_Evaluator_fabric_mod 674189.9346154083 ns/iter 682780.294117742 ns/iter 0.99
E2E_Evaluator_geojson 19105396.540539544 ns/iter 19288184.83333493 ns/iter 0.99
E2E_Evaluator_gitpod_configuration 237326.20020393276 ns/iter 235438.25440373723 ns/iter 1.01
E2E_Evaluator_helm_chart_lock 311948.78266794566 ns/iter 312837.09443207795 ns/iter 1.00
E2E_Evaluator_importmap 46753.796396759615 ns/iter 49170.73221287931 ns/iter 0.95
E2E_Evaluator_jasmine 107041.78315821121 ns/iter 104891.10734121929 ns/iter 1.02
E2E_Evaluator_jshintrc 1198736.5454543277 ns/iter 1203636.5515465757 ns/iter 1.00
E2E_Evaluator_jsconfig 424045.8716707867 ns/iter 431973.56302519003 ns/iter 0.98
E2E_Evaluator_krakend 209858.14369591727 ns/iter 210932.68604298722 ns/iter 0.99
E2E_Evaluator_lazygit 147873.40790057325 ns/iter 149226.01921046592 ns/iter 0.99
E2E_Evaluator_lerna 135914.63436545734 ns/iter 138884.61024628315 ns/iter 0.98
E2E_Evaluator_nest_cli 187105.2328365665 ns/iter 183903.18328978628 ns/iter 1.02
E2E_Evaluator_omc 18850.1584458801 ns/iter 18716.235790393872 ns/iter 1.01
E2E_Evaluator_omnisharp 617297.8888889544 ns/iter 609428.6907665512 ns/iter 1.01
E2E_Evaluator_openapi 9161589.68918869 ns/iter 10073558.917807307 ns/iter 0.91
E2E_Evaluator_pre_commit_hooks 474846.40396455134 ns/iter 476680.53351384366 ns/iter 1.00
E2E_Evaluator_pulumi 716106.5218716982 ns/iter 706553.9104628232 ns/iter 1.01
E2E_Evaluator_semantic_release 99604.5865548645 ns/iter 96704.80379832981 ns/iter 1.03
E2E_Evaluator_stale 147466.3941882521 ns/iter 148268.2420449765 ns/iter 0.99
E2E_Evaluator_stylecop 299748.3217427972 ns/iter 289810.10616576497 ns/iter 1.03
E2E_Evaluator_tmuxinator 99984.34656531039 ns/iter 98853.18016759485 ns/iter 1.01
E2E_Evaluator_ui5 506370.8189780725 ns/iter 509426.54405291314 ns/iter 0.99
E2E_Evaluator_ui5_manifest 2564378.0437958143 ns/iter 2536955.3345461264 ns/iter 1.01
E2E_Evaluator_unreal_engine_uproject 443804.85542177025 ns/iter 434879.8261139789 ns/iter 1.02
E2E_Evaluator_users_array 593206.0444258258 ns/iter 581719.565756666 ns/iter 1.02
E2E_Evaluator_vercel 317128.1132938158 ns/iter 318397.78413699765 ns/iter 1.00
E2E_Evaluator_yamllint 8777.284658794419 ns/iter 8836.206945384314 ns/iter 0.99
Micro_Draft4_Meta_1_No_Callback 198.39834746525622 ns/iter 195.39146895778723 ns/iter 1.02
Micro_Draft4_Required_Properties 793.4852300939186 ns/iter 791.7099914596479 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 23.26896374406318 ns/iter 23.270127535391776 ns/iter 1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.24973341496656 ns/iter 11.22009566657132 ns/iter 1.00
Micro_Draft4_Items_Schema 278.81664302457824 ns/iter 283.6539437616555 ns/iter 0.98
Micro_Draft4_Nested_Object 1.7628651738014423 ns/iter 1.7588471793431466 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 338.39951173620153 ns/iter 322.4650733364083 ns/iter 1.05
Micro_Draft4_Properties_Triad_Closed 275.3945210321258 ns/iter 269.00328044570875 ns/iter 1.02
Micro_Draft4_Properties_Triad_Required 340.9640536275378 ns/iter 338.22336430720264 ns/iter 1.01
Micro_Draft4_Properties_Closed 57.330978777103105 ns/iter 57.89977686714077 ns/iter 0.99
Micro_Draft4_Non_Recursive_Ref 11.587107571210405 ns/iter 11.676956112685264 ns/iter 0.99
Micro_Draft4_Pattern_Properties_True 162.44590287806676 ns/iter 162.43212983437743 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 11.209057376254464 ns/iter 11.216681275902106 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 21.36007634018279 ns/iter 21.463322569269863 ns/iter 1.00
Micro_Draft4_Nested_Oneof 58.83454797777596 ns/iter 58.9437699487699 ns/iter 1.00
Micro_Draft4_Short_Enum 19.335650827546257 ns/iter 12.171218037825337 ns/iter 1.59
Micro_Draft4_Long_Enum 15.325923587698004 ns/iter 15.579906479885945 ns/iter 0.98
Micro_Draft4_Long_Enum_Short_Strings 19.308566145198494 ns/iter 12.16539354678965 ns/iter 1.59
Micro_Draft4_Type_Object 3.73825505302928 ns/iter 3.7384709780746666 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2430865.5625004703 ns/iter 2465586.20422557 ns/iter 0.99
Micro_Draft4_Compile_Ref_Many_Nested 1757376.5753769893 ns/iter 1779220.9822783673 ns/iter 0.99
Micro_Draft4_Compile_Wrap 2410980.851724507 ns/iter 2387330.47959214 ns/iter 1.01
Micro_Draft6_Property_Names 126.46546703584337 ns/iter 126.30103716623208 ns/iter 1.00
Micro_Draft6_Compile_FHIR 13303981201.00017 ns/iter 13755265337.000082 ns/iter 0.97
Micro_Draft7_If_Then_Else 24.302563718002975 ns/iter 24.371634608714885 ns/iter 1.00
Micro_2019_09_Unevaluated_Properties 26.480696324025974 ns/iter 26.51687650893403 ns/iter 1.00
Micro_2019_09_Compile_Wrap 289800577.49993193 ns/iter 313115007.9999543 ns/iter 0.93
Micro_2020_12_Dynamic_Ref 231.78602060605414 ns/iter 230.33760508738425 ns/iter 1.01
Micro_2020_12_Dynamic_Ref_Single 3.4362417120200814 ns/iter 3.4292990836023214 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1083.110331675135 ns/iter 1084.6035630073463 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 104089.46809750579 ns/iter 110381.13721218618 ns/iter 0.94
Micro_2020_12_Compile_NonCircular_Shared_Refs 1126274.8677418425 ns/iter 1111995.4247226308 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric 8846.733401504773 ns/iter 8238.910796742923 ns/iter 1.07
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 178593.03626678724 ns/iter 176721.52770780763 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 22523.18062370856 ns/iter 23096.67652284205 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 145.1081759500314 ns/iter 142.09064038408678 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4231.6915167568095 ns/iter 4450.14876785629 ns/iter 0.95
Alterschema_Check_Readibility_ISO_Language_Set_3 361292735.0000064 ns/iter 382290609.50004625 ns/iter 0.95
Alterschema_Check_Readibility_OMC 83524307.62499808 ns/iter 83912502.87502317 ns/iter 1.00
Alterschema_Check_Readibility_KrakenD 1173520079.9998894 ns/iter 1164720284.9999304 ns/iter 1.01
Alterschema_Apply_Readibility_KrakenD 119091624040.00017 ns/iter 117039515569.99982 ns/iter 1.02
Alterschema_Check_Invalid_External_Refs 305319087.0000435 ns/iter 295072872.999981 ns/iter 1.03

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: 6937b52 Previous: a774160 Ratio
E2E_Evaluator_adaptivecard 118869 ns 119910 ns 0.99
E2E_Evaluator_ansible-meta 522636 ns 538540 ns 0.97
E2E_Evaluator_aws-cdk 148229 ns 145948 ns 1.02
E2E_Evaluator_babelrc 329360 ns 325854 ns 1.01
E2E_Evaluator_cerebrum-criminal-case 2464552 ns 2511735 ns 0.98
E2E_Evaluator_clang-format 262791 ns 261172 ns 1.01
E2E_Evaluator_cmake-presets 18158280 ns 19488571 ns 0.93
E2E_Evaluator_code-climate 551003 ns 508705 ns 1.08
E2E_Evaluator_cql2 1250711 ns 1253762 ns 1.00
E2E_Evaluator_cspell 1552121 ns 1547384 ns 1.00
E2E_Evaluator_cypress 791289 ns 787696 ns 1.00
E2E_Evaluator_deno 1100674 ns 1068593 ns 1.03
E2E_Evaluator_dependabot 1255979 ns 1118566 ns 1.12
E2E_Evaluator_draft-04 23263477 ns 26791509 ns 0.87
E2E_Evaluator_fabric-mod 2365188 ns 2409447 ns 0.98
E2E_Evaluator_geojson 20848737 ns 20287459 ns 1.03
E2E_Evaluator_gitpod-configuration 727028 ns 724581 ns 1.00
E2E_Evaluator_helm-chart-lock 1113344 ns 986749 ns 1.13
E2E_Evaluator_importmap 305431 ns 262755 ns 1.16
E2E_Evaluator_jasmine 314749 ns 297973 ns 1.06
E2E_Evaluator_jsconfig 1245378 ns 1226779 ns 1.02
E2E_Evaluator_jshintrc 2744272 ns 2766891 ns 0.99
E2E_Evaluator_krakend 675501 ns 666862 ns 1.01
E2E_Evaluator_lazygit 509834 ns 515465 ns 0.99
E2E_Evaluator_lerna 464379 ns 462575 ns 1.00
E2E_Evaluator_nest-cli 602250 ns 584423 ns 1.03
E2E_Evaluator_omc 94860 ns 91649 ns 1.04
E2E_Evaluator_omnisharp 1410458 ns 1406200 ns 1.00
E2E_Evaluator_openapi 23271556 ns 24970023 ns 0.93
E2E_Evaluator_pre-commit-hooks 2051112 ns 1979980 ns 1.04
E2E_Evaluator_pulumi 1959613 ns 1926681 ns 1.02
E2E_Evaluator_semantic-release 253464 ns 253823 ns 1.00
E2E_Evaluator_stale 407481 ns 403493 ns 1.01
E2E_Evaluator_stylecop 1255998 ns 1277497 ns 0.98
E2E_Evaluator_tmuxinator 229685 ns 225569 ns 1.02
E2E_Evaluator_ui5 2422314 ns 2375458 ns 1.02
E2E_Evaluator_ui5-manifest 10488254 ns 12252329 ns 0.86
E2E_Evaluator_unreal-engine-uproject 1521787 ns 1527135 ns 1.00
E2E_Evaluator_users-array 2420256 ns 2510856 ns 0.96
E2E_Evaluator_vercel 1013636 ns 986656 ns 1.03
E2E_Evaluator_yamllint 30061 ns 26278 ns 1.14

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 6937b52 Previous: a774160 Ratio
Schema_Iterator_ISO_Language 3423969.7563453554 ns/iter 2381396.315614707 ns/iter 1.44
Schema_Tracker_ISO_Language 7889704.22535334 ns/iter 5167411.355704638 ns/iter 1.53
Schema_Tracker_ISO_Language_To_JSON 19605180.189187564 ns/iter 15608073.142857393 ns/iter 1.26
Schema_Frame_WoT_References 7069966.666666092 ns/iter 4960684.782608259 ns/iter 1.43
Schema_Frame_OMC_References 31876094.681820177 ns/iter 24142997.103448078 ns/iter 1.32
Schema_Frame_OMC_Locations 28688503.31999965 ns/iter 23926395.161289115 ns/iter 1.20
Schema_Frame_ISO_Language_Locations 79956555.55555458 ns/iter 74068597.2222208 ns/iter 1.08
Schema_Frame_KrakenD_References 43857210.93748885 ns/iter 43143054.6875049 ns/iter 1.02
Schema_Frame_KrakenD_Reachable 402749083.000117 ns/iter 399405270.9999778 ns/iter 1.01
Schema_Frame_ISO_Language_Locations_To_JSON 77500583.3333277 ns/iter 72163078.66666384 ns/iter 1.07
Schema_Frame_Many_Resources_References 290415680.3333535 ns/iter 277865027.6666592 ns/iter 1.05
Schema_Bundle_Meta_2020_12 1342135.3178308674 ns/iter 1304039.1401500357 ns/iter 1.03
Schema_Format_ISO_Language_To_JSON 80490699.11112383 ns/iter 75392907.55556117 ns/iter 1.07
E2E_Compiler_adaptivecard 61806892.33334154 ns/iter 56759673.58332438 ns/iter 1.09
E2E_Compiler_ansible_meta 27471498.44444047 ns/iter 25229349.714286238 ns/iter 1.09
E2E_Compiler_aws_cdk 337378.5306123234 ns/iter 277609.9504950649 ns/iter 1.22
E2E_Compiler_babelrc 2388028.2061855504 ns/iter 2174304.165625074 ns/iter 1.10
E2E_Compiler_clang_format 16424875.000000482 ns/iter 15656369.31818207 ns/iter 1.05
E2E_Compiler_cmake_presets 28658410.230762526 ns/iter 25899058.629630856 ns/iter 1.11
E2E_Compiler_code_climate 2340368.2249128944 ns/iter 2204395.3069619793 ns/iter 1.06
E2E_Compiler_cql2 14342672.624999458 ns/iter 12115795.258619623 ns/iter 1.18
E2E_Compiler_cspell 22161653.624998223 ns/iter 20411589.470591158 ns/iter 1.09
E2E_Compiler_cypress 3950870.9016402964 ns/iter 3627426.546391764 ns/iter 1.09
E2E_Compiler_deno 7169271.844660012 ns/iter 7325935.499999594 ns/iter 0.98
E2E_Compiler_dependabot 3851098.445053779 ns/iter 4468977.00000045 ns/iter 0.86
E2E_Compiler_draft_04 2127369.1488767676 ns/iter 2150318.368421018 ns/iter 0.99
E2E_Compiler_fabric_mod 3717266.617977504 ns/iter 3857203.898936656 ns/iter 0.96
E2E_Compiler_geojson 22687016.424242757 ns/iter 23010697.58064592 ns/iter 0.99
E2E_Compiler_gitpod_configuration 4178340.6704535186 ns/iter 4157143.0000000536 ns/iter 1.01
E2E_Compiler_helm_chart_lock 526829.6607408518 ns/iter 516793.1481481799 ns/iter 1.02
E2E_Compiler_importmap 204255.88364868058 ns/iter 204069.31420206555 ns/iter 1.00
E2E_Compiler_jasmine 1096553.9475309756 ns/iter 1054150.4343284182 ns/iter 1.04
E2E_Compiler_jshintrc 3271011.5874446514 ns/iter 3145442.378378415 ns/iter 1.04
E2E_Compiler_jsconfig 18992325.43243326 ns/iter 18615836.729730513 ns/iter 1.02
E2E_Compiler_krakend 145734141.79999417 ns/iter 120735090.33333115 ns/iter 1.21
E2E_Compiler_lazygit 33371059.523807116 ns/iter 30722460.22727334 ns/iter 1.09
E2E_Compiler_lerna 1489194.285714326 ns/iter 1317218.900362316 ns/iter 1.13
E2E_Compiler_nest_cli 6720402.151785265 ns/iter 6142948.191303849 ns/iter 1.09
E2E_Compiler_omc 167081083.2499683 ns/iter 159605687.50000447 ns/iter 1.05
E2E_Compiler_omnisharp 5689370.050847282 ns/iter 5927908.051724028 ns/iter 0.96
E2E_Compiler_openapi 21330588.235293683 ns/iter 21021959.62500275 ns/iter 1.01
E2E_Compiler_pre_commit_hooks 4062438.4709306387 ns/iter 4191519.028901468 ns/iter 0.97
E2E_Compiler_pulumi 3698474.456521818 ns/iter 3397154.49315027 ns/iter 1.09
E2E_Compiler_semantic_release 1654427.586206749 ns/iter 1344541.0649817544 ns/iter 1.23
E2E_Compiler_stale 1408841.3370995037 ns/iter 1234135.726795039 ns/iter 1.14
E2E_Compiler_stylecop 6546089.722628063 ns/iter 5483058.921875283 ns/iter 1.19
E2E_Compiler_tmuxinator 2056642.3150686915 ns/iter 1746727.2727273735 ns/iter 1.18
E2E_Compiler_ui5 63148041.666655295 ns/iter 48716973.21428721 ns/iter 1.30
E2E_Compiler_ui5_manifest 350185312.5000025 ns/iter 286325562.49999654 ns/iter 1.22
E2E_Compiler_unreal_engine_uproject 3876380.63529507 ns/iter 3933997.793651134 ns/iter 0.99
E2E_Compiler_users_array 805111.2576883563 ns/iter 764467.4062837672 ns/iter 1.05
E2E_Compiler_vercel 12826396.852460675 ns/iter 12428659.951612439 ns/iter 1.03
E2E_Compiler_yamllint 270990.3098257085 ns/iter 238915.53188554395 ns/iter 1.13
E2E_Evaluator_adaptivecard 22314.723268128364 ns/iter 19767.963987241492 ns/iter 1.13
E2E_Evaluator_ansible_meta 173363.40192845624 ns/iter 163081.23574325218 ns/iter 1.06
E2E_Evaluator_aws_cdk 36393.21966938834 ns/iter 33015.840697396714 ns/iter 1.10
E2E_Evaluator_babelrc 94596.87084554437 ns/iter 78560.60816055197 ns/iter 1.20
E2E_Evaluator_cerebrum_criminal_case 799068.6018957772 ns/iter 683306.9135371253 ns/iter 1.17
E2E_Evaluator_clang_format 113406.30731770187 ns/iter 95770.88361491749 ns/iter 1.18
E2E_Evaluator_cmake_presets 4059293.122092778 ns/iter 3168982.7777775764 ns/iter 1.28
E2E_Evaluator_code_climate 143156.65033692232 ns/iter 122771.51152559758 ns/iter 1.17
E2E_Evaluator_cql2 167845.97490155912 ns/iter 140468.31669709683 ns/iter 1.19
E2E_Evaluator_cspell 430665.13805979636 ns/iter 362947.44994785264 ns/iter 1.19
E2E_Evaluator_cypress 169393.98116242827 ns/iter 141329.69147873347 ns/iter 1.20
E2E_Evaluator_deno 254328.65386034406 ns/iter 224192.82800510214 ns/iter 1.13
E2E_Evaluator_dependabot 259146.30689260177 ns/iter 226009.86048064046 ns/iter 1.15
E2E_Evaluator_draft_04 6005826.66399896 ns/iter 5114023.116788383 ns/iter 1.17
E2E_Evaluator_fabric_mod 530292.7499999441 ns/iter 473422.6583112987 ns/iter 1.12
E2E_Evaluator_geojson 12298347.457625808 ns/iter 9222021.999999836 ns/iter 1.33
E2E_Evaluator_gitpod_configuration 176853.3671700589 ns/iter 154823.0137350631 ns/iter 1.14
E2E_Evaluator_helm_chart_lock 253749.61472431434 ns/iter 205393.00716948084 ns/iter 1.24
E2E_Evaluator_importmap 34343.35904218949 ns/iter 28986.162188969567 ns/iter 1.18
E2E_Evaluator_jasmine 86373.52231604015 ns/iter 77082.47770700649 ns/iter 1.12
E2E_Evaluator_jshintrc 1036690.0793650572 ns/iter 895143.2634960249 ns/iter 1.16
E2E_Evaluator_jsconfig 434588.1937059622 ns/iter 292818.33458181605 ns/iter 1.48
E2E_Evaluator_krakend 145726.67619445585 ns/iter 129232.40055969737 ns/iter 1.13
E2E_Evaluator_lazygit 109147.11890427032 ns/iter 93822.9470400893 ns/iter 1.16
E2E_Evaluator_lerna 128653.12381292765 ns/iter 120251.60771647381 ns/iter 1.07
E2E_Evaluator_nest_cli 160331.80218921523 ns/iter 127028.14160992522 ns/iter 1.26
E2E_Evaluator_omc 17433.98574433166 ns/iter 13461.10083123378 ns/iter 1.30
E2E_Evaluator_omnisharp 524523.6670000395 ns/iter 417323.3015494594 ns/iter 1.26
E2E_Evaluator_openapi 8467028.166667964 ns/iter 5097805.453237761 ns/iter 1.66
E2E_Evaluator_pre_commit_hooks 412421.92237719486 ns/iter 319863.6010218368 ns/iter 1.29
E2E_Evaluator_pulumi 559383.6206897376 ns/iter 464441.3012608221 ns/iter 1.20
E2E_Evaluator_semantic_release 75860.88910154792 ns/iter 62857.781187942266 ns/iter 1.21
E2E_Evaluator_stale 152154.7530520648 ns/iter 104101.71750074852 ns/iter 1.46
E2E_Evaluator_stylecop 309161.7492477639 ns/iter 172337.81283292457 ns/iter 1.79
E2E_Evaluator_tmuxinator 85042.3596884979 ns/iter 64231.70939155783 ns/iter 1.32
E2E_Evaluator_ui5 381427.20143452263 ns/iter 313312.43359194236 ns/iter 1.22
E2E_Evaluator_ui5_manifest 2128629.7837840216 ns/iter 1429076.388211431 ns/iter 1.49
E2E_Evaluator_unreal_engine_uproject 411071.65403089905 ns/iter 304460.084477737 ns/iter 1.35
E2E_Evaluator_users_array 531286.7036011482 ns/iter 387035.9904819107 ns/iter 1.37
E2E_Evaluator_vercel 242805.70742217632 ns/iter 198924.37575063863 ns/iter 1.22
E2E_Evaluator_yamllint 6411.659865859416 ns/iter 5600.115042750017 ns/iter 1.14
Micro_Draft4_Meta_1_No_Callback 154.38802910462883 ns/iter 130.23289404113874 ns/iter 1.19
Micro_Draft4_Required_Properties 703.8406446357186 ns/iter 589.6720279714552 ns/iter 1.19
Micro_Draft4_Many_Optional_Properties_Minimal_Match 20.713283931239303 ns/iter 16.916775274366547 ns/iter 1.22
Micro_Draft4_Few_Optional_Properties_Minimal_Match 8.720146641392692 ns/iter 6.777584571596122 ns/iter 1.29
Micro_Draft4_Items_Schema 286.5795106738218 ns/iter 235.27612697901037 ns/iter 1.22
Micro_Draft4_Nested_Object 0.7564480447092872 ns/iter 0.6272136542684451 ns/iter 1.21
Micro_Draft4_Properties_Triad_Optional 234.99309735281958 ns/iter 197.03357346995404 ns/iter 1.19
Micro_Draft4_Properties_Triad_Closed 182.7479499053403 ns/iter 163.51202890537027 ns/iter 1.12
Micro_Draft4_Properties_Triad_Required 236.82551045543377 ns/iter 202.17158439505886 ns/iter 1.17
Micro_Draft4_Properties_Closed 41.77446272249161 ns/iter 37.969036399109896 ns/iter 1.10
Micro_Draft4_Non_Recursive_Ref 10.14948527737113 ns/iter 9.090935522704147 ns/iter 1.12
Micro_Draft4_Pattern_Properties_True 153.80761870536645 ns/iter 142.44583201644187 ns/iter 1.08
Micro_Draft4_Ref_To_Single_Property 8.005270066873612 ns/iter 6.784563065554289 ns/iter 1.18
Micro_Draft4_Additional_Properties_Type 20.62395639377278 ns/iter 18.896370125746376 ns/iter 1.09
Micro_Draft4_Nested_Oneof 47.74226704639852 ns/iter 37.123698785896956 ns/iter 1.29
Micro_Draft4_Short_Enum 5.414567534019996 ns/iter 4.585751794662259 ns/iter 1.18
Micro_Draft4_Long_Enum 12.990246656204102 ns/iter 9.107301808488987 ns/iter 1.43
Micro_Draft4_Long_Enum_Short_Strings 6.980658358647658 ns/iter 6.4609050575269045 ns/iter 1.08
Micro_Draft4_Type_Object 2.4961233359966415 ns/iter 2.1746564807159667 ns/iter 1.15
Micro_Draft4_Ref_Single_100 1814433.093994976 ns/iter 1520715.943478209 ns/iter 1.19
Micro_Draft4_Compile_Ref_Many_Nested 1504795.6923074974 ns/iter 1113366.9856915744 ns/iter 1.35
Micro_Draft4_Compile_Wrap 2289582.8031749493 ns/iter 1824078.246753353 ns/iter 1.26
Micro_Draft6_Property_Names 112.87766456121037 ns/iter 99.06255931287669 ns/iter 1.14
Micro_Draft6_Compile_FHIR 17418785458.000004 ns/iter 6557495249.999989 ns/iter 2.66
Micro_Draft7_If_Then_Else 24.808426210047326 ns/iter 17.22694950236715 ns/iter 1.44
Micro_2019_09_Unevaluated_Properties 35.54574696111443 ns/iter 23.835638083777024 ns/iter 1.49
Micro_2019_09_Compile_Wrap 499459854.0000652 ns/iter 267004569.33334255 ns/iter 1.87
Micro_2020_12_Dynamic_Ref 271.3504663207033 ns/iter 187.71012022183606 ns/iter 1.45
Micro_2020_12_Dynamic_Ref_Single 3.5291601260599763 ns/iter 2.155671063010879 ns/iter 1.64
Micro_2020_12_Simple_Output_Mask 1230.1366416832834 ns/iter 746.5750842397895 ns/iter 1.65
Micro_2020_12_Simple_Output_Annotations 116774.39719220533 ns/iter 78021.78065592013 ns/iter 1.50
Micro_2020_12_Compile_NonCircular_Shared_Refs 1153413.120060939 ns/iter 729266.1060925415 ns/iter 1.58
Micro_2020_12_Exhaustive_Deep_Numeric 7221.887796539633 ns/iter 4689.366077464745 ns/iter 1.54
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 158979.69848772878 ns/iter 103702.53542133942 ns/iter 1.53
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 19229.843919167713 ns/iter 12583.18290733578 ns/iter 1.53
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 148.53527106550231 ns/iter 81.52321536818098 ns/iter 1.82
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 7845.590670239698 ns/iter 4417.855268316438 ns/iter 1.78
Alterschema_Check_Readibility_ISO_Language_Set_3 344868375.0000328 ns/iter 200540041.66665134 ns/iter 1.72
Alterschema_Check_Readibility_OMC 101675410.71427877 ns/iter 50124038.714281075 ns/iter 2.03
Alterschema_Check_Readibility_KrakenD 1162180457.9999661 ns/iter 533703875.0000147 ns/iter 2.18
Alterschema_Apply_Readibility_KrakenD 82202435583.9999 ns/iter 60386555791.99997 ns/iter 1.36
Alterschema_Check_Invalid_External_Refs 229750430.33329713 ns/iter 159196895.75000006 ns/iter 1.44

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: 6937b52 Previous: a774160 Ratio
E2E_Evaluator_adaptivecard 102494 ns 97194 ns 1.05
E2E_Evaluator_ansible-meta 420628 ns 333547 ns 1.26
E2E_Evaluator_aws-cdk 122081 ns 115678 ns 1.06
E2E_Evaluator_babelrc 308895 ns 248860 ns 1.24
E2E_Evaluator_cerebrum-criminal-case 1635493 ns 1615371 ns 1.01
E2E_Evaluator_clang-format 327204 ns 171854 ns 1.90
E2E_Evaluator_cmake-presets 28006183 ns 11642313 ns 2.41
E2E_Evaluator_code-climate 358008 ns 392182 ns 0.91
E2E_Evaluator_cql2 1024403 ns 1029395 ns 1.00
E2E_Evaluator_cspell 1135986 ns 1319411 ns 0.86
E2E_Evaluator_cypress 670955 ns 589212 ns 1.14
E2E_Evaluator_deno 841351 ns 709253 ns 1.19
E2E_Evaluator_dependabot 905858 ns 711297 ns 1.27
E2E_Evaluator_draft-04 21321223 ns 15733695 ns 1.36
E2E_Evaluator_fabric-mod 2236054 ns 1362988 ns 1.64
E2E_Evaluator_geojson 15925878 ns 13700819 ns 1.16
E2E_Evaluator_gitpod-configuration 653805 ns 468798 ns 1.39
E2E_Evaluator_helm-chart-lock 1061689 ns 831216 ns 1.28
E2E_Evaluator_importmap 241609 ns 203360 ns 1.19
E2E_Evaluator_jasmine 244065 ns 218574 ns 1.12
E2E_Evaluator_jsconfig 1193984 ns 805859 ns 1.48
E2E_Evaluator_jshintrc 2459501 ns 2041277 ns 1.20
E2E_Evaluator_krakend 534531 ns 413324 ns 1.29
E2E_Evaluator_lazygit 322557 ns 263264 ns 1.23
E2E_Evaluator_lerna 380921 ns 319416 ns 1.19
E2E_Evaluator_nest-cli 580586 ns 401709 ns 1.45
E2E_Evaluator_omc 96605 ns 67762 ns 1.43
E2E_Evaluator_omnisharp 1206566 ns 916901 ns 1.32
E2E_Evaluator_openapi 19737745 ns 14527617 ns 1.36
E2E_Evaluator_pre-commit-hooks 1501372 ns 1298143 ns 1.16
E2E_Evaluator_pulumi 1642071 ns 1311955 ns 1.25
E2E_Evaluator_semantic-release 196995 ns 175444 ns 1.12
E2E_Evaluator_stale 305444 ns 281002 ns 1.09
E2E_Evaluator_stylecop 1057192 ns 690857 ns 1.53
E2E_Evaluator_tmuxinator 177346 ns 152358 ns 1.16
E2E_Evaluator_ui5 1894252 ns 1485628 ns 1.28
E2E_Evaluator_ui5-manifest 10576736 ns 6989100 ns 1.51
E2E_Evaluator_unreal-engine-uproject 1283807 ns 1128375 ns 1.14
E2E_Evaluator_users-array 2508295 ns 1791148 ns 1.40
E2E_Evaluator_vercel 864042 ns 694155 ns 1.24
E2E_Evaluator_yamllint 25360 ns 22518 ns 1.13

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit 887b6ee into main May 29, 2026
14 checks passed
@jviotti jviotti deleted the 2019-09-formats branch May 29, 2026 18:20
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 6937b52 Previous: a774160 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 362355936.49996644 ns/iter 259019756.00004333 ns/iter 1.40
Alterschema_Check_Readibility_OMC 97638618.28569783 ns/iter 78946784.99999624 ns/iter 1.24
Alterschema_Check_Readibility_KrakenD 1333639239.9999113 ns/iter 1048478503.0000694 ns/iter 1.27
Alterschema_Apply_Readibility_KrakenD 135309131749.00002 ns/iter 101794207819.99988 ns/iter 1.33
Alterschema_Check_Invalid_External_Refs 303618077.5000048 ns/iter 231779028.99995694 ns/iter 1.31
Micro_2020_12_Dynamic_Ref 260.63555056863845 ns/iter 208.9447849488203 ns/iter 1.25
Micro_2020_12_Dynamic_Ref_Single 4.583451309855347 ns/iter 3.819259925109795 ns/iter 1.20
Micro_2020_12_Simple_Output_Mask 1116.8831054575012 ns/iter 866.7433824873841 ns/iter 1.29
Micro_2020_12_Simple_Output_Annotations 102992.40163083439 ns/iter 82689.81589217222 ns/iter 1.25
Micro_2020_12_Compile_NonCircular_Shared_Refs 1248542.9429589673 ns/iter 973964.7111110294 ns/iter 1.28
Micro_2020_12_Exhaustive_Deep_Numeric 8735.219856589492 ns/iter 6715.032734109172 ns/iter 1.30
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 157581.27898124093 ns/iter 122103.55601446317 ns/iter 1.29
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 26571.46491988549 ns/iter 20969.572087554476 ns/iter 1.27
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 157.27944684910628 ns/iter 119.45413292779088 ns/iter 1.32
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4497.270988605696 ns/iter 3529.0275047630657 ns/iter 1.27
Micro_2019_09_Unevaluated_Properties 28.526179354318597 ns/iter 21.570849472268357 ns/iter 1.32
Micro_2019_09_Compile_Wrap 331307297.9999561 ns/iter 251741301.66662204 ns/iter 1.32
Micro_Draft7_If_Then_Else 24.936802153551493 ns/iter 19.33131255942275 ns/iter 1.29
Micro_Draft6_Property_Names 145.08950189839726 ns/iter 122.10693175075237 ns/iter 1.19
Micro_Draft6_Compile_FHIR 14826877942.00001 ns/iter 11056247727.000027 ns/iter 1.34
Micro_Draft4_Meta_1_No_Callback 177.49626142716556 ns/iter 136.73543278645906 ns/iter 1.30
Micro_Draft4_Required_Properties 830.3886412790758 ns/iter 646.1478306334499 ns/iter 1.29
Micro_Draft4_Many_Optional_Properties_Minimal_Match 20.98218857738602 ns/iter 16.25598927094618 ns/iter 1.29
Micro_Draft4_Few_Optional_Properties_Minimal_Match 12.66621246242286 ns/iter 9.827971539117685 ns/iter 1.29
Micro_Draft4_Items_Schema 297.2129526696394 ns/iter 246.64175738482265 ns/iter 1.21
Micro_Draft4_Nested_Object 2.1098704918584725 ns/iter 1.3671422104949182 ns/iter 1.54
Micro_Draft4_Properties_Triad_Optional 412.4015527532069 ns/iter 320.3893298818594 ns/iter 1.29
Micro_Draft4_Properties_Triad_Closed 345.91803669586693 ns/iter 255.82792119067201 ns/iter 1.35
Micro_Draft4_Properties_Triad_Required 429.3877735408348 ns/iter 329.8739451822328 ns/iter 1.30
Micro_Draft4_Properties_Closed 61.98354531308057 ns/iter 47.54164667683932 ns/iter 1.30
Micro_Draft4_Non_Recursive_Ref 9.148599497692826 ns/iter 7.371629570237982 ns/iter 1.24
Micro_Draft4_Pattern_Properties_True 190.29462335565617 ns/iter 150.37586618005182 ns/iter 1.27
Micro_Draft4_Ref_To_Single_Property 13.026893872224546 ns/iter 10.101921187556279 ns/iter 1.29
Micro_Draft4_Additional_Properties_Type 13.746137657442748 ns/iter 10.921502024517952 ns/iter 1.26
Micro_Draft4_Nested_Oneof 63.41143766776973 ns/iter 50.4926695689965 ns/iter 1.26
Micro_Draft4_Short_Enum 14.554589773792944 ns/iter 11.272184220525363 ns/iter 1.29
Micro_Draft4_Long_Enum 14.042969212422994 ns/iter 10.098965927004032 ns/iter 1.39
Micro_Draft4_Long_Enum_Short_Strings 14.484986376025237 ns/iter 11.23329745123008 ns/iter 1.29
Micro_Draft4_Type_Object 4.57381935343055 ns/iter 3.825304471381136 ns/iter 1.20
Micro_Draft4_Ref_Single_100 2600828.1074070884 ns/iter 1941404.0581721067 ns/iter 1.34
Micro_Draft4_Compile_Ref_Many_Nested 1907384.2975210098 ns/iter 1422786.632322944 ns/iter 1.34
Micro_Draft4_Compile_Wrap 2674667.8499998427 ns/iter 2033986.6531793175 ns/iter 1.31
E2E_Compiler_adaptivecard 69518417.59998843 ns/iter 52677735.07692324 ns/iter 1.32
E2E_Compiler_ansible_meta 33956530.142859265 ns/iter 25872767.888889335 ns/iter 1.31
E2E_Compiler_aws_cdk 423166.75469325384 ns/iter 328985.4842055648 ns/iter 1.29
E2E_Compiler_babelrc 2901323.579166615 ns/iter 2275004.6980513027 ns/iter 1.28
E2E_Compiler_clang_format 20687890.02941471 ns/iter 16088709.534885712 ns/iter 1.29
E2E_Compiler_cmake_presets 28449419.39999444 ns/iter 22642857.031250685 ns/iter 1.26
E2E_Compiler_code_climate 2968082.978813943 ns/iter 2320848.4768205057 ns/iter 1.28
E2E_Compiler_cql2 14693184.333329631 ns/iter 11167887.936507111 ns/iter 1.32
E2E_Compiler_cspell 25420047.64286178 ns/iter 19247178.222220406 ns/iter 1.32
E2E_Compiler_cypress 4347309.043750158 ns/iter 3379260.839805398 ns/iter 1.29
E2E_Compiler_deno 8866730.240507549 ns/iter 6930822.623763733 ns/iter 1.28
E2E_Compiler_dependabot 4434772.9303794205 ns/iter 3490119.4825866628 ns/iter 1.27
E2E_Compiler_draft_04 3076728.4537450746 ns/iter 2413480.006896015 ns/iter 1.27
E2E_Compiler_fabric_mod 5396801.692308355 ns/iter 4243585.253011204 ns/iter 1.27
E2E_Compiler_geojson 25053140.23999745 ns/iter 19600696.83333485 ns/iter 1.28
E2E_Compiler_gitpod_configuration 5517668.535432003 ns/iter 4349338.850931942 ns/iter 1.27
E2E_Compiler_helm_chart_lock 764618.9650273061 ns/iter 601306.4268503116 ns/iter 1.27
E2E_Compiler_importmap 318350.0892696433 ns/iter 247039.74858953708 ns/iter 1.29
E2E_Compiler_jasmine 1521879.3709329767 ns/iter 1207564.6333905377 ns/iter 1.26
E2E_Compiler_jshintrc 4834583.3103447715 ns/iter 3786045.827027428 ns/iter 1.28
E2E_Compiler_jsconfig 23932782.103452936 ns/iter 18623032.815789405 ns/iter 1.29
E2E_Compiler_krakend 152774482.99998468 ns/iter 115675247.66667247 ns/iter 1.32
E2E_Compiler_lazygit 37335852.47368865 ns/iter 29052633.416663792 ns/iter 1.29
E2E_Compiler_lerna 1816249.3834197542 ns/iter 1421719.7479672544 ns/iter 1.28
E2E_Compiler_nest_cli 8395727.036143847 ns/iter 6562441.46728857 ns/iter 1.28
E2E_Compiler_omc 183270743.7499721 ns/iter 142265004.00000077 ns/iter 1.29
E2E_Compiler_omnisharp 7545022.043478125 ns/iter 5929160.737286636 ns/iter 1.27
E2E_Compiler_openapi 28623485.680000156 ns/iter 22350670.838712234 ns/iter 1.28
E2E_Compiler_pre_commit_hooks 5965803.237287774 ns/iter 4642870.768212193 ns/iter 1.28
E2E_Compiler_pulumi 4548318.584415466 ns/iter 3577592.836735471 ns/iter 1.27
E2E_Compiler_semantic_release 1779966.3248734728 ns/iter 1401870.3279998591 ns/iter 1.27
E2E_Compiler_stale 1742187.6501237275 ns/iter 1375423.5697443443 ns/iter 1.27
E2E_Compiler_stylecop 7025271.260001773 ns/iter 5545220.818898603 ns/iter 1.27
E2E_Compiler_tmuxinator 2185754.538940814 ns/iter 1725495.8271605351 ns/iter 1.27
E2E_Compiler_ui5 52454457.38460848 ns/iter 40837241.35295384 ns/iter 1.28
E2E_Compiler_ui5_manifest 342383562.00000906 ns/iter 261502732.00005355 ns/iter 1.31
E2E_Compiler_unreal_engine_uproject 5151311.940741194 ns/iter 4036361.844828468 ns/iter 1.28
E2E_Compiler_users_array 907482.2036315453 ns/iter 685005.5696077106 ns/iter 1.32
E2E_Compiler_vercel 13661433.843137775 ns/iter 10443532.104477866 ns/iter 1.31
E2E_Compiler_yamllint 383753.6010929358 ns/iter 300304.0498280912 ns/iter 1.28
E2E_Evaluator_adaptivecard 23452.944763599535 ns/iter 18152.799807806176 ns/iter 1.29
E2E_Evaluator_ansible_meta 241399.94172095958 ns/iter 190495.1900053542 ns/iter 1.27
E2E_Evaluator_aws_cdk 47535.91986417723 ns/iter 37307.99179893872 ns/iter 1.27
E2E_Evaluator_babelrc 87590.55833544012 ns/iter 67390.58374191554 ns/iter 1.30
E2E_Evaluator_cerebrum_criminal_case 1124942.8052370423 ns/iter 1039266.2292900418 ns/iter 1.08
E2E_Evaluator_clang_format 99967.61512125385 ns/iter 77262.81306856738 ns/iter 1.29
E2E_Evaluator_cmake_presets 4794403.3956829645 ns/iter 3690707.695186769 ns/iter 1.30
E2E_Evaluator_code_climate 169277.94012118474 ns/iter 131085.7952918911 ns/iter 1.29
E2E_Evaluator_cql2 213074.58731102874 ns/iter 160551.9800278674 ns/iter 1.33
E2E_Evaluator_cspell 509548.32164184627 ns/iter 398762.0177409685 ns/iter 1.28
E2E_Evaluator_cypress 144215.7269326482 ns/iter 110979.31669864112 ns/iter 1.30
E2E_Evaluator_deno 291722.74144479044 ns/iter 235631.68676276805 ns/iter 1.24
E2E_Evaluator_dependabot 357198.6134969511 ns/iter 272364.49432041723 ns/iter 1.31
E2E_Evaluator_draft_04 12279352.302325713 ns/iter 9353533.552631402 ns/iter 1.31
E2E_Evaluator_fabric_mod 731903.1543340266 ns/iter 591222.9173693684 ns/iter 1.24
E2E_Evaluator_geojson 20219549.911764584 ns/iter 18198748.250000563 ns/iter 1.11
E2E_Evaluator_gitpod_configuration 233665.79676985138 ns/iter 180087.12094702118 ns/iter 1.30
E2E_Evaluator_helm_chart_lock 218494.54525452462 ns/iter 169781.35146340408 ns/iter 1.29
E2E_Evaluator_importmap 41156.64873719652 ns/iter 31445.81271973288 ns/iter 1.31
E2E_Evaluator_jasmine 103930.15014119458 ns/iter 80195.56034381832 ns/iter 1.30
E2E_Evaluator_jshintrc 1024151.3171805709 ns/iter 800364.6182857794 ns/iter 1.28
E2E_Evaluator_jsconfig 372414.06448196643 ns/iter 288372.31280997285 ns/iter 1.29
E2E_Evaluator_krakend 186613.39652408546 ns/iter 143552.15794849963 ns/iter 1.30
E2E_Evaluator_lazygit 128333.22658389196 ns/iter 100279.67800972197 ns/iter 1.28
E2E_Evaluator_lerna 136985.95878694084 ns/iter 102831.1077058917 ns/iter 1.33
E2E_Evaluator_nest_cli 183849.1522137681 ns/iter 142090.3547997498 ns/iter 1.29
E2E_Evaluator_omc 18558.093172650337 ns/iter 14663.209135879706 ns/iter 1.27
E2E_Evaluator_omnisharp 550611.1129643593 ns/iter 404449.6479118364 ns/iter 1.36
E2E_Evaluator_openapi 11103815.380952906 ns/iter 9636983.465753311 ns/iter 1.15
E2E_Evaluator_pre_commit_hooks 474160.0805909343 ns/iter 364552.16378861543 ns/iter 1.30
E2E_Evaluator_pulumi 752456.4646227522 ns/iter 580551.4958472583 ns/iter 1.30
E2E_Evaluator_semantic_release 87225.87876141911 ns/iter 66850.04698307185 ns/iter 1.30
E2E_Evaluator_stale 156809.6069351192 ns/iter 121560.52409112213 ns/iter 1.29
E2E_Evaluator_stylecop 292278.4256474281 ns/iter 228734.95529110142 ns/iter 1.28
E2E_Evaluator_tmuxinator 87539.92926162541 ns/iter 67208.54651612569 ns/iter 1.30
E2E_Evaluator_ui5 526000.2064083273 ns/iter 404282.4465627764 ns/iter 1.30
E2E_Evaluator_ui5_manifest 2619943.3984368527 ns/iter 2056481.1020409495 ns/iter 1.27
E2E_Evaluator_unreal_engine_uproject 434633.0553458333 ns/iter 342471.01158307504 ns/iter 1.27
E2E_Evaluator_users_array 669540.0125483106 ns/iter 548235.2092114097 ns/iter 1.22
E2E_Evaluator_vercel 279492.87248584436 ns/iter 214507.9800797027 ns/iter 1.30
E2E_Evaluator_yamllint 9809.639657398982 ns/iter 7118.1622739134045 ns/iter 1.38
Schema_Format_ISO_Language_To_JSON 116377099.99994665 ns/iter 92124922.00001065 ns/iter 1.26
Schema_Bundle_Meta_2020_12 1985885.440342889 ns/iter 1553578.8403477976 ns/iter 1.28
Schema_Frame_WoT_References 6042446.7304350715 ns/iter 4811373.9520549765 ns/iter 1.26
Schema_Frame_OMC_References 25810399.33332889 ns/iter 19582928.542857707 ns/iter 1.32
Schema_Frame_OMC_Locations 23196128.7333282 ns/iter 18096509.256408285 ns/iter 1.28
Schema_Frame_ISO_Language_Locations 107207468.99998327 ns/iter 83592002.33333771 ns/iter 1.28
Schema_Frame_KrakenD_References 45630913.31250746 ns/iter 35616898.399996445 ns/iter 1.28
Schema_Frame_KrakenD_Reachable 591998271.9999553 ns/iter 466559757.50013566 ns/iter 1.27
Schema_Frame_ISO_Language_Locations_To_JSON 191083451.7499893 ns/iter 160403825.7499951 ns/iter 1.19
Schema_Frame_Many_Resources_References 397581274.00000376 ns/iter 315576625.9999382 ns/iter 1.26
Schema_Iterator_ISO_Language 3781593.994593808 ns/iter 2798564.3147407738 ns/iter 1.35
Schema_Tracker_ISO_Language 5625390.568000512 ns/iter 4278092.2024526065 ns/iter 1.31
Schema_Tracker_ISO_Language_To_JSON 29197250.499995183 ns/iter 22029674.83871391 ns/iter 1.33

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: 6937b52 Previous: a774160 Ratio
E2E_Evaluator_adaptivecard 122440 ns 93699 ns 1.31
E2E_Evaluator_ansible-meta 555760 ns 424712 ns 1.31
E2E_Evaluator_aws-cdk 137167 ns 100270 ns 1.37
E2E_Evaluator_babelrc 305756 ns 256086 ns 1.19
E2E_Evaluator_cerebrum-criminal-case 2746518 ns 2092442 ns 1.31
E2E_Evaluator_clang-format 265992 ns 236986 ns 1.12
E2E_Evaluator_cmake-presets 19069921 ns 14214576 ns 1.34
E2E_Evaluator_code-climate 506255 ns 384782 ns 1.32
E2E_Evaluator_cql2 1250211 ns 965294 ns 1.30
E2E_Evaluator_cspell 1672587 ns 1334035 ns 1.25
E2E_Evaluator_cypress 911345 ns 714900 ns 1.27
E2E_Evaluator_deno 1140645 ns 889875 ns 1.28
E2E_Evaluator_dependabot 1158277 ns 948443 ns 1.22
E2E_Evaluator_draft-04 29878481 ns 19705991 ns 1.52
E2E_Evaluator_fabric-mod 2667595 ns 1982818 ns 1.35
E2E_Evaluator_geojson 20162650 ns 17162349 ns 1.17
E2E_Evaluator_gitpod-configuration 750636 ns 580930 ns 1.29
E2E_Evaluator_helm-chart-lock 1004494 ns 788075 ns 1.27
E2E_Evaluator_importmap 271122 ns 208092 ns 1.30
E2E_Evaluator_jasmine 279501 ns 231194 ns 1.21
E2E_Evaluator_jsconfig 1421865 ns 1241010 ns 1.15
E2E_Evaluator_jshintrc 2932295 ns 2316163 ns 1.27
E2E_Evaluator_krakend 640718 ns 502605 ns 1.27
E2E_Evaluator_lazygit 464069 ns 373414 ns 1.24
E2E_Evaluator_lerna 464497 ns 353890 ns 1.31
E2E_Evaluator_nest-cli 611204 ns 486841 ns 1.26
E2E_Evaluator_omc 91803 ns 70815 ns 1.30
E2E_Evaluator_omnisharp 1472579 ns 1190666 ns 1.24
E2E_Evaluator_openapi 26207385 ns 17962984 ns 1.46
E2E_Evaluator_pre-commit-hooks 2138481 ns 1607988 ns 1.33
E2E_Evaluator_pulumi 2027448 ns 1561512 ns 1.30
E2E_Evaluator_semantic-release 229919 ns 178874 ns 1.29
E2E_Evaluator_stale 379581 ns 301185 ns 1.26
E2E_Evaluator_stylecop 1287106 ns 983698 ns 1.31
E2E_Evaluator_tmuxinator 214347 ns 169256 ns 1.27
E2E_Evaluator_ui5 2321920 ns 1705560 ns 1.36
E2E_Evaluator_ui5-manifest 10797751 ns 7693324 ns 1.40
E2E_Evaluator_unreal-engine-uproject 1608117 ns 1279636 ns 1.26
E2E_Evaluator_users-array 2624845 ns 1912684 ns 1.37
E2E_Evaluator_vercel 1029619 ns 838964 ns 1.23
E2E_Evaluator_yamllint 24191 ns 18889 ns 1.28

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant