Skip to content

Upgrade the JSON Schema Test Suite to 584e550cf443b9f9b9f9a3f05fc0b2dbae178dfa#828

Merged
jviotti merged 1 commit into
mainfrom
test-suite-bump
May 24, 2026
Merged

Upgrade the JSON Schema Test Suite to 584e550cf443b9f9b9f9a3f05fc0b2dbae178dfa#828
jviotti merged 1 commit into
mainfrom
test-suite-bump

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented May 24, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

…dbae178dfa`

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 20 files

Re-trigger cubic

@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 24, 2026

🤖 Augment PR Summary

Summary: This PR bumps the vendored JSON Schema Test Suite to upstream commit 584e550c….

Changes:

  • Updates the pinned jsonschema-test-suite SHA in DEPENDENCIES
  • Adds new non-object “ignored” cases for minProperties across multiple drafts (now including null and booleans)
  • Adds new non-object “ignored” cases for propertyNames across multiple drafts (now including null and booleans)
  • Refreshes format/date optional test vectors with many additional RFC3339 edge cases (leap-year boundaries, whitespace, year-width, trailing characters, etc.)
  • Reorders/relocates one format/hostname test case without changing its expected validity

Technical Notes: This is primarily a vendored test-data update; any CI changes would surface only where these suites are executed/enabled in Blaze’s official-suite harness.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 549d822 Previous: bc1f434 Ratio
Schema_Iterator_ISO_Language 2093676.188741971 ns/iter 1999250.6875004328 ns/iter 1.05
Schema_Tracker_ISO_Language 4377029.652941393 ns/iter 4774555.6447356 ns/iter 0.92
Schema_Tracker_ISO_Language_To_JSON 12745128.036360918 ns/iter 12216723.964286301 ns/iter 1.04
Schema_Frame_WoT_References 4484742.038217102 ns/iter 4293125.506098766 ns/iter 1.04
Schema_Frame_OMC_References 21598737.00000503 ns/iter 23132627.766661547 ns/iter 0.93
Schema_Frame_OMC_Locations 20307817.857142907 ns/iter 26243687.500003226 ns/iter 0.77
Schema_Frame_ISO_Language_Locations 67725870.7999954 ns/iter 65634958.375 ns/iter 1.03
Schema_Frame_KrakenD_References 42869365.2352997 ns/iter 39664789.176466756 ns/iter 1.08
Schema_Frame_KrakenD_Reachable 326891062.49995345 ns/iter 312639208.0000642 ns/iter 1.05
Schema_Frame_ISO_Language_Locations_To_JSON 65659454.545435764 ns/iter 68654458.33333677 ns/iter 0.96
Schema_Frame_Many_Resources_References 250945138.6666418 ns/iter 265849013.66671452 ns/iter 0.94
Schema_Bundle_Meta_2020_12 1221352.4964278934 ns/iter 1182507.1101431216 ns/iter 1.03
Schema_Format_ISO_Language_To_JSON 73331985.88892427 ns/iter 66963441.5000246 ns/iter 1.10
E2E_Compiler_adaptivecard 54291721.15383642 ns/iter 49812785.71429877 ns/iter 1.09
E2E_Compiler_ansible_meta 22863081.933337525 ns/iter 23910964.068959557 ns/iter 0.96
E2E_Compiler_aws_cdk 258157.11262428685 ns/iter 278115.04985545797 ns/iter 0.93
E2E_Compiler_babelrc 1981262.022856234 ns/iter 1947832.704819252 ns/iter 1.02
E2E_Compiler_clang_format 13968583.340001713 ns/iter 15527187.078430193 ns/iter 0.90
E2E_Compiler_cmake_presets 23617929.166660663 ns/iter 22084996.093752805 ns/iter 1.07
E2E_Compiler_code_climate 2104974.6309148334 ns/iter 1964928.338935499 ns/iter 1.07
E2E_Compiler_cql2 10860835.863640564 ns/iter 10389304.544118846 ns/iter 1.05
E2E_Compiler_cspell 18320433.10526531 ns/iter 17391302.07499784 ns/iter 1.05
E2E_Compiler_cypress 3315825.635071077 ns/iter 3317034.3238095613 ns/iter 1.00
E2E_Compiler_deno 6349082.605263327 ns/iter 5938757.771185904 ns/iter 1.07
E2E_Compiler_dependabot 3385024.6394225587 ns/iter 3245400.847222131 ns/iter 1.04
E2E_Compiler_draft_04 1845384.2592587909 ns/iter 1785550.9493673004 ns/iter 1.03
E2E_Compiler_fabric_mod 3413589.460784155 ns/iter 3276791.079439756 ns/iter 1.04
E2E_Compiler_geojson 20106779.411756128 ns/iter 19333204.861109406 ns/iter 1.04
E2E_Compiler_gitpod_configuration 3790961.473116543 ns/iter 3956120.615789348 ns/iter 0.96
E2E_Compiler_helm_chart_lock 509660.7472677275 ns/iter 478980.50878474896 ns/iter 1.06
E2E_Compiler_importmap 192097.87108223408 ns/iter 183326.41646869943 ns/iter 1.05
E2E_Compiler_jasmine 990499.7654497023 ns/iter 948664.9838493811 ns/iter 1.04
E2E_Compiler_jshintrc 2972241.88135661 ns/iter 2847816.22764239 ns/iter 1.04
E2E_Compiler_jsconfig 17251648.94999125 ns/iter 17444820.42857141 ns/iter 0.99
E2E_Compiler_krakend 118860145.83334751 ns/iter 110733104.16664602 ns/iter 1.07
E2E_Compiler_lazygit 29167559.04165787 ns/iter 27662993.359999746 ns/iter 1.05
E2E_Compiler_lerna 1271573.2663144392 ns/iter 1196042.0899829438 ns/iter 1.06
E2E_Compiler_nest_cli 5724101.434426585 ns/iter 5499761.811023294 ns/iter 1.04
E2E_Compiler_omc 144477700.0000613 ns/iter 139833924.99999353 ns/iter 1.03
E2E_Compiler_omnisharp 5452880.162789905 ns/iter 5261649.621212944 ns/iter 1.04
E2E_Compiler_openapi 20176052.39999674 ns/iter 19557412.027779717 ns/iter 1.03
E2E_Compiler_pre_commit_hooks 4320401.855554539 ns/iter 4129310.418750265 ns/iter 1.05
E2E_Compiler_pulumi 3001528.846153501 ns/iter 2911772.10964845 ns/iter 1.03
E2E_Compiler_semantic_release 1165951.650170921 ns/iter 1091740.2343750382 ns/iter 1.07
E2E_Compiler_stale 1147692.1334431989 ns/iter 1092028.8270441697 ns/iter 1.05
E2E_Compiler_stylecop 5209657.540145088 ns/iter 5066069.160000097 ns/iter 1.03
E2E_Compiler_tmuxinator 1412383.6767892917 ns/iter 1362167.5204919789 ns/iter 1.04
E2E_Compiler_ui5 45845036.133323446 ns/iter 45214515.62500545 ns/iter 1.01
E2E_Compiler_ui5_manifest 267670944.33337963 ns/iter 258067319.6666036 ns/iter 1.04
E2E_Compiler_unreal_engine_uproject 3458524.2216756702 ns/iter 3295478.080568388 ns/iter 1.05
E2E_Compiler_users_array 712294.6127048717 ns/iter 682421.8750001165 ns/iter 1.04
E2E_Compiler_vercel 11012950.396824246 ns/iter 10741941.924241915 ns/iter 1.03
E2E_Compiler_yamllint 242242.39801329555 ns/iter 228525.41576607616 ns/iter 1.06
E2E_Evaluator_adaptivecard 17499.211316657682 ns/iter 17412.28822646011 ns/iter 1.00
E2E_Evaluator_ansible_meta 151579.19151674144 ns/iter 148953.98351644882 ns/iter 1.02
E2E_Evaluator_aws_cdk 31850.968274236857 ns/iter 30857.15137736585 ns/iter 1.03
E2E_Evaluator_babelrc 75637.45382217564 ns/iter 73673.2904800518 ns/iter 1.03
E2E_Evaluator_cerebrum_criminal_case 587181.1609388586 ns/iter 565200.874193432 ns/iter 1.04
E2E_Evaluator_clang_format 89583.92708604122 ns/iter 87125.28821932804 ns/iter 1.03
E2E_Evaluator_cmake_presets 2942410.5147674847 ns/iter 2817502.074688027 ns/iter 1.04
E2E_Evaluator_code_climate 116589.6054557505 ns/iter 112318.70857417672 ns/iter 1.04
E2E_Evaluator_cql2 135347.68360053803 ns/iter 130427.62055480931 ns/iter 1.04
E2E_Evaluator_cspell 375436.90862144553 ns/iter 344411.657507297 ns/iter 1.09
E2E_Evaluator_cypress 137088.48445360927 ns/iter 125441.98429780158 ns/iter 1.09
E2E_Evaluator_deno 200792.07181688343 ns/iter 198595.778725987 ns/iter 1.01
E2E_Evaluator_dependabot 214136.81362666033 ns/iter 206283.55630699027 ns/iter 1.04
E2E_Evaluator_draft_04 4846397.499998906 ns/iter 4678509.6153846495 ns/iter 1.04
E2E_Evaluator_fabric_mod 436935.58234174445 ns/iter 421752.97982887685 ns/iter 1.04
E2E_Evaluator_geojson 9000998.397432808 ns/iter 8732746.87500043 ns/iter 1.03
E2E_Evaluator_gitpod_configuration 152305.5737847735 ns/iter 145212.3937383028 ns/iter 1.05
E2E_Evaluator_helm_chart_lock 184948.74543012952 ns/iter 185076.74009292715 ns/iter 1.00
E2E_Evaluator_importmap 29114.03306150299 ns/iter 27459.719979643265 ns/iter 1.06
E2E_Evaluator_jasmine 92089.13992097993 ns/iter 72886.98381406303 ns/iter 1.26
E2E_Evaluator_jshintrc 895003.5062066333 ns/iter 877421.1859354432 ns/iter 1.02
E2E_Evaluator_jsconfig 284737.93163434445 ns/iter 272528.9677682233 ns/iter 1.04
E2E_Evaluator_krakend 119226.99402195541 ns/iter 112322.1001763087 ns/iter 1.06
E2E_Evaluator_lazygit 95921.50607346535 ns/iter 92159.66400756192 ns/iter 1.04
E2E_Evaluator_lerna 102807.99246786836 ns/iter 100510.21356857866 ns/iter 1.02
E2E_Evaluator_nest_cli 114163.93142671208 ns/iter 110365.32739315457 ns/iter 1.03
E2E_Evaluator_omc 12428.38373028045 ns/iter 14095.510852604015 ns/iter 0.88
E2E_Evaluator_omnisharp 402313.6915078802 ns/iter 387685.71579522913 ns/iter 1.04
E2E_Evaluator_openapi 5132321.296295467 ns/iter 4884647.098484065 ns/iter 1.05
E2E_Evaluator_pre_commit_hooks 331933.0128081966 ns/iter 310780.71693125396 ns/iter 1.07
E2E_Evaluator_pulumi 489611.02682779444 ns/iter 502361.0310694023 ns/iter 0.97
E2E_Evaluator_semantic_release 65518.73755570377 ns/iter 61714.87137553098 ns/iter 1.06
E2E_Evaluator_stale 104935.28659664922 ns/iter 99841.39090131171 ns/iter 1.05
E2E_Evaluator_stylecop 175467.05649287745 ns/iter 180602.41646549627 ns/iter 0.97
E2E_Evaluator_tmuxinator 65356.859678473484 ns/iter 65530.548153794974 ns/iter 1.00
E2E_Evaluator_ui5 312010.3519999652 ns/iter 350948.4943668052 ns/iter 0.89
E2E_Evaluator_ui5_manifest 1419025.0506071385 ns/iter 1370211.142581843 ns/iter 1.04
E2E_Evaluator_unreal_engine_uproject 292242.56958324683 ns/iter 282288.39644011535 ns/iter 1.04
E2E_Evaluator_users_array 404650.1103754338 ns/iter 370528.7180170928 ns/iter 1.09
E2E_Evaluator_vercel 204252.89589440147 ns/iter 198176.68371695702 ns/iter 1.03
E2E_Evaluator_yamllint 5599.249258282298 ns/iter 5768.829448303855 ns/iter 0.97
Micro_Draft4_Meta_1_No_Callback 126.94906613516574 ns/iter 119.29329001517826 ns/iter 1.06
Micro_Draft4_Required_Properties 589.9505525500387 ns/iter 569.2860415599569 ns/iter 1.04
Micro_Draft4_Many_Optional_Properties_Minimal_Match 14.993099650363844 ns/iter 14.911597765289846 ns/iter 1.01
Micro_Draft4_Few_Optional_Properties_Minimal_Match 6.703029151712224 ns/iter 6.4697750026095004 ns/iter 1.04
Micro_Draft4_Items_Schema 242.20531182520946 ns/iter 235.14597183741463 ns/iter 1.03
Micro_Draft4_Nested_Object 0.6617064659966445 ns/iter 0.6274438657482456 ns/iter 1.05
Micro_Draft4_Properties_Triad_Optional 192.55532018350638 ns/iter 183.1736809127556 ns/iter 1.05
Micro_Draft4_Properties_Triad_Closed 155.9789272155319 ns/iter 152.5959127416281 ns/iter 1.02
Micro_Draft4_Properties_Triad_Required 199.45975092987308 ns/iter 194.54481825727473 ns/iter 1.03
Micro_Draft4_Properties_Closed 37.78980781027185 ns/iter 34.03746676501883 ns/iter 1.11
Micro_Draft4_Non_Recursive_Ref 9.665549593710494 ns/iter 9.084575723389527 ns/iter 1.06
Micro_Draft4_Pattern_Properties_True 143.23184114646645 ns/iter 143.0106662010443 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 6.865263333006769 ns/iter 6.644141850051837 ns/iter 1.03
Micro_Draft4_Additional_Properties_Type 19.293127403227682 ns/iter 18.4999038305275 ns/iter 1.04
Micro_Draft4_Nested_Oneof 38.30620364085101 ns/iter 37.50656825224822 ns/iter 1.02
Micro_Draft4_Short_Enum 4.623773025025389 ns/iter 4.470232219640688 ns/iter 1.03
Micro_Draft4_Long_Enum 9.741847646570227 ns/iter 9.418817219236239 ns/iter 1.03
Micro_Draft4_Long_Enum_Short_Strings 5.963243017901864 ns/iter 5.656630792202418 ns/iter 1.05
Micro_Draft4_Type_Object 2.0715204802749407 ns/iter 1.9985150491884642 ns/iter 1.04
Micro_Draft4_Ref_Single_100 1594011.099322442 ns/iter 1533110.2894740005 ns/iter 1.04
Micro_Draft4_Compile_Ref_Many_Nested 1170120.8207230857 ns/iter 1143550.54151617 ns/iter 1.02
Micro_Draft4_Compile_Wrap 1989966.6411044335 ns/iter 1818190.6649220309 ns/iter 1.09
Micro_Draft6_Property_Names 91.75082425441059 ns/iter 86.91797723904534 ns/iter 1.06
Micro_Draft6_Compile_FHIR 7479775667.000012 ns/iter 6944457875.000126 ns/iter 1.08
Micro_Draft7_If_Then_Else 16.52508176712496 ns/iter 15.68075331644998 ns/iter 1.05
Micro_2019_09_Unevaluated_Properties 26.08582040722874 ns/iter 24.349710355438102 ns/iter 1.07
Micro_2019_09_Compile_Wrap 282324958.49988484 ns/iter 269975666.66667205 ns/iter 1.05
Micro_2020_12_Dynamic_Ref 178.8329989222692 ns/iter 171.17190484637328 ns/iter 1.04
Micro_2020_12_Dynamic_Ref_Single 2.0705209053838103 ns/iter 2.076800620132753 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 743.3141161864991 ns/iter 743.5124039950326 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 82295.09088798345 ns/iter 80147.69685478458 ns/iter 1.03
Micro_2020_12_Compile_NonCircular_Shared_Refs 777347.6435538223 ns/iter 727773.3023257332 ns/iter 1.07
Micro_2020_12_Exhaustive_Deep_Numeric 5000.573398591889 ns/iter 4791.726315862242 ns/iter 1.04
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 108202.2630437889 ns/iter 104887.3488406742 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 13466.93887545119 ns/iter 13097.242236139007 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 86.6841974222907 ns/iter 82.96092970364752 ns/iter 1.04
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4546.5760380174725 ns/iter 4423.630687419133 ns/iter 1.03
Alterschema_Check_Readibility_ISO_Language_Set_3 239981847.33333495 ns/iter 210156639.0000092 ns/iter 1.14
Alterschema_Check_Readibility_OMC 56747530.27270444 ns/iter 51031473.21429853 ns/iter 1.11
Alterschema_Check_Readibility_KrakenD 593057667.0002666 ns/iter 539623500.0000615 ns/iter 1.10
Alterschema_Apply_Readibility_KrakenD 62151384581.999535 ns/iter 57671246290.99999 ns/iter 1.08
Alterschema_Check_Invalid_External_Refs 199872343.75003028 ns/iter 160799687.50000262 ns/iter 1.24

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: 549d822 Previous: bc1f434 Ratio
E2E_Evaluator_adaptivecard 97867 ns 94870 ns 1.03
E2E_Evaluator_ansible-meta 365824 ns 348861 ns 1.05
E2E_Evaluator_aws-cdk 118080 ns 111129 ns 1.06
E2E_Evaluator_babelrc 256394 ns 240067 ns 1.07
E2E_Evaluator_cerebrum-criminal-case 1698023 ns 1565448 ns 1.08
E2E_Evaluator_clang-format 175971 ns 172813 ns 1.02
E2E_Evaluator_cmake-presets 11699702 ns 11449353 ns 1.02
E2E_Evaluator_code-climate 397743 ns 350854 ns 1.13
E2E_Evaluator_cql2 1088695 ns 930038 ns 1.17
E2E_Evaluator_cspell 1238000 ns 926604 ns 1.34
E2E_Evaluator_cypress 602561 ns 505161 ns 1.19
E2E_Evaluator_deno 700646 ns 713334 ns 0.98
E2E_Evaluator_dependabot 756021 ns 708288 ns 1.07
E2E_Evaluator_draft-04 15881089 ns 16995073 ns 0.93
E2E_Evaluator_fabric-mod 1523968 ns 1331617 ns 1.14
E2E_Evaluator_geojson 14708294 ns 13620104 ns 1.08
E2E_Evaluator_gitpod-configuration 490652 ns 456119 ns 1.08
E2E_Evaluator_helm-chart-lock 854277 ns 784494 ns 1.09
E2E_Evaluator_importmap 211235 ns 218858 ns 0.97
E2E_Evaluator_jasmine 227184 ns 198236 ns 1.15
E2E_Evaluator_jsconfig 829188 ns 784201 ns 1.06
E2E_Evaluator_jshintrc 2070863 ns 1870784 ns 1.11
E2E_Evaluator_krakend 432155 ns 408619 ns 1.06
E2E_Evaluator_lazygit 272740 ns 256629 ns 1.06
E2E_Evaluator_lerna 324922 ns 294572 ns 1.10
E2E_Evaluator_nest-cli 419515 ns 413483 ns 1.01
E2E_Evaluator_omc 71562 ns 64877 ns 1.10
E2E_Evaluator_omnisharp 978182 ns 904572 ns 1.08
E2E_Evaluator_openapi 17301931 ns 14252249 ns 1.21
E2E_Evaluator_pre-commit-hooks 1321458 ns 1259521 ns 1.05
E2E_Evaluator_pulumi 1380464 ns 1259231 ns 1.10
E2E_Evaluator_semantic-release 179723 ns 165914 ns 1.08
E2E_Evaluator_stale 294630 ns 266220 ns 1.11
E2E_Evaluator_stylecop 767609 ns 676546 ns 1.13
E2E_Evaluator_tmuxinator 158594 ns 148522 ns 1.07
E2E_Evaluator_ui5 1653827 ns 1449398 ns 1.14
E2E_Evaluator_ui5-manifest 7475735 ns 7306532 ns 1.02
E2E_Evaluator_unreal-engine-uproject 1174486 ns 1059068 ns 1.11
E2E_Evaluator_users-array 1844527 ns 1684258 ns 1.10
E2E_Evaluator_vercel 807393 ns 687340 ns 1.17
E2E_Evaluator_yamllint 24076 ns 22494 ns 1.07

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 549d822 Previous: bc1f434 Ratio
Schema_Iterator_ISO_Language 3105696.67713005 ns/iter 3032058.489177426 ns/iter 1.02
Schema_Tracker_ISO_Language 7902739.287233766 ns/iter 7499070.589473807 ns/iter 1.05
Schema_Tracker_ISO_Language_To_JSON 18712299.89189266 ns/iter 19034844.13157972 ns/iter 0.98
Schema_Frame_WoT_References 5155914.338234545 ns/iter 5329821.2187495865 ns/iter 0.97
Schema_Frame_OMC_References 21390423.937496904 ns/iter 22548464.10000179 ns/iter 0.95
Schema_Frame_OMC_Locations 19662007.000003237 ns/iter 20857545.411766242 ns/iter 0.94
Schema_Frame_ISO_Language_Locations 101956034.16665715 ns/iter 103281284.16667444 ns/iter 0.99
Schema_Frame_KrakenD_References 39685137.49999955 ns/iter 43131364.23529747 ns/iter 0.92
Schema_Frame_KrakenD_Reachable 552097799.9999559 ns/iter 590364286.999943 ns/iter 0.94
Schema_Frame_ISO_Language_Locations_To_JSON 109900734.19998226 ns/iter 114812702.60001111 ns/iter 0.96
Schema_Frame_Many_Resources_References 366407169.5000075 ns/iter 370262169.9999895 ns/iter 0.99
Schema_Bundle_Meta_2020_12 1684404.8437538217 ns/iter 1676045.772723463 ns/iter 1.00
Schema_Format_ISO_Language_To_JSON 108912715.42852466 ns/iter 111639096.33330603 ns/iter 0.98
E2E_Compiler_adaptivecard 61725526.36363351 ns/iter 63502033.272729106 ns/iter 0.97
E2E_Compiler_ansible_meta 28757498.541665424 ns/iter 29527444.916666925 ns/iter 0.97
E2E_Compiler_aws_cdk 379149.4430652435 ns/iter 365835.4695787886 ns/iter 1.04
E2E_Compiler_babelrc 2582477.4833947024 ns/iter 2582256.8523983466 ns/iter 1.00
E2E_Compiler_clang_format 18391439.973685775 ns/iter 18576042.052631546 ns/iter 0.99
E2E_Compiler_cmake_presets 25884175.703704722 ns/iter 26211895.629629638 ns/iter 0.99
E2E_Compiler_code_climate 2586773.2029523705 ns/iter 2618943.171641414 ns/iter 0.99
E2E_Compiler_cql2 12988727.999998918 ns/iter 13057024.16981011 ns/iter 0.99
E2E_Compiler_cspell 22886444.333335023 ns/iter 23132558.13333323 ns/iter 0.99
E2E_Compiler_cypress 3954411.836158641 ns/iter 3963244.892045349 ns/iter 1.00
E2E_Compiler_deno 7914161.168538781 ns/iter 7846380.300000217 ns/iter 1.01
E2E_Compiler_dependabot 3946290.067797287 ns/iter 3963550.011428976 ns/iter 1.00
E2E_Compiler_draft_04 2698440.7230770555 ns/iter 2680674.573076658 ns/iter 1.01
E2E_Compiler_fabric_mod 4769908.537415474 ns/iter 4773917.877550926 ns/iter 1.00
E2E_Compiler_geojson 22026985.250001017 ns/iter 22571201.741932843 ns/iter 0.98
E2E_Compiler_gitpod_configuration 4910308.556336723 ns/iter 4938139.605634416 ns/iter 0.99
E2E_Compiler_helm_chart_lock 709320.1203235581 ns/iter 678744.0463767779 ns/iter 1.05
E2E_Compiler_importmap 286758.39787141973 ns/iter 273136.22526394663 ns/iter 1.05
E2E_Compiler_jasmine 1366865.1277058139 ns/iter 1340948.0134358408 ns/iter 1.02
E2E_Compiler_jshintrc 4362239.25465733 ns/iter 4321937.666666734 ns/iter 1.01
E2E_Compiler_jsconfig 21992180.87499588 ns/iter 22202559.03124979 ns/iter 0.99
E2E_Compiler_krakend 143217026.0000021 ns/iter 143253852.1999959 ns/iter 1.00
E2E_Compiler_lazygit 33365090.666674882 ns/iter 34346562.50000216 ns/iter 0.97
E2E_Compiler_lerna 1609713.3225806502 ns/iter 1584128.5500001009 ns/iter 1.02
E2E_Compiler_nest_cli 7472640.021275882 ns/iter 7490197.741935356 ns/iter 1.00
E2E_Compiler_omc 158374797.24996227 ns/iter 162659990.99999818 ns/iter 0.97
E2E_Compiler_omnisharp 6900249.932036743 ns/iter 6771491.403845594 ns/iter 1.02
E2E_Compiler_openapi 25236392.461535547 ns/iter 25172912.357143264 ns/iter 1.00
E2E_Compiler_pre_commit_hooks 5292843.16793849 ns/iter 5412587.236641341 ns/iter 0.98
E2E_Compiler_pulumi 4036470.8034676732 ns/iter 4040188.514451295 ns/iter 1.00
E2E_Compiler_semantic_release 1562044.335570101 ns/iter 1550588.6629712535 ns/iter 1.01
E2E_Compiler_stale 1568825.8396436619 ns/iter 1567696.5862831194 ns/iter 1.00
E2E_Compiler_stylecop 6183014.82300978 ns/iter 6212975.4336279975 ns/iter 1.00
E2E_Compiler_tmuxinator 1926243.7774726662 ns/iter 1907249.596730335 ns/iter 1.01
E2E_Compiler_ui5 46713832.26667179 ns/iter 48613770.33333459 ns/iter 0.96
E2E_Compiler_ui5_manifest 313844963.49994606 ns/iter 312246231.5000121 ns/iter 1.01
E2E_Compiler_unreal_engine_uproject 4608917.523178538 ns/iter 4611737.789473798 ns/iter 1.00
E2E_Compiler_users_array 799998.9430523174 ns/iter 764595.4785478655 ns/iter 1.05
E2E_Compiler_vercel 12519931.035715867 ns/iter 12385232.333334291 ns/iter 1.01
E2E_Compiler_yamllint 347883.3557644621 ns/iter 332897.36355010874 ns/iter 1.05
E2E_Evaluator_adaptivecard 24309.897961293227 ns/iter 23624.1384594315 ns/iter 1.03
E2E_Evaluator_ansible_meta 226222.15263332883 ns/iter 201825.55600696465 ns/iter 1.12
E2E_Evaluator_aws_cdk 49179.034424626 ns/iter 41522.0334816098 ns/iter 1.18
E2E_Evaluator_babelrc 108262.81480370364 ns/iter 85353.07552431268 ns/iter 1.27
E2E_Evaluator_cerebrum_criminal_case 942649.7267833562 ns/iter 990788.3396501717 ns/iter 0.95
E2E_Evaluator_clang_format 120462.73823011084 ns/iter 115389.60882449643 ns/iter 1.04
E2E_Evaluator_cmake_presets 4160624.798815613 ns/iter 4087043.210526315 ns/iter 1.02
E2E_Evaluator_code_climate 172731.09527329748 ns/iter 149305.469009584 ns/iter 1.16
E2E_Evaluator_cql2 213409.74430064642 ns/iter 180427.99379361814 ns/iter 1.18
E2E_Evaluator_cspell 562011.1466136534 ns/iter 543910.9249225665 ns/iter 1.03
E2E_Evaluator_cypress 187195.4019164421 ns/iter 164198.8901461593 ns/iter 1.14
E2E_Evaluator_deno 306938.17313703214 ns/iter 242177.68123481292 ns/iter 1.27
E2E_Evaluator_dependabot 310491.40976458474 ns/iter 292847.2132067291 ns/iter 1.06
E2E_Evaluator_draft_04 7433186.301074774 ns/iter 9095502.703703292 ns/iter 0.82
E2E_Evaluator_fabric_mod 691800.1064677448 ns/iter 633306.7209301547 ns/iter 1.09
E2E_Evaluator_geojson 14234448.74509704 ns/iter 15481222.326086381 ns/iter 0.92
E2E_Evaluator_gitpod_configuration 225569.5349583143 ns/iter 194446.13982694186 ns/iter 1.16
E2E_Evaluator_helm_chart_lock 337677.401456377 ns/iter 234797.7710333938 ns/iter 1.44
E2E_Evaluator_importmap 45962.85287341173 ns/iter 40547.232594569876 ns/iter 1.13
E2E_Evaluator_jasmine 102217.05093599137 ns/iter 93118.48256660088 ns/iter 1.10
E2E_Evaluator_jshintrc 1199260.0308218081 ns/iter 1152896.6606557914 ns/iter 1.04
E2E_Evaluator_jsconfig 416403.30059880816 ns/iter 394586.3118218978 ns/iter 1.06
E2E_Evaluator_krakend 209485.0750074214 ns/iter 177268.90544629787 ns/iter 1.18
E2E_Evaluator_lazygit 156041.10803393385 ns/iter 121388.26568965324 ns/iter 1.29
E2E_Evaluator_lerna 140742.83468723894 ns/iter 108423.72448309729 ns/iter 1.30
E2E_Evaluator_nest_cli 176694.215550417 ns/iter 163298.04246382494 ns/iter 1.08
E2E_Evaluator_omc 18016.656913642535 ns/iter 16701.30215687145 ns/iter 1.08
E2E_Evaluator_omnisharp 604079.5202064671 ns/iter 550272.4043409053 ns/iter 1.10
E2E_Evaluator_openapi 8802980.232876632 ns/iter 10783933.848484373 ns/iter 0.82
E2E_Evaluator_pre_commit_hooks 462771.4017555666 ns/iter 460654.15631138504 ns/iter 1.00
E2E_Evaluator_pulumi 684828.2689321706 ns/iter 645873.8042086167 ns/iter 1.06
E2E_Evaluator_semantic_release 98456.16703724429 ns/iter 77694.69339887636 ns/iter 1.27
E2E_Evaluator_stale 145675.20398840948 ns/iter 140523.80937061095 ns/iter 1.04
E2E_Evaluator_stylecop 284318.20186084666 ns/iter 253310.79783003093 ns/iter 1.12
E2E_Evaluator_tmuxinator 94994.16407832823 ns/iter 79746.57296359322 ns/iter 1.19
E2E_Evaluator_ui5 497183.656028428 ns/iter 461085.70576677646 ns/iter 1.08
E2E_Evaluator_ui5_manifest 2448898.124567397 ns/iter 2291810.5755626652 ns/iter 1.07
E2E_Evaluator_unreal_engine_uproject 418958.12767230347 ns/iter 400905.4432988878 ns/iter 1.05
E2E_Evaluator_users_array 523665.71194024396 ns/iter 535311.5305491389 ns/iter 0.98
E2E_Evaluator_vercel 302923.8341991618 ns/iter 239763.58316146128 ns/iter 1.26
E2E_Evaluator_yamllint 8331.090585200014 ns/iter 8111.632314136485 ns/iter 1.03
Micro_Draft4_Meta_1_No_Callback 186.63182754771782 ns/iter 191.32435383249583 ns/iter 0.98
Micro_Draft4_Required_Properties 796.7121354656814 ns/iter 864.6333156459053 ns/iter 0.92
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.49571998226494 ns/iter 23.823085065895725 ns/iter 0.90
Micro_Draft4_Few_Optional_Properties_Minimal_Match 10.905050348529233 ns/iter 10.631833434967918 ns/iter 1.03
Micro_Draft4_Items_Schema 278.7490415265476 ns/iter 243.60626733335948 ns/iter 1.14
Micro_Draft4_Nested_Object 1.7697796563135213 ns/iter 1.4068708783404755 ns/iter 1.26
Micro_Draft4_Properties_Triad_Optional 328.2689036180049 ns/iter 317.43161254058566 ns/iter 1.03
Micro_Draft4_Properties_Triad_Closed 276.50641484614385 ns/iter 263.25124086846563 ns/iter 1.05
Micro_Draft4_Properties_Triad_Required 342.24852187547185 ns/iter 330.1916812327966 ns/iter 1.04
Micro_Draft4_Properties_Closed 56.438268228567665 ns/iter 59.94466298427262 ns/iter 0.94
Micro_Draft4_Non_Recursive_Ref 11.16200823198308 ns/iter 12.149051008001832 ns/iter 0.92
Micro_Draft4_Pattern_Properties_True 159.5036327691638 ns/iter 152.30167907890473 ns/iter 1.05
Micro_Draft4_Ref_To_Single_Property 10.90831580089774 ns/iter 10.995851070673892 ns/iter 0.99
Micro_Draft4_Additional_Properties_Type 21.100909722323994 ns/iter 23.27465005442934 ns/iter 0.91
Micro_Draft4_Nested_Oneof 54.77498019273302 ns/iter 52.26677750216158 ns/iter 1.05
Micro_Draft4_Short_Enum 14.132599028434512 ns/iter 14.13829699097381 ns/iter 1.00
Micro_Draft4_Long_Enum 14.339165718879075 ns/iter 13.374172005619753 ns/iter 1.07
Micro_Draft4_Long_Enum_Short_Strings 14.157185244247337 ns/iter 14.064743274970558 ns/iter 1.01
Micro_Draft4_Type_Object 3.1162731173741047 ns/iter 3.164933774823015 ns/iter 0.98
Micro_Draft4_Ref_Single_100 2380935.2013652213 ns/iter 2335453.5282391245 ns/iter 1.02
Micro_Draft4_Compile_Ref_Many_Nested 1727462.0888892293 ns/iter 1707855.635036394 ns/iter 1.01
Micro_Draft4_Compile_Wrap 2364900.888513707 ns/iter 2377825.3973060516 ns/iter 0.99
Micro_Draft6_Property_Names 126.39316818692141 ns/iter 123.87446571883723 ns/iter 1.02
Micro_Draft6_Compile_FHIR 14273791506.99994 ns/iter 15833622854.000168 ns/iter 0.90
Micro_Draft7_If_Then_Else 23.72673650614669 ns/iter 23.607079351799968 ns/iter 1.01
Micro_2019_09_Unevaluated_Properties 27.118866207430084 ns/iter 25.038280799967666 ns/iter 1.08
Micro_2019_09_Compile_Wrap 295333751.4999248 ns/iter 315998242.4999725 ns/iter 0.93
Micro_2020_12_Dynamic_Ref 226.7530149937675 ns/iter 227.06230995371556 ns/iter 1.00
Micro_2020_12_Dynamic_Ref_Single 3.426459849747872 ns/iter 3.166354058158333 ns/iter 1.08
Micro_2020_12_Simple_Output_Mask 1074.2597886875694 ns/iter 1022.2926044131959 ns/iter 1.05
Micro_2020_12_Simple_Output_Annotations 103189.56709384156 ns/iter 93070.27433154955 ns/iter 1.11
Micro_2020_12_Compile_NonCircular_Shared_Refs 1098945.2213504207 ns/iter 1079032.4189602989 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric 8153.555585074163 ns/iter 8657.08152645218 ns/iter 0.94
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 171573.81526792934 ns/iter 169653.41538459292 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 22223.925273469795 ns/iter 22647.06460448475 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 140.78644662465942 ns/iter 151.33655528614918 ns/iter 0.93
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4274.402964984637 ns/iter 4135.001877731531 ns/iter 1.03
Alterschema_Check_Readibility_ISO_Language_Set_3 359434880.5000891 ns/iter 361273115.500012 ns/iter 0.99
Alterschema_Check_Readibility_OMC 85567274.37499489 ns/iter 92177904.75000243 ns/iter 0.93
Alterschema_Check_Readibility_KrakenD 1204171098.9999502 ns/iter 1299248896.0001082 ns/iter 0.93
Alterschema_Apply_Readibility_KrakenD 119619270148.99992 ns/iter 130368825425.00006 ns/iter 0.92
Alterschema_Check_Invalid_External_Refs 306296549.50007534 ns/iter 281456359.66666305 ns/iter 1.09

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: 549d822 Previous: bc1f434 Ratio
E2E_Evaluator_adaptivecard 118268 ns 118402 ns 1.00
E2E_Evaluator_ansible-meta 518650 ns 549904 ns 0.94
E2E_Evaluator_aws-cdk 140226 ns 133827 ns 1.05
E2E_Evaluator_babelrc 335056 ns 328205 ns 1.02
E2E_Evaluator_cerebrum-criminal-case 2583318 ns 2930916 ns 0.88
E2E_Evaluator_clang-format 258667 ns 288324 ns 0.90
E2E_Evaluator_cmake-presets 17038887 ns 20453361 ns 0.83
E2E_Evaluator_code-climate 497669 ns 501348 ns 0.99
E2E_Evaluator_cql2 1217876 ns 1239354 ns 0.98
E2E_Evaluator_cspell 1464242 ns 1720528 ns 0.85
E2E_Evaluator_cypress 770304 ns 908704 ns 0.85
E2E_Evaluator_deno 1064037 ns 1142386 ns 0.93
E2E_Evaluator_dependabot 1242100 ns 1251836 ns 0.99
E2E_Evaluator_draft-04 22403379 ns 29887001 ns 0.75
E2E_Evaluator_fabric-mod 2337527 ns 2642238 ns 0.88
E2E_Evaluator_geojson 20779366 ns 20905872 ns 0.99
E2E_Evaluator_gitpod-configuration 706693 ns 753716 ns 0.94
E2E_Evaluator_helm-chart-lock 1041478 ns 1057103 ns 0.99
E2E_Evaluator_importmap 266052 ns 270699 ns 0.98
E2E_Evaluator_jasmine 301733 ns 288093 ns 1.05
E2E_Evaluator_jsconfig 1240433 ns 1516970 ns 0.82
E2E_Evaluator_jshintrc 2750627 ns 3035819 ns 0.91
E2E_Evaluator_krakend 685576 ns 625716 ns 1.10
E2E_Evaluator_lazygit 496685 ns 467911 ns 1.06
E2E_Evaluator_lerna 455764 ns 470028 ns 0.97
E2E_Evaluator_nest-cli 589012 ns 620299 ns 0.95
E2E_Evaluator_omc 91605 ns 93918 ns 0.98
E2E_Evaluator_omnisharp 1409313 ns 1514439 ns 0.93
E2E_Evaluator_openapi 25060627 ns 27248010 ns 0.92
E2E_Evaluator_pre-commit-hooks 1989165 ns 2180647 ns 0.91
E2E_Evaluator_pulumi 1886500 ns 2047948 ns 0.92
E2E_Evaluator_semantic-release 255941 ns 238236 ns 1.07
E2E_Evaluator_stale 399590 ns 394174 ns 1.01
E2E_Evaluator_stylecop 1215541 ns 1267990 ns 0.96
E2E_Evaluator_tmuxinator 231377 ns 224684 ns 1.03
E2E_Evaluator_ui5 2410573 ns 2256765 ns 1.07
E2E_Evaluator_ui5-manifest 11798960 ns 11203953 ns 1.05
E2E_Evaluator_unreal-engine-uproject 1527206 ns 1766661 ns 0.86
E2E_Evaluator_users-array 2454072 ns 2443718 ns 1.00
E2E_Evaluator_vercel 1007448 ns 1047693 ns 0.96
E2E_Evaluator_yamllint 25941 ns 24346 ns 1.07

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 549d822 Previous: bc1f434 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 364589953.00006336 ns/iter 379813332.5000208 ns/iter 0.96
Alterschema_Check_Readibility_OMC 98441663.7142788 ns/iter 102364058.85711975 ns/iter 0.96
Alterschema_Check_Readibility_KrakenD 1391311350.0000236 ns/iter 1416203256.0000172 ns/iter 0.98
Alterschema_Apply_Readibility_KrakenD 134755277137.00012 ns/iter 144594984631.0002 ns/iter 0.93
Alterschema_Check_Invalid_External_Refs 309481260.49997884 ns/iter 301756011.00006586 ns/iter 1.03
Micro_2020_12_Dynamic_Ref 264.9998051012959 ns/iter 272.3946592256116 ns/iter 0.97
Micro_2020_12_Dynamic_Ref_Single 4.226132918271373 ns/iter 4.221656824869148 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1128.7057033390522 ns/iter 1117.7909236558137 ns/iter 1.01
Micro_2020_12_Simple_Output_Annotations 102840.5471944231 ns/iter 104142.42128668679 ns/iter 0.99
Micro_2020_12_Compile_NonCircular_Shared_Refs 1265296.9343062367 ns/iter 1273414.3089578564 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric 8799.7420784817 ns/iter 11308.326244411315 ns/iter 0.78
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 169355.63336589304 ns/iter 165372.0696897234 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 27225.04831748446 ns/iter 26384.895337058668 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 154.92639823372457 ns/iter 154.03133124554245 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4568.829998896254 ns/iter 4644.206971931087 ns/iter 0.98
Micro_2019_09_Unevaluated_Properties 28.509849014834053 ns/iter 28.502169616013664 ns/iter 1.00
Micro_2019_09_Compile_Wrap 352773131.50004375 ns/iter 337993342.49999905 ns/iter 1.04
Micro_Draft7_If_Then_Else 24.591214439978092 ns/iter 24.78268075742619 ns/iter 0.99
Micro_Draft6_Property_Names 159.91105894690483 ns/iter 159.73690854082318 ns/iter 1.00
Micro_Draft6_Compile_FHIR 15368454411.00013 ns/iter 14693054561.999815 ns/iter 1.05
Micro_Draft4_Meta_1_No_Callback 186.6171465313375 ns/iter 178.90028759283715 ns/iter 1.04
Micro_Draft4_Required_Properties 823.2947610629128 ns/iter 823.7447932081492 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.173420986308813 ns/iter 21.131712091985293 ns/iter 1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match 13.02519526581833 ns/iter 13.027459819657027 ns/iter 1.00
Micro_Draft4_Items_Schema 295.3062345032156 ns/iter 296.9654766071661 ns/iter 0.99
Micro_Draft4_Nested_Object 2.1109457613567413 ns/iter 2.1124063810768834 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 427.88428824168204 ns/iter 511.03785600002993 ns/iter 0.84
Micro_Draft4_Properties_Triad_Closed 352.3647469520824 ns/iter 412.01553805254827 ns/iter 0.86
Micro_Draft4_Properties_Triad_Required 448.45233602923645 ns/iter 471.70104729399094 ns/iter 0.95
Micro_Draft4_Properties_Closed 62.59248661138893 ns/iter 62.36216520506074 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 8.814194712820761 ns/iter 8.808373776861936 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 190.10861682935302 ns/iter 187.63274252356572 ns/iter 1.01
Micro_Draft4_Ref_To_Single_Property 13.17549890217245 ns/iter 13.188618855928947 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 14.118113654528543 ns/iter 14.115620033044548 ns/iter 1.00
Micro_Draft4_Nested_Oneof 65.72782603400809 ns/iter 63.363853551199014 ns/iter 1.04
Micro_Draft4_Short_Enum 14.496501928553913 ns/iter 14.576926108837853 ns/iter 0.99
Micro_Draft4_Long_Enum 14.42863338089507 ns/iter 14.426280788379934 ns/iter 1.00
Micro_Draft4_Long_Enum_Short_Strings 14.529544156082414 ns/iter 14.485263433916451 ns/iter 1.00
Micro_Draft4_Type_Object 3.9390932143678583 ns/iter 3.873313193333134 ns/iter 1.02
Micro_Draft4_Ref_Single_100 2544110.0549448156 ns/iter 2597742.3420078754 ns/iter 0.98
Micro_Draft4_Compile_Ref_Many_Nested 1877681.6675822774 ns/iter 1928008.9427789361 ns/iter 0.97
Micro_Draft4_Compile_Wrap 2661049.1939160754 ns/iter 2735120.7265624567 ns/iter 0.97
E2E_Compiler_adaptivecard 72166828.00001308 ns/iter 69715611.60000874 ns/iter 1.04
E2E_Compiler_ansible_meta 35580038.23809486 ns/iter 34040807.14285772 ns/iter 1.05
E2E_Compiler_aws_cdk 429692.9004302187 ns/iter 433384.13551992126 ns/iter 0.99
E2E_Compiler_babelrc 2940613.218487586 ns/iter 2977651.395745039 ns/iter 0.99
E2E_Compiler_clang_format 20951049.76470285 ns/iter 21192693.6969686 ns/iter 0.99
E2E_Compiler_cmake_presets 29414585.333332375 ns/iter 29345361.62500005 ns/iter 1.00
E2E_Compiler_code_climate 2994616.3562234896 ns/iter 3047492.4739129837 ns/iter 0.98
E2E_Compiler_cql2 14477777.39583008 ns/iter 14663495.937502565 ns/iter 0.99
E2E_Compiler_cspell 25041605.214287948 ns/iter 25604608.814816214 ns/iter 0.98
E2E_Compiler_cypress 4378039.28571439 ns/iter 4495488.692307449 ns/iter 0.97
E2E_Compiler_deno 9084423.337665245 ns/iter 9179500.649351766 ns/iter 0.99
E2E_Compiler_dependabot 4493229.6410255 ns/iter 4602450.131578077 ns/iter 0.98
E2E_Compiler_draft_04 3187857.3392855204 ns/iter 3140082.9196428503 ns/iter 1.02
E2E_Compiler_fabric_mod 5457565.218749849 ns/iter 5475893.843749802 ns/iter 1.00
E2E_Compiler_geojson 25774312.96296911 ns/iter 25876750.88889059 ns/iter 1.00
E2E_Compiler_gitpod_configuration 5612479.8879991425 ns/iter 5767721.121950361 ns/iter 0.97
E2E_Compiler_helm_chart_lock 784396.4107742965 ns/iter 798694.7519641789 ns/iter 0.98
E2E_Compiler_importmap 320699.28728278127 ns/iter 320393.0439001662 ns/iter 1.00
E2E_Compiler_jasmine 1562588.7517081352 ns/iter 1571990.0563063626 ns/iter 0.99
E2E_Compiler_jshintrc 4943455.19718254 ns/iter 4979373.468084834 ns/iter 0.99
E2E_Compiler_jsconfig 24272496.310341638 ns/iter 24775425.928567074 ns/iter 0.98
E2E_Compiler_krakend 147470823.99999273 ns/iter 150003155.20001096 ns/iter 0.98
E2E_Compiler_lazygit 37843547.210525826 ns/iter 38740269.333326675 ns/iter 0.98
E2E_Compiler_lerna 1843718.273209925 ns/iter 1879515.4385024165 ns/iter 0.98
E2E_Compiler_nest_cli 8479053.240965087 ns/iter 8612032.641975828 ns/iter 0.98
E2E_Compiler_omc 181776875.49996334 ns/iter 185559720.75000682 ns/iter 0.98
E2E_Compiler_omnisharp 7635354.648350535 ns/iter 7850204.516855453 ns/iter 0.97
E2E_Compiler_openapi 29015857.458337754 ns/iter 29369070.666670423 ns/iter 0.99
E2E_Compiler_pre_commit_hooks 6055457.00869579 ns/iter 6116075.939130299 ns/iter 0.99
E2E_Compiler_pulumi 4609471.1381580345 ns/iter 4698178.453333337 ns/iter 0.98
E2E_Compiler_semantic_release 1812015.028947132 ns/iter 1821868.3645834234 ns/iter 0.99
E2E_Compiler_stale 1769995.857868135 ns/iter 1802386.347938259 ns/iter 0.98
E2E_Compiler_stylecop 7123571.989797377 ns/iter 7249256.144330071 ns/iter 0.98
E2E_Compiler_tmuxinator 2219308.1139242835 ns/iter 2252521.9999997425 ns/iter 0.99
E2E_Compiler_ui5 51630904.07693115 ns/iter 53398536.38462535 ns/iter 0.97
E2E_Compiler_ui5_manifest 332306896.49997205 ns/iter 347148972.5000083 ns/iter 0.96
E2E_Compiler_unreal_engine_uproject 5211983.671642884 ns/iter 5330303.030303419 ns/iter 0.98
E2E_Compiler_users_array 900378.1412067093 ns/iter 936028.4672896211 ns/iter 0.96
E2E_Compiler_vercel 13508800.480770754 ns/iter 13986583.139999311 ns/iter 0.97
E2E_Compiler_yamllint 392385.40100392915 ns/iter 392913.059709724 ns/iter 1.00
E2E_Evaluator_adaptivecard 23342.768745852263 ns/iter 23658.598094855122 ns/iter 0.99
E2E_Evaluator_ansible_meta 239905.89260802916 ns/iter 243004.14206706287 ns/iter 0.99
E2E_Evaluator_aws_cdk 47628.69804568154 ns/iter 47287.11041990078 ns/iter 1.01
E2E_Evaluator_babelrc 85729.0562591258 ns/iter 86070.21590488999 ns/iter 1.00
E2E_Evaluator_cerebrum_criminal_case 1113992.977455773 ns/iter 1114550.866454869 ns/iter 1.00
E2E_Evaluator_clang_format 104946.85342752068 ns/iter 106077.9698204417 ns/iter 0.99
E2E_Evaluator_cmake_presets 4965519.055172238 ns/iter 4701805.267973065 ns/iter 1.06
E2E_Evaluator_code_climate 168627.83608915284 ns/iter 168097.9216015638 ns/iter 1.00
E2E_Evaluator_cql2 206839.45521503082 ns/iter 208207.16152021918 ns/iter 0.99
E2E_Evaluator_cspell 510070.9126353213 ns/iter 534951.6864216113 ns/iter 0.95
E2E_Evaluator_cypress 144116.28052053507 ns/iter 145632.91770317467 ns/iter 0.99
E2E_Evaluator_deno 292210.39940571267 ns/iter 308534.3347386706 ns/iter 0.95
E2E_Evaluator_dependabot 347541.41024363344 ns/iter 351337.6327345587 ns/iter 0.99
E2E_Evaluator_draft_04 7355190.177779352 ns/iter 7580091.17284198 ns/iter 0.97
E2E_Evaluator_fabric_mod 736688.2614728508 ns/iter 750698.9742489086 ns/iter 0.98
E2E_Evaluator_geojson 17022545.093019545 ns/iter 17131557.09524017 ns/iter 0.99
E2E_Evaluator_gitpod_configuration 234666.3568822659 ns/iter 234566.85568067196 ns/iter 1.00
E2E_Evaluator_helm_chart_lock 209709.88892250092 ns/iter 214881.01482391258 ns/iter 0.98
E2E_Evaluator_importmap 41028.54200210696 ns/iter 40621.748674191935 ns/iter 1.01
E2E_Evaluator_jasmine 103620.06227759094 ns/iter 104357.88287489166 ns/iter 0.99
E2E_Evaluator_jshintrc 1054411.435126644 ns/iter 1055856.231354776 ns/iter 1.00
E2E_Evaluator_jsconfig 371823.8119290862 ns/iter 393739.6649944114 ns/iter 0.94
E2E_Evaluator_krakend 188244.361468879 ns/iter 191913.9848233458 ns/iter 0.98
E2E_Evaluator_lazygit 131473.63276729794 ns/iter 132087.72346843893 ns/iter 1.00
E2E_Evaluator_lerna 139545.07207563653 ns/iter 136241.05535055196 ns/iter 1.02
E2E_Evaluator_nest_cli 183767.36389536964 ns/iter 180918.20010353075 ns/iter 1.02
E2E_Evaluator_omc 18465.12784648914 ns/iter 18603.757648675448 ns/iter 0.99
E2E_Evaluator_omnisharp 538081.5252829052 ns/iter 558489.5433615259 ns/iter 0.96
E2E_Evaluator_openapi 12267111.830504876 ns/iter 9867115.966668885 ns/iter 1.24
E2E_Evaluator_pre_commit_hooks 472385.59510878864 ns/iter 471685.9864774106 ns/iter 1.00
E2E_Evaluator_pulumi 780824.318232052 ns/iter 781201.2432433316 ns/iter 1.00
E2E_Evaluator_semantic_release 86173.32106741436 ns/iter 86085.00421575468 ns/iter 1.00
E2E_Evaluator_stale 161627.23163711533 ns/iter 163563.13554568336 ns/iter 0.99
E2E_Evaluator_stylecop 291022.8618121141 ns/iter 311316.4830895558 ns/iter 0.93
E2E_Evaluator_tmuxinator 87214.91728195512 ns/iter 88344.19806945561 ns/iter 0.99
E2E_Evaluator_ui5 518191.22280166333 ns/iter 525647.8904943366 ns/iter 0.99
E2E_Evaluator_ui5_manifest 2671399.7824424757 ns/iter 2697102.0579147707 ns/iter 0.99
E2E_Evaluator_unreal_engine_uproject 442881.6050793622 ns/iter 448373.4181701258 ns/iter 0.99
E2E_Evaluator_users_array 622598.4688322509 ns/iter 624494.5902354044 ns/iter 1.00
E2E_Evaluator_vercel 272358.73624656704 ns/iter 276203.4281756894 ns/iter 0.99
E2E_Evaluator_yamllint 9222.047077301884 ns/iter 9211.763298992322 ns/iter 1.00
Schema_Format_ISO_Language_To_JSON 126200244.16666335 ns/iter 118417834.99998353 ns/iter 1.07
Schema_Bundle_Meta_2020_12 2001006.9565166528 ns/iter 1996952.2199887382 ns/iter 1.00
Schema_Frame_WoT_References 6193845.223214517 ns/iter 6242988.018019222 ns/iter 0.99
Schema_Frame_OMC_References 26700214.18518647 ns/iter 26008662.999999985 ns/iter 1.03
Schema_Frame_OMC_Locations 23744654.58620793 ns/iter 24031804.82758279 ns/iter 0.99
Schema_Frame_ISO_Language_Locations 108503301.00000368 ns/iter 108503134.42857182 ns/iter 1.00
Schema_Frame_KrakenD_References 45230376.31250304 ns/iter 47844803.79998968 ns/iter 0.95
Schema_Frame_KrakenD_Reachable 597559718.9999462 ns/iter 629690881.9999771 ns/iter 0.95
Schema_Frame_ISO_Language_Locations_To_JSON 149454056.80000478 ns/iter 164914812.00000635 ns/iter 0.91
Schema_Frame_Many_Resources_References 408222131.49999696 ns/iter 429245833.49997646 ns/iter 0.95
Schema_Iterator_ISO_Language 3801961.2408374543 ns/iter 3677994.1105255364 ns/iter 1.03
Schema_Tracker_ISO_Language 5168514.133334544 ns/iter 5217281.231883437 ns/iter 0.99
Schema_Tracker_ISO_Language_To_JSON 24833131.14285985 ns/iter 23950159.58621053 ns/iter 1.04

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: 549d822 Previous: bc1f434 Ratio
E2E_Evaluator_adaptivecard 118768 ns 121252 ns 0.98
E2E_Evaluator_ansible-meta 542146 ns 545966 ns 0.99
E2E_Evaluator_aws-cdk 129759 ns 128950 ns 1.01
E2E_Evaluator_babelrc 307520 ns 304991 ns 1.01
E2E_Evaluator_cerebrum-criminal-case 2641898 ns 2638226 ns 1.00
E2E_Evaluator_clang-format 261081 ns 260489 ns 1.00
E2E_Evaluator_cmake-presets 19265330 ns 17765504 ns 1.08
E2E_Evaluator_code-climate 489786 ns 489219 ns 1.00
E2E_Evaluator_cql2 1299708 ns 1267879 ns 1.03
E2E_Evaluator_cspell 1621668 ns 1650395 ns 0.98
E2E_Evaluator_cypress 850183 ns 866747 ns 0.98
E2E_Evaluator_deno 1166710 ns 1101668 ns 1.06
E2E_Evaluator_dependabot 1196471 ns 1208570 ns 0.99
E2E_Evaluator_draft-04 27699389 ns 24933598 ns 1.11
E2E_Evaluator_fabric-mod 2434433 ns 2516180 ns 0.97
E2E_Evaluator_geojson 21100052 ns 21826314 ns 0.97
E2E_Evaluator_gitpod-configuration 727343 ns 737249 ns 0.99
E2E_Evaluator_helm-chart-lock 1012099 ns 1083245 ns 0.93
E2E_Evaluator_importmap 260497 ns 263638 ns 0.99
E2E_Evaluator_jasmine 294648 ns 275912 ns 1.07
E2E_Evaluator_jsconfig 1433777 ns 1457932 ns 0.98
E2E_Evaluator_jshintrc 2914285 ns 2903440 ns 1.00
E2E_Evaluator_krakend 667229 ns 600658 ns 1.11
E2E_Evaluator_lazygit 481741 ns 441216 ns 1.09
E2E_Evaluator_lerna 432765 ns 457049 ns 0.95
E2E_Evaluator_nest-cli 622506 ns 579955 ns 1.07
E2E_Evaluator_omc 93138 ns 90643 ns 1.03
E2E_Evaluator_omnisharp 1495101 ns 1505549 ns 0.99
E2E_Evaluator_openapi 27372539 ns 24008992 ns 1.14
E2E_Evaluator_pre-commit-hooks 2076764 ns 2046630 ns 1.01
E2E_Evaluator_pulumi 1914086 ns 1988064 ns 0.96
E2E_Evaluator_semantic-release 224542 ns 222255 ns 1.01
E2E_Evaluator_stale 378663 ns 373534 ns 1.01
E2E_Evaluator_stylecop 1217216 ns 1206489 ns 1.01
E2E_Evaluator_tmuxinator 210727 ns 211607 ns 1.00
E2E_Evaluator_ui5 2298968 ns 2251191 ns 1.02
E2E_Evaluator_ui5-manifest 9909142 ns 10105112 ns 0.98
E2E_Evaluator_unreal-engine-uproject 1607407 ns 1602094 ns 1.00
E2E_Evaluator_users-array 2540169 ns 2467017 ns 1.03
E2E_Evaluator_vercel 1010903 ns 978481 ns 1.03
E2E_Evaluator_yamllint 24295 ns 23778 ns 1.02

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit 12cec8e into main May 24, 2026
14 checks passed
@jviotti jviotti deleted the test-suite-bump branch May 24, 2026 22:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant