Skip to content

Allow choosing which annotations to accept#882

Merged
jviotti merged 2 commits into
mainfrom
annotations-whitelist
Jun 22, 2026
Merged

Allow choosing which annotations to accept#882
jviotti merged 2 commits into
mainfrom
annotations-whitelist

Conversation

@jviotti

@jviotti jviotti commented Jun 22, 2026

Copy link
Copy Markdown
Member

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Review in cubic

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@jviotti jviotti force-pushed the annotations-whitelist branch from 965ecef to 02e91ed Compare June 22, 2026 18:29
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@jviotti jviotti marked this pull request as ready for review June 22, 2026 18:42
@augmentcode

augmentcode Bot commented Jun 22, 2026

Copy link
Copy Markdown
🤖 Augment PR Summary

Summary: This PR adds a way to selectively enable/disable annotation emission during exhaustive compilation, so users can control which schema keywords produce annotations.

Changes:

  • Introduced Tweaks::annotations (optional keyword allowlist) to filter which keywords emit annotations in Mode::Exhaustive.
  • Added annotations_enabled(context, keyword) helper to centralize the “exhaustive + allowlist” decision.
  • Updated the default compiler’s core-annotation fallback path to skip emitting annotations when the keyword is not enabled (or when compiling property names).
  • Updated 2019-09 / draft3 compiler paths (e.g., properties, items, additionalItems, unevaluated*, content keywords, format annotations) to honor the allowlist.
  • Refined draft3 compilation to avoid emitting empty wrapper/group instructions when annotations are filtered out.
  • Added evaluator tests for 2020-12 covering “no annotations”, “selected annotations”, nested contains behavior, custom-keyword selection, and fast-mode behavior.
  • Added a draft7 regression test ensuring filtered annotations don’t introduce an empty wrapper for additionalItems.

Technical Notes: The allowlist only affects annotation emission; evaluation tracking for unevaluatedProperties/unevaluatedItems remains functional even when annotations are fully filtered.

🤖 Was this summary useful? React with 👍 or 👎

@augmentcode augmentcode Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

bool format_assertion{false};
/// Select which keywords emit annotations in exhaustive mode. When not set,
/// every annotation keyword is emitted
std::optional<std::unordered_set<sourcemeta::core::JSON::StringView>>

@augmentcode augmentcode Bot Jun 22, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

src/compiler/include/sourcemeta/blaze/compiler.h:104: Tweaks::annotations stores JSON::StringView (std::string_view) inside an unordered_set, which can dangle if callers build the set from temporary/short-lived strings (UB when annotations_enabled() checks contains). It might be worth clearly documenting the required lifetime expectations for these views (or otherwise ensuring the keys are owned).

Severity: medium

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 51e649b Previous: 1dc7105 Ratio
Schema_Iterator_ISO_Language 2205706.8854163866 ns/iter 2328046.687295952 ns/iter 0.95
Schema_Tracker_ISO_Language 4237127.476190359 ns/iter 5031408.606666143 ns/iter 0.84
Schema_Tracker_ISO_Language_To_JSON 14679657.608696843 ns/iter 15961652.489363102 ns/iter 0.92
Schema_Frame_WoT_References 4504602.134146331 ns/iter 6080209.517730065 ns/iter 0.74
Schema_Frame_OMC_References 31533635.77777984 ns/iter 26394413.319994785 ns/iter 1.19
Schema_Frame_OMC_Locations 20478303.741935723 ns/iter 22613945.833328824 ns/iter 0.91
Schema_Frame_ISO_Language_Locations 72381546.33334185 ns/iter 103157050.88889141 ns/iter 0.70
Schema_Frame_KrakenD_References 39716259.76471253 ns/iter 54569306.57141714 ns/iter 0.73
Schema_Frame_KrakenD_Reachable 362320063.0000838 ns/iter 615323749.0000265 ns/iter 0.59
Schema_Frame_ISO_Language_Locations_To_JSON 69473231.44446374 ns/iter 99520285.71430154 ns/iter 0.70
Schema_Frame_Many_Resources_References 264305305.33336118 ns/iter 439164333.5000026 ns/iter 0.60
Schema_Bundle_Meta_2020_12 1218738.496503364 ns/iter 1880735.9014379936 ns/iter 0.65
Schema_Format_ISO_Language_To_JSON 72084856.44443701 ns/iter 109882048.83335584 ns/iter 0.66
E2E_Compiler_adaptivecard 62551805.49999296 ns/iter 76277678.09090486 ns/iter 0.82
E2E_Compiler_ansible_meta 30568427.444441788 ns/iter 41187562.49999933 ns/iter 0.74
E2E_Compiler_aws_cdk 323759.0671609207 ns/iter 576920.3539170926 ns/iter 0.56
E2E_Compiler_babelrc 2187537.9770492264 ns/iter 4239247.294999586 ns/iter 0.52
E2E_Compiler_clang_format 14681481.215686789 ns/iter 27963447.51851831 ns/iter 0.53
E2E_Compiler_cmake_presets 25923516.962966125 ns/iter 47618986.1333296 ns/iter 0.54
E2E_Compiler_code_climate 2109441.0529412124 ns/iter 3986945.7671956434 ns/iter 0.53
E2E_Compiler_cql2 13078563.90000097 ns/iter 20294617.187502693 ns/iter 0.64
E2E_Compiler_cspell 19299082.031253077 ns/iter 32483787.315784767 ns/iter 0.59
E2E_Compiler_cypress 3336353.0092595248 ns/iter 6037932.795699954 ns/iter 0.55
E2E_Compiler_deno 6223350.071428918 ns/iter 10199448.227274733 ns/iter 0.61
E2E_Compiler_dependabot 3261445.2598043536 ns/iter 5429670.194915824 ns/iter 0.60
E2E_Compiler_draft_04 1918696.350922995 ns/iter 3624835.41818144 ns/iter 0.53
E2E_Compiler_fabric_mod 3430213.1767672664 ns/iter 5669464.338982341 ns/iter 0.61
E2E_Compiler_geojson 23287319.057148386 ns/iter 36315710.6666626 ns/iter 0.64
E2E_Compiler_gitpod_configuration 4091993.9064336005 ns/iter 6546830.275231205 ns/iter 0.63
E2E_Compiler_helm_chart_lock 486379.2528352262 ns/iter 666858.7438422673 ns/iter 0.73
E2E_Compiler_importmap 195721.65722305162 ns/iter 352401.4806377471 ns/iter 0.56
E2E_Compiler_jasmine 989503.8154068352 ns/iter 2101449.0107818516 ns/iter 0.47
E2E_Compiler_jshintrc 3026198.04453482 ns/iter 5757954.590001191 ns/iter 0.53
E2E_Compiler_jsconfig 17993289.538463403 ns/iter 26420989.130438894 ns/iter 0.68
E2E_Compiler_krakend 123494441.79999408 ns/iter 224331402.66669703 ns/iter 0.55
E2E_Compiler_lazygit 30733208.30434489 ns/iter 39049226.56251131 ns/iter 0.79
E2E_Compiler_lerna 1216249.2517985345 ns/iter 1492359.5653105546 ns/iter 0.81
E2E_Compiler_nest_cli 5845665.948276417 ns/iter 6963173.5360820405 ns/iter 0.84
E2E_Compiler_omc 160494979.25001788 ns/iter 171083666.7500075 ns/iter 0.94
E2E_Compiler_omnisharp 6129482.664000534 ns/iter 5905160.066667274 ns/iter 1.04
E2E_Compiler_openapi 21451735.2258099 ns/iter 23299916.65516806 ns/iter 0.92
E2E_Compiler_pre_commit_hooks 3864915.277778083 ns/iter 4223552.206896272 ns/iter 0.92
E2E_Compiler_pulumi 3142266.489361104 ns/iter 3293424.2060308857 ns/iter 0.95
E2E_Compiler_semantic_release 1167958.0577556528 ns/iter 1197626.9787233078 ns/iter 0.98
E2E_Compiler_stale 1119697.5159127212 ns/iter 1672482.2934233684 ns/iter 0.67
E2E_Compiler_stylecop 5077155.040816851 ns/iter 5508296.7807018645 ns/iter 0.92
E2E_Compiler_tmuxinator 1425946.3552360446 ns/iter 1477372.8778001338 ns/iter 0.97
E2E_Compiler_ui5 52627824.35714339 ns/iter 56373535.230774835 ns/iter 0.93
E2E_Compiler_ui5_manifest 289370604.50004995 ns/iter 322847874.9999795 ns/iter 0.90
E2E_Compiler_unreal_engine_uproject 3369422.475961196 ns/iter 3391726.851852447 ns/iter 0.99
E2E_Compiler_users_array 777768.5950413271 ns/iter 692389.9202227365 ns/iter 1.12
E2E_Compiler_vercel 12057164.351850353 ns/iter 11434729.178570738 ns/iter 1.05
E2E_Compiler_yamllint 227037.32174742484 ns/iter 218666.20637419858 ns/iter 1.04
E2E_Evaluator_adaptivecard 18666.246432400134 ns/iter 20146.198623484914 ns/iter 0.93
E2E_Evaluator_ansible_meta 157637.96051178707 ns/iter 158399.68248172288 ns/iter 1.00
E2E_Evaluator_aws_cdk 33575.45464569892 ns/iter 32778.73328700541 ns/iter 1.02
E2E_Evaluator_babelrc 81898.98142599009 ns/iter 82198.61615903077 ns/iter 1.00
E2E_Evaluator_cerebrum_criminal_case 704534.5104960904 ns/iter 633978.9667540615 ns/iter 1.11
E2E_Evaluator_clang_format 133550.2120248718 ns/iter 88427.02593984884 ns/iter 1.51
E2E_Evaluator_cmake_presets 4189180.0065356437 ns/iter 3666647.180554921 ns/iter 1.14
E2E_Evaluator_code_climate 167106.0523476372 ns/iter 127666.23361522063 ns/iter 1.31
E2E_Evaluator_cql2 205951.54169829327 ns/iter 135879.7810146476 ns/iter 1.52
E2E_Evaluator_cspell 563614.2633279185 ns/iter 383400.9094279189 ns/iter 1.47
E2E_Evaluator_cypress 163283.7701612678 ns/iter 138154.67230366505 ns/iter 1.18
E2E_Evaluator_deno 307135.20183484716 ns/iter 217742.77000311986 ns/iter 1.41
E2E_Evaluator_dependabot 294038.50102663256 ns/iter 223904.13124238388 ns/iter 1.31
E2E_Evaluator_draft_04 7553935.606061585 ns/iter 5715738.138686351 ns/iter 1.32
E2E_Evaluator_fabric_mod 822590.4314160423 ns/iter 528272.3502747243 ns/iter 1.56
E2E_Evaluator_geojson 10863687.93877617 ns/iter 9200945.095240995 ns/iter 1.18
E2E_Evaluator_gitpod_configuration 279218.2888264249 ns/iter 202617.85044541862 ns/iter 1.38
E2E_Evaluator_helm_chart_lock 288228.2072368211 ns/iter 380307.447916645 ns/iter 0.76
E2E_Evaluator_importmap 52487.96669998228 ns/iter 40647.80109829216 ns/iter 1.29
E2E_Evaluator_jasmine 118831.26144907993 ns/iter 133124.9184206208 ns/iter 0.89
E2E_Evaluator_jshintrc 1435126.73611094 ns/iter 1242746.563972788 ns/iter 1.15
E2E_Evaluator_jsconfig 487075.04988815426 ns/iter 344165.39509531716 ns/iter 1.42
E2E_Evaluator_krakend 180434.77982034607 ns/iter 160425.69906206356 ns/iter 1.12
E2E_Evaluator_lazygit 113237.22525140109 ns/iter 123146.11298837751 ns/iter 0.92
E2E_Evaluator_lerna 156655.56214247338 ns/iter 183007.19905800998 ns/iter 0.86
E2E_Evaluator_nest_cli 182553.7102030651 ns/iter 180921.8429242088 ns/iter 1.01
E2E_Evaluator_omc 19590.406621218353 ns/iter 34704.177076325635 ns/iter 0.56
E2E_Evaluator_omnisharp 620893.6009317586 ns/iter 484107.8090710762 ns/iter 1.28
E2E_Evaluator_openapi 11326759.514288044 ns/iter 6206107.542857353 ns/iter 1.83
E2E_Evaluator_pre_commit_hooks 595906.4999999555 ns/iter 346218.6162134874 ns/iter 1.72
E2E_Evaluator_pulumi 871725.4098359892 ns/iter 565251.6268980519 ns/iter 1.54
E2E_Evaluator_semantic_release 112696.12613750472 ns/iter 99179.22924343178 ns/iter 1.14
E2E_Evaluator_stale 163393.6457310849 ns/iter 118297.20210611238 ns/iter 1.38
E2E_Evaluator_stylecop 226699.51456317166 ns/iter 187483.7719886879 ns/iter 1.21
E2E_Evaluator_tmuxinator 84994.39605698269 ns/iter 73800.47864346152 ns/iter 1.15
E2E_Evaluator_ui5 467347.6550897521 ns/iter 361391.1882234365 ns/iter 1.29
E2E_Evaluator_ui5_manifest 2105770.1423843955 ns/iter 1788949.6914890853 ns/iter 1.18
E2E_Evaluator_unreal_engine_uproject 352041.8254648689 ns/iter 326614.49724004284 ns/iter 1.08
E2E_Evaluator_users_array 501567.03397605655 ns/iter 523988.58300011855 ns/iter 0.96
E2E_Evaluator_vercel 326836.8918645897 ns/iter 280979.7668688727 ns/iter 1.16
E2E_Evaluator_yamllint 8803.314740601767 ns/iter 8514.055641364703 ns/iter 1.03
Micro_Draft4_Meta_1_No_Callback 171.98656435422077 ns/iter 215.395072474442 ns/iter 0.80
Micro_Draft4_Required_Properties 815.433467556764 ns/iter 788.5945096557057 ns/iter 1.03
Micro_Draft4_Many_Optional_Properties_Minimal_Match 25.027217121006142 ns/iter 19.607445537071918 ns/iter 1.28
Micro_Draft4_Few_Optional_Properties_Minimal_Match 10.237304896242762 ns/iter 10.18864862653979 ns/iter 1.00
Micro_Draft4_Items_Schema 306.0948938471664 ns/iter 240.6450534409752 ns/iter 1.27
Micro_Draft4_Nested_Object 0.8419131063709511 ns/iter 0.8263963217554586 ns/iter 1.02
Micro_Draft4_Properties_Triad_Optional 289.9244052364505 ns/iter 251.08748170054704 ns/iter 1.15
Micro_Draft4_Properties_Triad_Closed 226.01371440734312 ns/iter 204.40224810008587 ns/iter 1.11
Micro_Draft4_Properties_Triad_Required 306.5036283043971 ns/iter 240.20825720311993 ns/iter 1.28
Micro_Draft4_Properties_Closed 55.52945297043014 ns/iter 48.00083363922327 ns/iter 1.16
Micro_Draft4_Non_Recursive_Ref 16.569813792957973 ns/iter 13.563955673896839 ns/iter 1.22
Micro_Draft4_Pattern_Properties_True 183.8777852577067 ns/iter 179.36846981084494 ns/iter 1.03
Micro_Draft4_Ref_To_Single_Property 9.122118386979258 ns/iter 9.602037118878531 ns/iter 0.95
Micro_Draft4_Additional_Properties_Type 31.901362137137735 ns/iter 28.794401755964238 ns/iter 1.11
Micro_Draft4_Nested_Oneof 51.505683400000635 ns/iter 47.4573646255743 ns/iter 1.09
Micro_Draft4_Short_Enum 6.505044094738369 ns/iter 5.486678843817807 ns/iter 1.19
Micro_Draft4_Long_Enum 12.72220732108044 ns/iter 10.488345486090095 ns/iter 1.21
Micro_Draft4_Long_Enum_Short_Strings 8.612720445023927 ns/iter 6.46813000906692 ns/iter 1.33
Micro_Draft4_Type_Object 3.2717500767396084 ns/iter 2.5171246686791693 ns/iter 1.30
Micro_Draft4_Ref_Single_100 2424220.082707165 ns/iter 1658170.9735577786 ns/iter 1.46
Micro_Draft4_Compile_Ref_Many_Nested 1757863.7722219054 ns/iter 1216603.3051722355 ns/iter 1.44
Micro_Draft4_Compile_Wrap 2903388.8859644006 ns/iter 2180429.4969511805 ns/iter 1.33
Micro_Draft6_Property_Names 115.32189517311443 ns/iter 99.99202533348135 ns/iter 1.15
Micro_Draft6_Compile_FHIR 16878484167.000124 ns/iter 9874017542.000048 ns/iter 1.71
Micro_Draft7_If_Then_Else 25.86637871418262 ns/iter 18.418295478345915 ns/iter 1.40
Micro_2019_09_Unevaluated_Properties 34.531655747634 ns/iter 28.982577362868525 ns/iter 1.19
Micro_2019_09_Compile_Wrap 525337583.00000954 ns/iter 309465082.99996364 ns/iter 1.70
Micro_2020_12_Dynamic_Ref 271.7991943615262 ns/iter 200.82670019697775 ns/iter 1.35
Micro_2020_12_Dynamic_Ref_Single 3.552884724310107 ns/iter 2.764597124083041 ns/iter 1.29
Micro_2020_12_Simple_Output_Mask 902.8504749183307 ns/iter 791.3826931372637 ns/iter 1.14
Micro_2020_12_Simple_Output_Annotations 104956.86276999145 ns/iter 87335.64755660764 ns/iter 1.20
Micro_2020_12_Compile_NonCircular_Shared_Refs 1050618.2104430662 ns/iter 747650.0582752144 ns/iter 1.41
Micro_2020_12_Exhaustive_Deep_Numeric 7325.845592042663 ns/iter 5150.150353762148 ns/iter 1.42
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 154273.93370419217 ns/iter 112238.55787755718 ns/iter 1.37
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 16880.179706499723 ns/iter 14517.345337823155 ns/iter 1.16
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 144.4855615681875 ns/iter 88.19304169700148 ns/iter 1.64
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 5407.402933123106 ns/iter 5064.022453852105 ns/iter 1.07
Alterschema_Check_Readibility_ISO_Language_Set_3 370445749.99993074 ns/iter 251427555.66669926 ns/iter 1.47
Alterschema_Check_Readibility_OMC 89380629.66667026 ns/iter 59868201.33333974 ns/iter 1.49
Alterschema_Check_Readibility_KrakenD 1008793542.0001485 ns/iter 675342042.0000111 ns/iter 1.49
Alterschema_Apply_Readibility_KrakenD 100229654417.00012 ns/iter 68246952874.99981 ns/iter 1.47
Alterschema_Check_Invalid_External_Refs 183988500.00005496 ns/iter 185892760.49999624 ns/iter 0.99

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: 51e649b Previous: 1dc7105 Ratio
E2E_Evaluator_adaptivecard 121130 ns 104160 ns 1.16
E2E_Evaluator_ansible-meta 359020 ns 361095 ns 0.99
E2E_Evaluator_aws-cdk 150008 ns 115523 ns 1.30
E2E_Evaluator_babelrc 339105 ns 304509 ns 1.11
E2E_Evaluator_cerebrum-criminal-case 2147926 ns 1726204 ns 1.24
E2E_Evaluator_clang-format 291641 ns 251457 ns 1.16
E2E_Evaluator_cmake-presets 23928863 ns 19550657 ns 1.22
E2E_Evaluator_code-climate 532963 ns 475411 ns 1.12
E2E_Evaluator_cql2 1340981 ns 1227137 ns 1.09
E2E_Evaluator_cspell 1487349 ns 1221013 ns 1.22
E2E_Evaluator_cypress 670520 ns 657352 ns 1.02
E2E_Evaluator_deno 856215 ns 746183 ns 1.15
E2E_Evaluator_dependabot 827940 ns 789785 ns 1.05
E2E_Evaluator_draft-04 18053565 ns 16767999 ns 1.08
E2E_Evaluator_fabric-mod 1497269 ns 1363334 ns 1.10
E2E_Evaluator_geojson 16769818 ns 14893866 ns 1.13
E2E_Evaluator_gitpod-configuration 541228 ns 463878 ns 1.17
E2E_Evaluator_helm-chart-lock 846825 ns 810289 ns 1.05
E2E_Evaluator_importmap 216104 ns 258807 ns 0.84
E2E_Evaluator_jasmine 225092 ns 218685 ns 1.03
E2E_Evaluator_jsconfig 1076794 ns 1033219 ns 1.04
E2E_Evaluator_jshintrc 2148612 ns 2033576 ns 1.06
E2E_Evaluator_krakend 482406 ns 469507 ns 1.03
E2E_Evaluator_lazygit 322855 ns 298443 ns 1.08
E2E_Evaluator_lerna 345696 ns 315943 ns 1.09
E2E_Evaluator_nest-cli 421839 ns 398531 ns 1.06
E2E_Evaluator_omc 75625 ns 70571 ns 1.07
E2E_Evaluator_omnisharp 1031754 ns 978199 ns 1.05
E2E_Evaluator_openapi 22107901 ns 16232831 ns 1.36
E2E_Evaluator_pre-commit-hooks 1398884 ns 1482163 ns 0.94
E2E_Evaluator_pulumi 1436455 ns 1454408 ns 0.99
E2E_Evaluator_semantic-release 190663 ns 175673 ns 1.09
E2E_Evaluator_stale 291017 ns 306799 ns 0.95
E2E_Evaluator_stylecop 851517 ns 931317 ns 0.91
E2E_Evaluator_tmuxinator 167423 ns 174507 ns 0.96
E2E_Evaluator_ui5 1902291 ns 1631448 ns 1.17
E2E_Evaluator_ui5-manifest 8170336 ns 9371350 ns 0.87
E2E_Evaluator_unreal-engine-uproject 1172351 ns 1294207 ns 0.91
E2E_Evaluator_users-array 1822387 ns 2009016 ns 0.91
E2E_Evaluator_vercel 758214 ns 751465 ns 1.01
E2E_Evaluator_yamllint 24013 ns 24457 ns 0.98

This comment was automatically generated by workflow using github-action-benchmark.

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 7 files

Reply with feedback, questions, or to request a fix.

Re-trigger cubic

Comment thread src/compiler/include/sourcemeta/blaze/compiler.h

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 51e649b Previous: 1dc7105 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 377893289.4999798 ns/iter 340365145.499959 ns/iter 1.11
Alterschema_Check_Readibility_OMC 106779331.57142304 ns/iter 102605049.42857552 ns/iter 1.04
Alterschema_Check_Readibility_KrakenD 1447796643.9999363 ns/iter 1390775861.0000656 ns/iter 1.04
Alterschema_Apply_Readibility_KrakenD 136907081038.99988 ns/iter 132105273791.99994 ns/iter 1.04
Alterschema_Check_Invalid_External_Refs 295303180.5000137 ns/iter 293745321.499955 ns/iter 1.01
Micro_2020_12_Dynamic_Ref 260.31153813295776 ns/iter 269.7638687745869 ns/iter 0.96
Micro_2020_12_Dynamic_Ref_Single 4.222143149283362 ns/iter 4.223725217483778 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1122.6269866527307 ns/iter 1123.2063445341894 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 103094.24543850472 ns/iter 117590.94296683301 ns/iter 0.88
Micro_2020_12_Compile_NonCircular_Shared_Refs 1190443.4795917573 ns/iter 1178542.1703202554 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric 8785.789455973054 ns/iter 8908.085584666662 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 166775.5335515563 ns/iter 165743.44160672335 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 26629.926117156687 ns/iter 26672.39713679856 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 152.30128920944716 ns/iter 153.20256592893077 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4670.372657458144 ns/iter 4469.881766453392 ns/iter 1.04
Micro_2019_09_Unevaluated_Properties 28.539978748887098 ns/iter 28.169109854596364 ns/iter 1.01
Micro_2019_09_Compile_Wrap 349501491.99994487 ns/iter 319289385.0000473 ns/iter 1.09
Micro_Draft7_If_Then_Else 24.99594501760422 ns/iter 25.006556194250344 ns/iter 1.00
Micro_Draft6_Property_Names 151.09526604422882 ns/iter 143.0224241905666 ns/iter 1.06
Micro_Draft6_Compile_FHIR 16436211161.000074 ns/iter 14202258354.00015 ns/iter 1.16
Micro_Draft4_Meta_1_No_Callback 177.8519101319297 ns/iter 176.54704272912969 ns/iter 1.01
Micro_Draft4_Required_Properties 815.2028470619581 ns/iter 826.3808560059052 ns/iter 0.99
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.522870223391184 ns/iter 21.102663185087994 ns/iter 1.02
Micro_Draft4_Few_Optional_Properties_Minimal_Match 12.667568695322538 ns/iter 12.662185934306276 ns/iter 1.00
Micro_Draft4_Items_Schema 298.86151521277463 ns/iter 318.2028896478923 ns/iter 0.94
Micro_Draft4_Nested_Object 2.1114805384794737 ns/iter 2.1177275660077615 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 418.54898808531846 ns/iter 442.0815203905197 ns/iter 0.95
Micro_Draft4_Properties_Triad_Closed 339.9161402827085 ns/iter 343.69819042014143 ns/iter 0.99
Micro_Draft4_Properties_Triad_Required 466.8341283310425 ns/iter 457.2786745042494 ns/iter 1.02
Micro_Draft4_Properties_Closed 61.80183308826681 ns/iter 61.45075198807072 ns/iter 1.01
Micro_Draft4_Non_Recursive_Ref 8.451050458289565 ns/iter 9.152779566730846 ns/iter 0.92
Micro_Draft4_Pattern_Properties_True 200.25933103570893 ns/iter 187.49293903897154 ns/iter 1.07
Micro_Draft4_Ref_To_Single_Property 12.673191352137858 ns/iter 13.04820100801606 ns/iter 0.97
Micro_Draft4_Additional_Properties_Type 13.761292336472755 ns/iter 13.899114589192184 ns/iter 0.99
Micro_Draft4_Nested_Oneof 65.46112558871636 ns/iter 63.340641345179755 ns/iter 1.03
Micro_Draft4_Short_Enum 14.543072350214011 ns/iter 14.606666135644925 ns/iter 1.00
Micro_Draft4_Long_Enum 13.752699803326848 ns/iter 13.38331721253409 ns/iter 1.03
Micro_Draft4_Long_Enum_Short_Strings 14.497978564865083 ns/iter 14.486245259858256 ns/iter 1.00
Micro_Draft4_Type_Object 4.223476292039062 ns/iter 4.220039173875495 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2529501.4784172988 ns/iter 2500713.215827156 ns/iter 1.01
Micro_Draft4_Compile_Ref_Many_Nested 1850150.632274938 ns/iter 1852124.9708221718 ns/iter 1.00
Micro_Draft4_Compile_Wrap 2679112.817829736 ns/iter 2669919.5000002375 ns/iter 1.00
E2E_Compiler_adaptivecard 66493008.29999447 ns/iter 65493768.800001815 ns/iter 1.02
E2E_Compiler_ansible_meta 32005138.363636184 ns/iter 31830388.227273367 ns/iter 1.01
E2E_Compiler_aws_cdk 391904.96696531604 ns/iter 387267.95916118455 ns/iter 1.01
E2E_Compiler_babelrc 2776657.5515874326 ns/iter 2752186.846456554 ns/iter 1.01
E2E_Compiler_clang_format 19938756.857144263 ns/iter 19334520.194440253 ns/iter 1.03
E2E_Compiler_cmake_presets 28522287.559999313 ns/iter 28417640.199995734 ns/iter 1.00
E2E_Compiler_code_climate 2822829.3225813485 ns/iter 2798931.203187749 ns/iter 1.01
E2E_Compiler_cql2 14456796.897956317 ns/iter 14444087.387754716 ns/iter 1.00
E2E_Compiler_cspell 25325815.42857315 ns/iter 24956297.82142877 ns/iter 1.01
E2E_Compiler_cypress 4352524.825000615 ns/iter 4323220.627329138 ns/iter 1.01
E2E_Compiler_deno 8704083.12499933 ns/iter 8851447.000001883 ns/iter 0.98
E2E_Compiler_dependabot 4272502.737805786 ns/iter 4237530.999999072 ns/iter 1.01
E2E_Compiler_draft_04 2947242.9327727566 ns/iter 2939165.7436976973 ns/iter 1.00
E2E_Compiler_fabric_mod 5131791.182482656 ns/iter 5126893.116788526 ns/iter 1.00
E2E_Compiler_geojson 25488747.857147183 ns/iter 24138679.3793089 ns/iter 1.06
E2E_Compiler_gitpod_configuration 5468493.346456388 ns/iter 5379865.015384684 ns/iter 1.02
E2E_Compiler_helm_chart_lock 718655.3915726071 ns/iter 702728.8096676964 ns/iter 1.02
E2E_Compiler_importmap 294791.07118785934 ns/iter 288952.3065451773 ns/iter 1.02
E2E_Compiler_jasmine 1488011.0652627894 ns/iter 1451325.3929314096 ns/iter 1.03
E2E_Compiler_jshintrc 4522679.901961085 ns/iter 4520565.580645369 ns/iter 1.00
E2E_Compiler_jsconfig 23412789.83333268 ns/iter 23195087.733332302 ns/iter 1.01
E2E_Compiler_krakend 145748061.19999266 ns/iter 144674739.6000319 ns/iter 1.01
E2E_Compiler_lazygit 37360704.894737005 ns/iter 35893965.368419036 ns/iter 1.04
E2E_Compiler_lerna 1726880.155940357 ns/iter 1693490.966183211 ns/iter 1.02
E2E_Compiler_nest_cli 8223853.988373628 ns/iter 7977276.9999987185 ns/iter 1.03
E2E_Compiler_omc 178188420.74996156 ns/iter 172058689.00003907 ns/iter 1.04
E2E_Compiler_omnisharp 7317382.687498745 ns/iter 7191915.628864174 ns/iter 1.02
E2E_Compiler_openapi 27844573.399997897 ns/iter 27522057.26922232 ns/iter 1.01
E2E_Compiler_pre_commit_hooks 5652286.12903147 ns/iter 5621347.320000496 ns/iter 1.01
E2E_Compiler_pulumi 4374759.906249892 ns/iter 4345174.818750763 ns/iter 1.01
E2E_Compiler_semantic_release 1681506.5251797086 ns/iter 1668052.5584721388 ns/iter 1.01
E2E_Compiler_stale 1665827.0906923907 ns/iter 1643407.8047057162 ns/iter 1.01
E2E_Compiler_stylecop 6867697.495050775 ns/iter 6720406.961538682 ns/iter 1.02
E2E_Compiler_tmuxinator 2064944.1740409853 ns/iter 2033964.1686045662 ns/iter 1.02
E2E_Compiler_ui5 53151054.9999926 ns/iter 51538288.92857096 ns/iter 1.03
E2E_Compiler_ui5_manifest 365872779.5000232 ns/iter 325526412.50003946 ns/iter 1.12
E2E_Compiler_unreal_engine_uproject 4985830.164285485 ns/iter 4911310.464788739 ns/iter 1.02
E2E_Compiler_users_array 895931.0502577348 ns/iter 883878.8751574708 ns/iter 1.01
E2E_Compiler_vercel 13772683.058826206 ns/iter 13364990.499999644 ns/iter 1.03
E2E_Compiler_yamllint 357712.7706941007 ns/iter 357595.9576962734 ns/iter 1.00
E2E_Evaluator_adaptivecard 23343.26196068142 ns/iter 23294.539750905045 ns/iter 1.00
E2E_Evaluator_ansible_meta 241535.063143449 ns/iter 239198.98169263406 ns/iter 1.01
E2E_Evaluator_aws_cdk 47532.61768970357 ns/iter 48003.489497406765 ns/iter 0.99
E2E_Evaluator_babelrc 93759.17570816808 ns/iter 94489.34152563501 ns/iter 0.99
E2E_Evaluator_cerebrum_criminal_case 1277760.706270618 ns/iter 1138391.9819377782 ns/iter 1.12
E2E_Evaluator_clang_format 104713.94717942798 ns/iter 100377.0004276244 ns/iter 1.04
E2E_Evaluator_cmake_presets 7052759.129999232 ns/iter 4669534.55555533 ns/iter 1.51
E2E_Evaluator_code_climate 171226.67987205044 ns/iter 170233.58133268726 ns/iter 1.01
E2E_Evaluator_cql2 206854.6681495032 ns/iter 212584.92417907846 ns/iter 0.97
E2E_Evaluator_cspell 540918.4890564609 ns/iter 512431.23520713014 ns/iter 1.06
E2E_Evaluator_cypress 145163.52080760073 ns/iter 143911.05482545623 ns/iter 1.01
E2E_Evaluator_deno 311343.73833758745 ns/iter 291695.1212378568 ns/iter 1.07
E2E_Evaluator_dependabot 359523.11111100804 ns/iter 357286.4489690557 ns/iter 1.01
E2E_Evaluator_draft_04 12724565.50909324 ns/iter 7302802.340658532 ns/iter 1.74
E2E_Evaluator_fabric_mod 766081.3767797702 ns/iter 733055.4059195304 ns/iter 1.05
E2E_Evaluator_geojson 21326075.625005104 ns/iter 19042932.324325465 ns/iter 1.12
E2E_Evaluator_gitpod_configuration 235609.00746521182 ns/iter 231320.35458168926 ns/iter 1.02
E2E_Evaluator_helm_chart_lock 218587.75860958945 ns/iter 217526.7350722703 ns/iter 1.00
E2E_Evaluator_importmap 38927.677729834664 ns/iter 41633.60425480924 ns/iter 0.94
E2E_Evaluator_jasmine 106166.21747014862 ns/iter 104376.33617848593 ns/iter 1.02
E2E_Evaluator_jshintrc 1052232.385542407 ns/iter 1026341.5102940598 ns/iter 1.03
E2E_Evaluator_jsconfig 375557.3994638097 ns/iter 386771.246590287 ns/iter 0.97
E2E_Evaluator_krakend 191205.0489490717 ns/iter 188717.39312568313 ns/iter 1.01
E2E_Evaluator_lazygit 130256.10834443118 ns/iter 129451.42418673864 ns/iter 1.01
E2E_Evaluator_lerna 138182.13164658457 ns/iter 136168.77779953319 ns/iter 1.01
E2E_Evaluator_nest_cli 186224.93005524823 ns/iter 189048.54358972955 ns/iter 0.99
E2E_Evaluator_omc 19344.98307912167 ns/iter 18522.16999999863 ns/iter 1.04
E2E_Evaluator_omnisharp 532063.6451128131 ns/iter 522756.74183750496 ns/iter 1.02
E2E_Evaluator_openapi 16562353.904760132 ns/iter 10066726.367647467 ns/iter 1.65
E2E_Evaluator_pre_commit_hooks 477246.1834925094 ns/iter 478323.3006756327 ns/iter 1.00
E2E_Evaluator_pulumi 752664.1078748208 ns/iter 749713.8234018876 ns/iter 1.00
E2E_Evaluator_semantic_release 87059.92989022857 ns/iter 86751.30998250932 ns/iter 1.00
E2E_Evaluator_stale 163978.68970378925 ns/iter 159349.60373116858 ns/iter 1.03
E2E_Evaluator_stylecop 302214.093920326 ns/iter 292567.34105269733 ns/iter 1.03
E2E_Evaluator_tmuxinator 86984.07527283745 ns/iter 90762.5208851361 ns/iter 0.96
E2E_Evaluator_ui5 518914.7808527884 ns/iter 527973.8765893418 ns/iter 0.98
E2E_Evaluator_ui5_manifest 2662422.1098488346 ns/iter 2678452.0568179977 ns/iter 0.99
E2E_Evaluator_unreal_engine_uproject 439845.44556325447 ns/iter 449953.5305867096 ns/iter 0.98
E2E_Evaluator_users_array 691406.5084914851 ns/iter 702888.3635448181 ns/iter 0.98
E2E_Evaluator_vercel 279317.0849359355 ns/iter 282873.2454110297 ns/iter 0.99
E2E_Evaluator_yamllint 10062.854918624656 ns/iter 9180.430506830948 ns/iter 1.10
Schema_Format_ISO_Language_To_JSON 120777731.8333001 ns/iter 109577500.16666524 ns/iter 1.10
Schema_Bundle_Meta_2020_12 1867743.6480011237 ns/iter 1852155.0211664997 ns/iter 1.01
Schema_Frame_WoT_References 5827772.672269365 ns/iter 5850781.133333763 ns/iter 1.00
Schema_Frame_OMC_References 27024234.30769858 ns/iter 24281920.275864746 ns/iter 1.11
Schema_Frame_OMC_Locations 24077837.10344214 ns/iter 22333390.06452004 ns/iter 1.08
Schema_Frame_ISO_Language_Locations 112566185.83331601 ns/iter 102392023.57141559 ns/iter 1.10
Schema_Frame_KrakenD_References 50565761.29998121 ns/iter 43860932.93749127 ns/iter 1.15
Schema_Frame_KrakenD_Reachable 653514676.9999756 ns/iter 577628190.0000412 ns/iter 1.13
Schema_Frame_ISO_Language_Locations_To_JSON 190060978.00001952 ns/iter 174570798.49998537 ns/iter 1.09
Schema_Frame_Many_Resources_References 399955009.4999904 ns/iter 384210594.0000238 ns/iter 1.04
Schema_Iterator_ISO_Language 3890442.744444853 ns/iter 3671127.8969072006 ns/iter 1.06
Schema_Tracker_ISO_Language 5249496.8030308 ns/iter 5216434.729322657 ns/iter 1.01
Schema_Tracker_ISO_Language_To_JSON 26578251.846156213 ns/iter 25848063.22222364 ns/iter 1.03

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: 51e649b Previous: 1dc7105 Ratio
E2E_Evaluator_adaptivecard 117220 ns 120993 ns 0.97
E2E_Evaluator_ansible-meta 601885 ns 542476 ns 1.11
E2E_Evaluator_aws-cdk 129321 ns 126691 ns 1.02
E2E_Evaluator_babelrc 374164 ns 343931 ns 1.09
E2E_Evaluator_cerebrum-criminal-case 2720762 ns 2735153 ns 0.99
E2E_Evaluator_clang-format 286042 ns 260902 ns 1.10
E2E_Evaluator_cmake-presets 19844745 ns 18124292 ns 1.09
E2E_Evaluator_code-climate 505139 ns 496984 ns 1.02
E2E_Evaluator_cql2 1221954 ns 1233179 ns 0.99
E2E_Evaluator_cspell 1711043 ns 1592126 ns 1.07
E2E_Evaluator_cypress 928141 ns 845225 ns 1.10
E2E_Evaluator_deno 1069531 ns 1109528 ns 0.96
E2E_Evaluator_dependabot 1062640 ns 1057747 ns 1.00
E2E_Evaluator_draft-04 21180710 ns 22421334 ns 0.94
E2E_Evaluator_fabric-mod 2454054 ns 2491998 ns 0.98
E2E_Evaluator_geojson 28381106 ns 24624474 ns 1.15
E2E_Evaluator_gitpod-configuration 763898 ns 727342 ns 1.05
E2E_Evaluator_helm-chart-lock 1048031 ns 997814 ns 1.05
E2E_Evaluator_importmap 270174 ns 262085 ns 1.03
E2E_Evaluator_jasmine 278502 ns 280545 ns 0.99
E2E_Evaluator_jsconfig 1482948 ns 1435983 ns 1.03
E2E_Evaluator_jshintrc 2931469 ns 2953732 ns 0.99
E2E_Evaluator_krakend 628679 ns 630441 ns 1.00
E2E_Evaluator_lazygit 466161 ns 439714 ns 1.06
E2E_Evaluator_lerna 453159 ns 440498 ns 1.03
E2E_Evaluator_nest-cli 594368 ns 593181 ns 1.00
E2E_Evaluator_omc 92484 ns 93283 ns 0.99
E2E_Evaluator_omnisharp 1496666 ns 1464628 ns 1.02
E2E_Evaluator_openapi 23402874 ns 26007623 ns 0.90
E2E_Evaluator_pre-commit-hooks 2040459 ns 2053147 ns 0.99
E2E_Evaluator_pulumi 2028744 ns 2039534 ns 0.99
E2E_Evaluator_semantic-release 223752 ns 225353 ns 0.99
E2E_Evaluator_stale 376297 ns 380269 ns 0.99
E2E_Evaluator_stylecop 1199501 ns 1144974 ns 1.05
E2E_Evaluator_tmuxinator 218544 ns 215500 ns 1.01
E2E_Evaluator_ui5 2161511 ns 2143924 ns 1.01
E2E_Evaluator_ui5-manifest 9844034 ns 10858944 ns 0.91
E2E_Evaluator_unreal-engine-uproject 1624885 ns 1580958 ns 1.03
E2E_Evaluator_users-array 2449359 ns 2576448 ns 0.95
E2E_Evaluator_vercel 1003955 ns 1009231 ns 0.99
E2E_Evaluator_yamllint 24118 ns 24281 ns 0.99

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 51e649b Previous: 1dc7105 Ratio
Schema_Iterator_ISO_Language 3570618.7999995816 ns/iter 3178463.522726815 ns/iter 1.12
Schema_Tracker_ISO_Language 4708226.093959375 ns/iter 4599266.946309479 ns/iter 1.02
Schema_Tracker_ISO_Language_To_JSON 21051747.969694946 ns/iter 20924729.18749877 ns/iter 1.01
Schema_Frame_WoT_References 4890474.67132903 ns/iter 4808251.703448621 ns/iter 1.02
Schema_Frame_OMC_References 22420398.468753435 ns/iter 20831707.212120377 ns/iter 1.08
Schema_Frame_OMC_Locations 19449345.499999203 ns/iter 19114102.5277817 ns/iter 1.02
Schema_Frame_ISO_Language_Locations 100293125.00000744 ns/iter 98510487.66665827 ns/iter 1.02
Schema_Frame_KrakenD_References 41901386.82353041 ns/iter 40271263.16666201 ns/iter 1.04
Schema_Frame_KrakenD_Reachable 612610637.9997509 ns/iter 572686564.9999126 ns/iter 1.07
Schema_Frame_ISO_Language_Locations_To_JSON 127301974.4999715 ns/iter 119961710.40000263 ns/iter 1.06
Schema_Frame_Many_Resources_References 354033721.0000644 ns/iter 367967168.99993956 ns/iter 0.96
Schema_Bundle_Meta_2020_12 1560359.6311105625 ns/iter 1539552.4326704096 ns/iter 1.01
Schema_Format_ISO_Language_To_JSON 109024357.28572917 ns/iter 107383302.7143272 ns/iter 1.02
E2E_Compiler_adaptivecard 62652829.18182245 ns/iter 60816923.66666403 ns/iter 1.03
E2E_Compiler_ansible_meta 27484238.920005735 ns/iter 27294832.3461588 ns/iter 1.01
E2E_Compiler_aws_cdk 352914.50126202055 ns/iter 345150.437223051 ns/iter 1.02
E2E_Compiler_babelrc 2448140.729824158 ns/iter 2413940.9037805223 ns/iter 1.01
E2E_Compiler_clang_format 17495852.475002494 ns/iter 17051332.512199048 ns/iter 1.03
E2E_Compiler_cmake_presets 26047496.259260934 ns/iter 25730837.925923172 ns/iter 1.01
E2E_Compiler_code_climate 2460564.0947372685 ns/iter 2403585.6701030033 ns/iter 1.02
E2E_Compiler_cql2 13073972.320754828 ns/iter 12995816.166667115 ns/iter 1.01
E2E_Compiler_cspell 23300960.200003825 ns/iter 22882126.129036717 ns/iter 1.02
E2E_Compiler_cypress 4012254.8742861655 ns/iter 3950409.727272069 ns/iter 1.02
E2E_Compiler_deno 7535233.763441264 ns/iter 7452757.354837647 ns/iter 1.01
E2E_Compiler_dependabot 3735883.540107328 ns/iter 3672691.031579234 ns/iter 1.02
E2E_Compiler_draft_04 2585710.595588065 ns/iter 2577875.4492754107 ns/iter 1.00
E2E_Compiler_fabric_mod 4528314.858064351 ns/iter 4542944.038216861 ns/iter 1.00
E2E_Compiler_geojson 21290657.212120727 ns/iter 20925286.363638986 ns/iter 1.02
E2E_Compiler_gitpod_configuration 4770240.979451357 ns/iter 4692903.027027163 ns/iter 1.02
E2E_Compiler_helm_chart_lock 666259.063507099 ns/iter 655469.4565013997 ns/iter 1.02
E2E_Compiler_importmap 266436.4195511119 ns/iter 261285.0239520998 ns/iter 1.02
E2E_Compiler_jasmine 1300438.1537038407 ns/iter 1279921.2943330645 ns/iter 1.02
E2E_Compiler_jshintrc 4102265.4411763675 ns/iter 4024228.627218346 ns/iter 1.02
E2E_Compiler_jsconfig 21048574.93939314 ns/iter 20696291.794111483 ns/iter 1.02
E2E_Compiler_krakend 150699792.20002097 ns/iter 146292424.8000036 ns/iter 1.03
E2E_Compiler_lazygit 32400242.090912715 ns/iter 31511044.272726644 ns/iter 1.03
E2E_Compiler_lerna 1517982.6065219536 ns/iter 1494868.5948828785 ns/iter 1.02
E2E_Compiler_nest_cli 7109238.808080783 ns/iter 7011776.0800008 ns/iter 1.01
E2E_Compiler_omc 164403722.75002345 ns/iter 155801993.0000114 ns/iter 1.06
E2E_Compiler_omnisharp 6416246.5779824965 ns/iter 6346915.828829027 ns/iter 1.01
E2E_Compiler_openapi 24457500.321424115 ns/iter 24352601.724135168 ns/iter 1.00
E2E_Compiler_pre_commit_hooks 4967831.886523663 ns/iter 4891943.295774582 ns/iter 1.02
E2E_Compiler_pulumi 3841157.699453802 ns/iter 3778824.231182371 ns/iter 1.02
E2E_Compiler_semantic_release 1468861.4728032285 ns/iter 1454236.376299366 ns/iter 1.01
E2E_Compiler_stale 1480971.7579615826 ns/iter 1462117.9382977951 ns/iter 1.01
E2E_Compiler_stylecop 5919773.111110352 ns/iter 5828898.274999498 ns/iter 1.02
E2E_Compiler_tmuxinator 1807075.765464223 ns/iter 1782231.4554706435 ns/iter 1.01
E2E_Compiler_ui5 47680968.6666608 ns/iter 48291383.06666513 ns/iter 0.99
E2E_Compiler_ui5_manifest 328718525.5001077 ns/iter 318606125.4999686 ns/iter 1.03
E2E_Compiler_unreal_engine_uproject 4388581.194968177 ns/iter 4310182.722222488 ns/iter 1.02
E2E_Compiler_users_array 805530.4170507924 ns/iter 792372.2751983141 ns/iter 1.02
E2E_Compiler_vercel 12398425.803569678 ns/iter 12279703.315790245 ns/iter 1.01
E2E_Compiler_yamllint 324808.14531100605 ns/iter 318271.2396544241 ns/iter 1.02
E2E_Evaluator_adaptivecard 25619.80226686729 ns/iter 25054.573511497045 ns/iter 1.02
E2E_Evaluator_ansible_meta 258383.54725194597 ns/iter 234945.8326653586 ns/iter 1.10
E2E_Evaluator_aws_cdk 53516.54179208404 ns/iter 52319.96568702502 ns/iter 1.02
E2E_Evaluator_babelrc 116794.58525191338 ns/iter 116288.05878498674 ns/iter 1.00
E2E_Evaluator_cerebrum_criminal_case 1011453.1014495157 ns/iter 1007171.4063400923 ns/iter 1.00
E2E_Evaluator_clang_format 116945.10886758694 ns/iter 119080.71080850936 ns/iter 0.98
E2E_Evaluator_cmake_presets 6124413.955356138 ns/iter 4951546.944445549 ns/iter 1.24
E2E_Evaluator_code_climate 186551.4916334604 ns/iter 181847.39937436036 ns/iter 1.03
E2E_Evaluator_cql2 214248.34778622253 ns/iter 212886.1939116709 ns/iter 1.01
E2E_Evaluator_cspell 593213.2969958577 ns/iter 584018.3701842643 ns/iter 1.02
E2E_Evaluator_cypress 191758.88121245021 ns/iter 193297.7731301868 ns/iter 0.99
E2E_Evaluator_deno 327726.64058106195 ns/iter 317963.1501849159 ns/iter 1.03
E2E_Evaluator_dependabot 328525.95870485227 ns/iter 332220.5854701178 ns/iter 0.99
E2E_Evaluator_draft_04 9938397.573528297 ns/iter 10016647.718749994 ns/iter 0.99
E2E_Evaluator_fabric_mod 685024.8966861417 ns/iter 678052.3027614247 ns/iter 1.01
E2E_Evaluator_geojson 17598753.66666655 ns/iter 17230260.85366056 ns/iter 1.02
E2E_Evaluator_gitpod_configuration 241300.6686186772 ns/iter 235112.75000000763 ns/iter 1.03
E2E_Evaluator_helm_chart_lock 316826.4570523769 ns/iter 318092.992763434 ns/iter 1.00
E2E_Evaluator_importmap 51728.21233480325 ns/iter 50950.02077064445 ns/iter 1.02
E2E_Evaluator_jasmine 106498.06435493019 ns/iter 105865.13667766817 ns/iter 1.01
E2E_Evaluator_jshintrc 1198012.8051280377 ns/iter 1203612.65694719 ns/iter 1.00
E2E_Evaluator_jsconfig 428262.92279418046 ns/iter 422582.31585299224 ns/iter 1.01
E2E_Evaluator_krakend 213574.1233587743 ns/iter 207224.80660514455 ns/iter 1.03
E2E_Evaluator_lazygit 151168.27552113263 ns/iter 147776.59827626072 ns/iter 1.02
E2E_Evaluator_lerna 136492.83489829506 ns/iter 138016.44192069845 ns/iter 0.99
E2E_Evaluator_nest_cli 185653.90928555524 ns/iter 189532.11701848634 ns/iter 0.98
E2E_Evaluator_omc 19498.622632723207 ns/iter 18369.67896873605 ns/iter 1.06
E2E_Evaluator_omnisharp 625955.7654214409 ns/iter 616918.6800699682 ns/iter 1.01
E2E_Evaluator_openapi 10469251.808217451 ns/iter 9814189.465755153 ns/iter 1.07
E2E_Evaluator_pre_commit_hooks 490891.681149212 ns/iter 482999.38286116073 ns/iter 1.02
E2E_Evaluator_pulumi 681692.7926949488 ns/iter 690204.6792453082 ns/iter 0.99
E2E_Evaluator_semantic_release 104386.47551528127 ns/iter 102216.5188855226 ns/iter 1.02
E2E_Evaluator_stale 151198.7664952963 ns/iter 149455.4061969462 ns/iter 1.01
E2E_Evaluator_stylecop 306703.73722623655 ns/iter 288247.8923894788 ns/iter 1.06
E2E_Evaluator_tmuxinator 99819.78790035693 ns/iter 99063.9679369869 ns/iter 1.01
E2E_Evaluator_ui5 544650.5105058276 ns/iter 522542.6353550082 ns/iter 1.04
E2E_Evaluator_ui5_manifest 2668168.7680608877 ns/iter 2609686.0846153577 ns/iter 1.02
E2E_Evaluator_unreal_engine_uproject 428152.6627977445 ns/iter 435708.3910336335 ns/iter 0.98
E2E_Evaluator_users_array 580709.0216125423 ns/iter 580214.6310844674 ns/iter 1.00
E2E_Evaluator_vercel 329383.0945626003 ns/iter 316735.4833183748 ns/iter 1.04
E2E_Evaluator_yamllint 8987.471751121533 ns/iter 8630.21403300189 ns/iter 1.04
Micro_Draft4_Meta_1_No_Callback 194.0499428970147 ns/iter 195.868628981265 ns/iter 0.99
Micro_Draft4_Required_Properties 800.6392705133323 ns/iter 796.9447084451712 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 25.081299715583175 ns/iter 23.22464988172612 ns/iter 1.08
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.54637008010211 ns/iter 11.531256134312352 ns/iter 1.00
Micro_Draft4_Items_Schema 275.3888767754573 ns/iter 274.68614711835846 ns/iter 1.00
Micro_Draft4_Nested_Object 1.8670446642043266 ns/iter 1.79414950859428 ns/iter 1.04
Micro_Draft4_Properties_Triad_Optional 336.887424127134 ns/iter 323.5867369958254 ns/iter 1.04
Micro_Draft4_Properties_Triad_Closed 277.65008252204734 ns/iter 306.7075079545981 ns/iter 0.91
Micro_Draft4_Properties_Triad_Required 344.3057538598044 ns/iter 348.8926334718486 ns/iter 0.99
Micro_Draft4_Properties_Closed 57.31901669705711 ns/iter 57.309658575472575 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 14.01306294412552 ns/iter 13.96755682386976 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 155.63639950372718 ns/iter 155.6659714642761 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 11.537407159183445 ns/iter 11.525903294183388 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 32.95348348295764 ns/iter 32.981749886256395 ns/iter 1.00
Micro_Draft4_Nested_Oneof 58.88091087960544 ns/iter 58.8389918145443 ns/iter 1.00
Micro_Draft4_Short_Enum 12.15821908592221 ns/iter 9.97175260169451 ns/iter 1.22
Micro_Draft4_Long_Enum 16.09634292638607 ns/iter 14.650534578206585 ns/iter 1.10
Micro_Draft4_Long_Enum_Short_Strings 12.14584443985536 ns/iter 9.971100055161633 ns/iter 1.22
Micro_Draft4_Type_Object 3.4270983454678188 ns/iter 3.430473026294138 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2401377.20962184 ns/iter 2358714.5084171295 ns/iter 1.02
Micro_Draft4_Compile_Ref_Many_Nested 1731415.1940298919 ns/iter 1714649.5207829222 ns/iter 1.01
Micro_Draft4_Compile_Wrap 2383267.804794766 ns/iter 2355611.84175093 ns/iter 1.01
Micro_Draft6_Property_Names 123.26834029752311 ns/iter 137.47932984198087 ns/iter 0.90
Micro_Draft6_Compile_FHIR 14964735532.99984 ns/iter 14442920303.999926 ns/iter 1.04
Micro_Draft7_If_Then_Else 24.339408463344775 ns/iter 24.009437569684902 ns/iter 1.01
Micro_2019_09_Unevaluated_Properties 27.823471614885587 ns/iter 26.962875817689493 ns/iter 1.03
Micro_2019_09_Compile_Wrap 308604040.99996686 ns/iter 294200171.9999325 ns/iter 1.05
Micro_2020_12_Dynamic_Ref 233.16074356946558 ns/iter 234.33623086717182 ns/iter 0.99
Micro_2020_12_Dynamic_Ref_Single 3.4287746135820845 ns/iter 3.427948869803089 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1098.1613371707017 ns/iter 1124.0518846549876 ns/iter 0.98
Micro_2020_12_Simple_Output_Annotations 112783.52374860705 ns/iter 102743.66573241417 ns/iter 1.10
Micro_2020_12_Compile_NonCircular_Shared_Refs 1048138.2529940287 ns/iter 1036010.4697191132 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric 8420.349926472469 ns/iter 8200.659244749364 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 178937.8774209735 ns/iter 173996.17020750634 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 23213.282646873664 ns/iter 22877.10845139221 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 166.45484730077587 ns/iter 142.24616843615752 ns/iter 1.17
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4516.64956859184 ns/iter 4273.528375595556 ns/iter 1.06
Alterschema_Check_Readibility_ISO_Language_Set_3 369120684.9999844 ns/iter 369766489.49996614 ns/iter 1.00
Alterschema_Check_Readibility_OMC 85755400.12498096 ns/iter 84150166.99999 ns/iter 1.02
Alterschema_Check_Readibility_KrakenD 1223297336.999849 ns/iter 1174369705.0001173 ns/iter 1.04
Alterschema_Apply_Readibility_KrakenD 121795383375.00026 ns/iter 118479401916.99991 ns/iter 1.03
Alterschema_Check_Invalid_External_Refs 304496029.500001 ns/iter 304948371.0000231 ns/iter 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: 51e649b Previous: 1dc7105 Ratio
E2E_Evaluator_adaptivecard 119754 ns 116044 ns 1.03
E2E_Evaluator_ansible-meta 527807 ns 518158 ns 1.02
E2E_Evaluator_aws-cdk 143418 ns 146815 ns 0.98
E2E_Evaluator_babelrc 350021 ns 353804 ns 0.99
E2E_Evaluator_cerebrum-criminal-case 2556857 ns 2467911 ns 1.04
E2E_Evaluator_clang-format 262682 ns 264040 ns 0.99
E2E_Evaluator_cmake-presets 18472100 ns 18409293 ns 1.00
E2E_Evaluator_code-climate 509666 ns 506138 ns 1.01
E2E_Evaluator_cql2 1210083 ns 1218319 ns 0.99
E2E_Evaluator_cspell 1517895 ns 1481302 ns 1.02
E2E_Evaluator_cypress 778360 ns 767365 ns 1.01
E2E_Evaluator_deno 1040025 ns 1044859 ns 1.00
E2E_Evaluator_dependabot 1096347 ns 1096149 ns 1.00
E2E_Evaluator_draft-04 22340285 ns 23692315 ns 0.94
E2E_Evaluator_fabric-mod 2389480 ns 2417614 ns 0.99
E2E_Evaluator_geojson 27123640 ns 25035426 ns 1.08
E2E_Evaluator_gitpod-configuration 736568 ns 739667 ns 1.00
E2E_Evaluator_helm-chart-lock 996280 ns 989430 ns 1.01
E2E_Evaluator_importmap 273851 ns 279264 ns 0.98
E2E_Evaluator_jasmine 296457 ns 305814 ns 0.97
E2E_Evaluator_jsconfig 1288018 ns 1249845 ns 1.03
E2E_Evaluator_jshintrc 2832807 ns 2794461 ns 1.01
E2E_Evaluator_krakend 708650 ns 677175 ns 1.05
E2E_Evaluator_lazygit 518599 ns 510843 ns 1.02
E2E_Evaluator_lerna 472266 ns 474583 ns 1.00
E2E_Evaluator_nest-cli 602870 ns 606921 ns 0.99
E2E_Evaluator_omc 93856 ns 94019 ns 1.00
E2E_Evaluator_omnisharp 1435986 ns 1418697 ns 1.01
E2E_Evaluator_openapi 25863516 ns 25818560 ns 1.00
E2E_Evaluator_pre-commit-hooks 2036865 ns 2045791 ns 1.00
E2E_Evaluator_pulumi 1948620 ns 1921012 ns 1.01
E2E_Evaluator_semantic-release 254203 ns 262668 ns 0.97
E2E_Evaluator_stale 397638 ns 407074 ns 0.98
E2E_Evaluator_stylecop 1231782 ns 1240364 ns 0.99
E2E_Evaluator_tmuxinator 232914 ns 235185 ns 0.99
E2E_Evaluator_ui5 2216925 ns 2314729 ns 0.96
E2E_Evaluator_ui5-manifest 11131893 ns 13831431 ns 0.80
E2E_Evaluator_unreal-engine-uproject 1511747 ns 1567038 ns 0.96
E2E_Evaluator_users-array 2558086 ns 2776398 ns 0.92
E2E_Evaluator_vercel 1020704 ns 1029211 ns 0.99
E2E_Evaluator_yamllint 25809 ns 25987 ns 0.99

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit 18385a8 into main Jun 22, 2026
14 checks passed
@jviotti jviotti deleted the annotations-whitelist branch June 22, 2026 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant