Skip to content

Fix $id bug on Draft 6 canonicalizer#710

Merged
jviotti merged 1 commit intomainfrom
canonical-draft6-bugs
Apr 13, 2026
Merged

Fix $id bug on Draft 6 canonicalizer#710
jviotti merged 1 commit intomainfrom
canonical-draft6-bugs

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented Apr 13, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@augmentcode
Copy link
Copy Markdown

augmentcode bot commented Apr 13, 2026

🤖 Augment PR Summary

Summary: Fixes Draft-06 canonicalization losing the schema identifier when rewriting schemas into an allOf structure.

Changes:

  • TypeWithApplicatorToAllOf: preserves $id when extracting “typed” keywords and when rebuilding the top-level schema object.
  • EnumWithType: in Draft-06, treats integral numeric values (e.g. 3.0) as compatible with type: "integer" for enum/type redundancy checks.
  • Adds Draft-06 canonicalizer regression tests covering $id preservation, integer enums with integral reals, const/type incompatibilities, and a few additional normalization behaviors.

Technical Notes: The updated enum/type logic aligns with existing Draft-06 “integral real” handling used by other canonicalizer rules (e.g., enum filtering/unsatisfiable checks).

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 3 files

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="test/alterschema/alterschema_canonicalize_draft6_test.cc">

<violation number="1" location="test/alterschema/alterschema_canonicalize_draft6_test.cc:4488">
P2: `contains: false` makes the array schema unsatisfiable, so this test should expect `false` instead of preserving the keyword.</violation>
</file>

Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.

"not": { "pattern": "^admin" }
})JSON");

const auto expected = sourcemeta::core::parse_json(R"JSON({
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai bot Apr 13, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2: contains: false makes the array schema unsatisfiable, so this test should expect false instead of preserving the keyword.

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/alterschema/alterschema_canonicalize_draft6_test.cc, line 4488:

<comment>`contains: false` makes the array schema unsatisfiable, so this test should expect `false` instead of preserving the keyword.</comment>

<file context>
@@ -4476,3 +4476,192 @@ TEST_F(CanonicalizerDraft6Test, enum_assertion_uniqueItems_wrapped) {
+    "not": { "pattern": "^admin" }
+  })JSON");
+
+  const auto expected = sourcemeta::core::parse_json(R"JSON({
+    "$schema": "http://json-schema.org/draft-06/schema#",
+    "$id": "http://example.com/schema",
</file context>
Fix with Cubic

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: 9ebc1df Previous: 7630451 Ratio
E2E_Compiler_adaptivecard 59532652.6000008 ns/iter 62035399.79999846 ns/iter 0.96
E2E_Compiler_ansible_meta 25709528.481482062 ns/iter 28747171.458334718 ns/iter 0.89
E2E_Compiler_aws_cdk 336659.7836676236 ns/iter 381583.48717950605 ns/iter 0.88
E2E_Compiler_babelrc 2275962.387622034 ns/iter 2577171.382352779 ns/iter 0.88
E2E_Compiler_clang_format 16185824.720929928 ns/iter 18324333.815790422 ns/iter 0.88
E2E_Compiler_cmake_presets 23520588.83333446 ns/iter 25480622.925926954 ns/iter 0.92
E2E_Compiler_code_climate 2305145.496710506 ns/iter 2564379.1911763255 ns/iter 0.90
E2E_Compiler_cql2 11721094.983334031 ns/iter 12806991.636364274 ns/iter 0.92
E2E_Compiler_cspell 20688482.47058701 ns/iter 22595010.096773833 ns/iter 0.92
E2E_Compiler_cypress 3497773.4848485976 ns/iter 3883642.7499998333 ns/iter 0.90
E2E_Compiler_deno 6653852.358490526 ns/iter 7759784.888888691 ns/iter 0.86
E2E_Compiler_dependabot 3450431.303921489 ns/iter 3915924.9664803664 ns/iter 0.88
E2E_Compiler_draft_04 2405087.1374569885 ns/iter 2692565.0076923203 ns/iter 0.89
E2E_Compiler_fabric_mod 4252658.957575546 ns/iter 4754404.891156552 ns/iter 0.89
E2E_Compiler_geojson 20133674.88571508 ns/iter 21896545.59374965 ns/iter 0.92
E2E_Compiler_gitpod_configuration 4336762.608695594 ns/iter 4919601.901408569 ns/iter 0.88
E2E_Compiler_helm_chart_lock 612691.5993000655 ns/iter 711295.605076095 ns/iter 0.86
E2E_Compiler_importmap 252875.29764917592 ns/iter 287626.4525486998 ns/iter 0.88
E2E_Compiler_jasmine 1217116.550347224 ns/iter 1363525.7299413034 ns/iter 0.89
E2E_Compiler_jshintrc 3735188.295698902 ns/iter 4364598.114649736 ns/iter 0.86
E2E_Compiler_jsconfig 18790595.756756276 ns/iter 21648377.562499378 ns/iter 0.87
E2E_Compiler_krakend 124130368.50000481 ns/iter 136840548.99999863 ns/iter 0.91
E2E_Compiler_lazygit 30033806.913044594 ns/iter 33231600.238092966 ns/iter 0.90
E2E_Compiler_lerna 1409963.506048366 ns/iter 1601980.394077512 ns/iter 0.88
E2E_Compiler_nest_cli 6521516.555555654 ns/iter 7416152.202127473 ns/iter 0.88
E2E_Compiler_omc 145632610.4000027 ns/iter 150842348.20000118 ns/iter 0.97
E2E_Compiler_omnisharp 5805514.149999643 ns/iter 6714179.8725491995 ns/iter 0.86
E2E_Compiler_openapi 22195679.437500004 ns/iter 24887816.357142307 ns/iter 0.89
E2E_Compiler_pre_commit_hooks 4623171.019867542 ns/iter 5315377.992424215 ns/iter 0.87
E2E_Compiler_pulumi 3584907.564102662 ns/iter 4041763.265895905 ns/iter 0.89
E2E_Compiler_semantic_release 1418709.0526316706 ns/iter 1579577.8651686101 ns/iter 0.90
E2E_Compiler_stale 1374002.5705882383 ns/iter 1555339.5669642661 ns/iter 0.88
E2E_Compiler_stylecop 5245266.601503888 ns/iter 6215529.424778639 ns/iter 0.84
E2E_Compiler_tmuxinator 1714840.4362745238 ns/iter 1932481.6464087144 ns/iter 0.89
E2E_Compiler_ui5 43091527.624998346 ns/iter 46580286.53333304 ns/iter 0.93
E2E_Compiler_ui5_manifest 284158415.0000074 ns/iter 306960895.49999785 ns/iter 0.93
E2E_Compiler_unreal_engine_uproject 4042135.728323664 ns/iter 4612195.414473775 ns/iter 0.88
E2E_Compiler_vercel 11255923.238095311 ns/iter 12389404.649122313 ns/iter 0.91
E2E_Compiler_yamllint 309643.31119964755 ns/iter 349563.02795807616 ns/iter 0.89
E2E_Evaluator_adaptivecard 22119.248285804606 ns/iter 25438.210686482522 ns/iter 0.87
E2E_Evaluator_ansible_meta 200937.475409842 ns/iter 226753.63121501816 ns/iter 0.89
E2E_Evaluator_aws_cdk 43634.3867895164 ns/iter 50348.83844922842 ns/iter 0.87
E2E_Evaluator_babelrc 97733.65605274175 ns/iter 110799.99827424379 ns/iter 0.88
E2E_Evaluator_cerebrum_criminal_case 1258621.8339350706 ns/iter 1200193.1969177532 ns/iter 1.05
E2E_Evaluator_clang_format 121253.7787810389 ns/iter 123348.56623743608 ns/iter 0.98
E2E_Evaluator_cmake_presets 4456519.082802565 ns/iter 4215669.463855171 ns/iter 1.06
E2E_Evaluator_code_climate 180674.12153134236 ns/iter 175346.3593052054 ns/iter 1.03
E2E_Evaluator_cql2 183442.80764164097 ns/iter 210897.9044845785 ns/iter 0.87
E2E_Evaluator_cspell 543203.9677673127 ns/iter 557069.2095617627 ns/iter 0.98
E2E_Evaluator_cypress 180911.6609730839 ns/iter 191503.8835935344 ns/iter 0.94
E2E_Evaluator_deno 336233.84497606853 ns/iter 311229.5782011471 ns/iter 1.08
E2E_Evaluator_dependabot 412034.07265210216 ns/iter 411350.3512396573 ns/iter 1.00
E2E_Evaluator_draft_04 7987469.765957504 ns/iter 6978751.267326677 ns/iter 1.14
E2E_Evaluator_fabric_mod 679456.9063414955 ns/iter 715919.0449438164 ns/iter 0.95
E2E_Evaluator_geojson 16444997.613636373 ns/iter 15135218.195651937 ns/iter 1.09
E2E_Evaluator_gitpod_configuration 224951.53801547823 ns/iter 231017.73546512052 ns/iter 0.97
E2E_Evaluator_helm_chart_lock 383068.5929539429 ns/iter 352715.20983933186 ns/iter 1.09
E2E_Evaluator_importmap 33715.78460947442 ns/iter 46901.284454912326 ns/iter 0.72
E2E_Evaluator_jasmine 98085.12570303888 ns/iter 121384.21803731589 ns/iter 0.81
E2E_Evaluator_jshintrc 1190521.3327645236 ns/iter 1201967.775300171 ns/iter 0.99
E2E_Evaluator_jsconfig 392092.5411303881 ns/iter 421156.56630169344 ns/iter 0.93
E2E_Evaluator_krakend 209785.33695334088 ns/iter 201240.24803493638 ns/iter 1.04
E2E_Evaluator_lazygit 137831.28250147522 ns/iter 146875.5483532671 ns/iter 0.94
E2E_Evaluator_lerna 134452.58233009023 ns/iter 140844.46625891546 ns/iter 0.95
E2E_Evaluator_nest_cli 178042.4820747498 ns/iter 180734.8194159816 ns/iter 0.99
E2E_Evaluator_omc 17531.987088378475 ns/iter 19687.038710958874 ns/iter 0.89
E2E_Evaluator_omnisharp 552550.314829514 ns/iter 611586.3161120784 ns/iter 0.90
E2E_Evaluator_openapi 14514894.729166152 ns/iter 12829614.886793436 ns/iter 1.13
E2E_Evaluator_pre_commit_hooks 484940.8605135334 ns/iter 472112.8276324097 ns/iter 1.03
E2E_Evaluator_pulumi 725674.7112970805 ns/iter 707038.0315361401 ns/iter 1.03
E2E_Evaluator_semantic_release 82952.64416434476 ns/iter 100514.6326530522 ns/iter 0.83
E2E_Evaluator_stale 141914.6672805375 ns/iter 148847.79055921562 ns/iter 0.95
E2E_Evaluator_stylecop 279622.5168269281 ns/iter 281508.1598228516 ns/iter 0.99
E2E_Evaluator_tmuxinator 86931.30776867723 ns/iter 95765.68743109456 ns/iter 0.91
E2E_Evaluator_ui5 458257.30839297816 ns/iter 497052.78627592814 ns/iter 0.92
E2E_Evaluator_ui5_manifest 2537442.5412185597 ns/iter 2518212.0618183035 ns/iter 1.01
E2E_Evaluator_unreal_engine_uproject 428858.6642291036 ns/iter 420309.8880145194 ns/iter 1.02
E2E_Evaluator_vercel 329555.2983947126 ns/iter 319475.62862318556 ns/iter 1.03
E2E_Evaluator_yamllint 7974.454063336668 ns/iter 8611.66450264084 ns/iter 0.93
Micro_Draft4_Meta_1_No_Callback 189.62891489590822 ns/iter 193.54411122975654 ns/iter 0.98
Micro_Draft4_Required_Properties 816.3073510380235 ns/iter 796.5924841739501 ns/iter 1.02
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.748282469218417 ns/iter 22.74280680599984 ns/iter 0.96
Micro_Draft4_Few_Optional_Properties_Minimal_Match 10.023468868721059 ns/iter 10.902387530970117 ns/iter 0.92
Micro_Draft4_Items_Schema 255.4242542001956 ns/iter 277.9902062028279 ns/iter 0.92
Micro_Draft4_Nested_Object 1.1529486135506797 ns/iter 1.8117895965030757 ns/iter 0.64
Micro_Draft4_Properties_Triad_Optional 302.2409446028032 ns/iter 318.11174259661476 ns/iter 0.95
Micro_Draft4_Properties_Triad_Closed 252.73949049655025 ns/iter 262.98077576398646 ns/iter 0.96
Micro_Draft4_Properties_Triad_Required 320.0228599801571 ns/iter 329.0854677215614 ns/iter 0.97
Micro_Draft4_Properties_Closed 53.8441619311995 ns/iter 54.183886274422505 ns/iter 0.99
Micro_Draft4_Non_Recursive_Ref 9.879530136403748 ns/iter 11.929263395449777 ns/iter 0.83
Micro_Draft4_Pattern_Properties_True 123.36513033948646 ns/iter 158.40859790786038 ns/iter 0.78
Micro_Draft4_Ref_To_Single_Property 9.96561633675584 ns/iter 10.898403973365541 ns/iter 0.91
Micro_Draft4_Additional_Properties_Type 18.518835331550257 ns/iter 21.67538943045316 ns/iter 0.85
Micro_Draft4_Nested_Oneof 44.756115730786036 ns/iter 58.12565420835647 ns/iter 0.77
Micro_Draft4_Short_Enum 10.3945332279288 ns/iter 11.828088132070556 ns/iter 0.88
Micro_Draft4_Long_Enum 10.651202581790047 ns/iter 14.022859099319843 ns/iter 0.76
Micro_Draft4_Long_Enum_Short_Strings 10.442226147425647 ns/iter 11.83063117100082 ns/iter 0.88
Micro_Draft4_Type_Object 2.886566949295394 ns/iter 3.424987346322235 ns/iter 0.84
Micro_Draft4_Ref_Single_100 2110345.8975904873 ns/iter 2378983.435374214 ns/iter 0.89
Micro_Draft4_Compile_Ref_Many_Nested 1544489.1721853698 ns/iter 1732065.1305417954 ns/iter 0.89
Micro_Draft4_Compile_Wrap 2118761.7112463154 ns/iter 2364841.7804054134 ns/iter 0.90
Micro_Draft6_Property_Names 112.26633989601181 ns/iter 118.93191597064649 ns/iter 0.94
Micro_Draft6_Compile_FHIR 17466746973 ns/iter 13718224948.000057 ns/iter 1.27
Micro_Draft7_If_Then_Else 20.56321413206122 ns/iter 22.803295969564445 ns/iter 0.90
Micro_2019_09_Unevaluated_Properties 23.783465948803908 ns/iter 28.92982195241245 ns/iter 0.82
Micro_2019_09_Compile_Wrap 275532567.999979 ns/iter 290448418.0000395 ns/iter 0.95
Micro_2020_12_Dynamic_Ref 297.54213446196087 ns/iter 231.3198513067471 ns/iter 1.29
Micro_2020_12_Dynamic_Ref_Single 3.071321680904744 ns/iter 3.426683124935694 ns/iter 0.90
Micro_2020_12_Simple_Output_Mask 59870.2886456877 ns/iter 65221.98084574321 ns/iter 0.92
Micro_2020_12_Simple_Output_Annotations 96132.96009940599 ns/iter 104353.45635505294 ns/iter 0.92
Micro_2020_12_Compile_NonCircular_Shared_Refs 989392.6364922606 ns/iter 1101445.8803149357 ns/iter 0.90
Micro_2020_12_Exhaustive_Deep_Numeric 8341.72664464143 ns/iter 8080.327217545411 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 149455.03343983713 ns/iter 173565.3997017181 ns/iter 0.86
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 21150.321866134982 ns/iter 22167.153057337397 ns/iter 0.95
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 130.27345661274452 ns/iter 145.0539626221101 ns/iter 0.90
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 3741.3194544110384 ns/iter 4218.208145477433 ns/iter 0.89
Alterschema_Check_Readibility_ISO_Language_Set_3 313303391.99996614 ns/iter 341331512.50000536 ns/iter 0.92
Alterschema_Check_Readibility_OMC 88005991.49999756 ns/iter 82989115.87500867 ns/iter 1.06
Alterschema_Check_Readibility_KrakenD 1394558720.999953 ns/iter 1169646550.9999144 ns/iter 1.19
Alterschema_Apply_Readibility_KrakenD 138246393322.00003 ns/iter 116841824753.99995 ns/iter 1.18
Alterschema_Check_Invalid_External_Refs 224279874.66668734 ns/iter 291070565.0000409 ns/iter 0.77

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: 9ebc1df Previous: 7630451 Ratio
E2E_Evaluator_adaptivecard 112134 ns 116393 ns 0.96
E2E_Evaluator_ansible-meta 574745 ns 581156 ns 0.99
E2E_Evaluator_aws-cdk 142044 ns 137735 ns 1.03
E2E_Evaluator_babelrc 458566 ns 318829 ns 1.44
E2E_Evaluator_cerebrum-criminal-case 2658216 ns 2635515 ns 1.01
E2E_Evaluator_clang-format 346068 ns 276536 ns 1.25
E2E_Evaluator_cmake-presets 20301530 ns 19175038 ns 1.06
E2E_Evaluator_code-climate 468345 ns 435420 ns 1.08
E2E_Evaluator_cql2 1139202 ns 1162491 ns 0.98
E2E_Evaluator_cspell 1944078 ns 1553959 ns 1.25
E2E_Evaluator_cypress 1102713 ns 837040 ns 1.32
E2E_Evaluator_deno 1160786 ns 1071668 ns 1.08
E2E_Evaluator_dependabot 1162549 ns 1086402 ns 1.07
E2E_Evaluator_draft-04 21356767 ns 20556440 ns 1.04
E2E_Evaluator_fabric-mod 2631865 ns 2502293 ns 1.05
E2E_Evaluator_geojson 25668688 ns 20610050 ns 1.25
E2E_Evaluator_gitpod-configuration 886947 ns 755534 ns 1.17
E2E_Evaluator_helm-chart-lock 1074210 ns 1034801 ns 1.04
E2E_Evaluator_importmap 335271 ns 284896 ns 1.18
E2E_Evaluator_jasmine 341438 ns 293801 ns 1.16
E2E_Evaluator_jsconfig 1815037 ns 1335571 ns 1.36
E2E_Evaluator_jshintrc 3566387 ns 3084641 ns 1.16
E2E_Evaluator_krakend 703022 ns 775212 ns 0.91
E2E_Evaluator_lazygit 569403 ns 560463 ns 1.02
E2E_Evaluator_lerna 514560 ns 464981 ns 1.11
E2E_Evaluator_nest-cli 743823 ns 635361 ns 1.17
E2E_Evaluator_omc 80739 ns 85202 ns 0.95
E2E_Evaluator_omnisharp 1804849 ns 1546527 ns 1.17
E2E_Evaluator_openapi 34434475 ns 36978719 ns 0.93
E2E_Evaluator_pre-commit-hooks 2171908 ns 1972670 ns 1.10
E2E_Evaluator_pulumi 2270854 ns 1979368 ns 1.15
E2E_Evaluator_semantic-release 309927 ns 268974 ns 1.15
E2E_Evaluator_stale 487274 ns 433759 ns 1.12
E2E_Evaluator_stylecop 1217303 ns 1236338 ns 0.98
E2E_Evaluator_tmuxinator 287092 ns 218772 ns 1.31
E2E_Evaluator_ui5 2117258 ns 2253997 ns 0.94
E2E_Evaluator_ui5-manifest 10343100 ns 11099979 ns 0.93
E2E_Evaluator_unreal-engine-uproject 1696272 ns 1494868 ns 1.13
E2E_Evaluator_vercel 1122987 ns 1050590 ns 1.07
E2E_Evaluator_yamllint 24289 ns 24836 ns 0.98

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: 9ebc1df Previous: 7630451 Ratio
E2E_Compiler_adaptivecard 77053865.77778326 ns/iter 72295275.9999913 ns/iter 1.07
E2E_Compiler_ansible_meta 29730786.217392646 ns/iter 28358672.607140534 ns/iter 1.05
E2E_Compiler_aws_cdk 395110.18194317276 ns/iter 306732.75608615327 ns/iter 1.29
E2E_Compiler_babelrc 3254793.067307778 ns/iter 3789095.5355649022 ns/iter 0.86
E2E_Compiler_clang_format 21880601.833332647 ns/iter 22576341.346153256 ns/iter 0.97
E2E_Compiler_cmake_presets 36876975.89473852 ns/iter 37122313.70588249 ns/iter 0.99
E2E_Compiler_code_climate 2633410.21290319 ns/iter 2655671.5116277505 ns/iter 0.99
E2E_Compiler_cql2 14311152.08333343 ns/iter 13885349.86206823 ns/iter 1.03
E2E_Compiler_cspell 24329446.428570885 ns/iter 24604790.322578378 ns/iter 0.99
E2E_Compiler_cypress 4638253.946745997 ns/iter 4481262.367741487 ns/iter 1.04
E2E_Compiler_deno 7503561.731481425 ns/iter 7827554.07142791 ns/iter 0.96
E2E_Compiler_dependabot 4830664.106145007 ns/iter 4429774.403314499 ns/iter 1.09
E2E_Compiler_draft_04 2185452.810240815 ns/iter 2487990.6072725467 ns/iter 0.88
E2E_Compiler_fabric_mod 4217272.529069495 ns/iter 4603148.538960825 ns/iter 0.92
E2E_Compiler_geojson 26163090.517241407 ns/iter 33242811.680001978 ns/iter 0.79
E2E_Compiler_gitpod_configuration 4672347.327999887 ns/iter 5439711.831775079 ns/iter 0.86
E2E_Compiler_helm_chart_lock 585143.7224668964 ns/iter 709412.7503851843 ns/iter 0.82
E2E_Compiler_importmap 229505.36074765475 ns/iter 330509.08509739244 ns/iter 0.69
E2E_Compiler_jasmine 1294783.4511040598 ns/iter 1760229.1288014958 ns/iter 0.74
E2E_Compiler_jshintrc 4239151.076023375 ns/iter 4225253.7120418465 ns/iter 1.00
E2E_Compiler_jsconfig 23209609.84848446 ns/iter 22323527.787879165 ns/iter 1.04
E2E_Compiler_krakend 170600549.99999467 ns/iter 175066708.25000015 ns/iter 0.97
E2E_Compiler_lazygit 49951495.33333334 ns/iter 44054188.93333414 ns/iter 1.13
E2E_Compiler_lerna 1899869.4772726526 ns/iter 1866521.8896246445 ns/iter 1.02
E2E_Compiler_nest_cli 7168078.25675595 ns/iter 8550681.553571288 ns/iter 0.84
E2E_Compiler_omc 207016291.66664287 ns/iter 240359624.99999642 ns/iter 0.86
E2E_Compiler_omnisharp 6327787.735849683 ns/iter 8799788.310344495 ns/iter 0.72
E2E_Compiler_openapi 24381003.787876774 ns/iter 31671947.51851757 ns/iter 0.77
E2E_Compiler_pre_commit_hooks 4520634.803921608 ns/iter 5156755.159292169 ns/iter 0.88
E2E_Compiler_pulumi 3760181.912194617 ns/iter 4687430.013072105 ns/iter 0.80
E2E_Compiler_semantic_release 1381812.5361345252 ns/iter 1782733.7311232684 ns/iter 0.78
E2E_Compiler_stale 1362869.231329751 ns/iter 1637274.2830189944 ns/iter 0.83
E2E_Compiler_stylecop 5640917.6090223165 ns/iter 7689516.181818542 ns/iter 0.73
E2E_Compiler_tmuxinator 1924400.222760409 ns/iter 2239536.372928231 ns/iter 0.86
E2E_Compiler_ui5 74674534.09091459 ns/iter 78362074.1111185 ns/iter 0.95
E2E_Compiler_ui5_manifest 464245645.9999949 ns/iter 482910583.50002915 ns/iter 0.96
E2E_Compiler_unreal_engine_uproject 4778166.947019431 ns/iter 5776966.101695114 ns/iter 0.83
E2E_Compiler_vercel 15387802.481480204 ns/iter 16610613.70833276 ns/iter 0.93
E2E_Compiler_yamllint 262831.5698650092 ns/iter 355168.21602478804 ns/iter 0.74
E2E_Evaluator_adaptivecard 22326.827292819165 ns/iter 23822.37491737695 ns/iter 0.94
E2E_Evaluator_ansible_meta 235821.95047318854 ns/iter 213479.71949604797 ns/iter 1.10
E2E_Evaluator_aws_cdk 34575.38612655317 ns/iter 43780.30705639246 ns/iter 0.79
E2E_Evaluator_babelrc 82387.27344410171 ns/iter 93246.26688452596 ns/iter 0.88
E2E_Evaluator_cerebrum_criminal_case 896585.9278689214 ns/iter 1096337.1896814532 ns/iter 0.82
E2E_Evaluator_clang_format 106242.04009434202 ns/iter 102676.83544664645 ns/iter 1.03
E2E_Evaluator_cmake_presets 4218509.776536437 ns/iter 4238045.321637416 ns/iter 1.00
E2E_Evaluator_code_climate 139662.20167064696 ns/iter 145061.35760133743 ns/iter 0.96
E2E_Evaluator_cql2 149613.27742407535 ns/iter 227554.19152236858 ns/iter 0.66
E2E_Evaluator_cspell 434107.9239065376 ns/iter 529679.779479387 ns/iter 0.82
E2E_Evaluator_cypress 168267.47341002637 ns/iter 217038.21937550564 ns/iter 0.78
E2E_Evaluator_deno 232294.98489530993 ns/iter 258363.49153765582 ns/iter 0.90
E2E_Evaluator_dependabot 413931.8705994021 ns/iter 377107.3492462325 ns/iter 1.10
E2E_Evaluator_draft_04 6229041.357664423 ns/iter 5129588.913386515 ns/iter 1.21
E2E_Evaluator_fabric_mod 616332.4715614924 ns/iter 494831.26039537543 ns/iter 1.25
E2E_Evaluator_geojson 15202064.315788353 ns/iter 11672868.534482216 ns/iter 1.30
E2E_Evaluator_gitpod_configuration 203225.76007108574 ns/iter 167374.79532167257 ns/iter 1.21
E2E_Evaluator_helm_chart_lock 286698.88412986463 ns/iter 219953.31027440977 ns/iter 1.30
E2E_Evaluator_importmap 35898.312622461446 ns/iter 28302.786147643794 ns/iter 1.27
E2E_Evaluator_jasmine 95405.31244800345 ns/iter 81514.41898788557 ns/iter 1.17
E2E_Evaluator_jshintrc 1147978.2196970794 ns/iter 849161.3945410132 ns/iter 1.35
E2E_Evaluator_jsconfig 324568.9427498247 ns/iter 275113.40977151715 ns/iter 1.18
E2E_Evaluator_krakend 121778.0377757963 ns/iter 117669.25517712501 ns/iter 1.03
E2E_Evaluator_lazygit 91802.92652124433 ns/iter 96317.14601308726 ns/iter 0.95
E2E_Evaluator_lerna 105280.62735643264 ns/iter 110964.89710446856 ns/iter 0.95
E2E_Evaluator_nest_cli 116249.60124243394 ns/iter 113395.32564141609 ns/iter 1.03
E2E_Evaluator_omc 13298.298526079494 ns/iter 13431.633544166474 ns/iter 0.99
E2E_Evaluator_omnisharp 417310.8400239429 ns/iter 390357.0863228386 ns/iter 1.07
E2E_Evaluator_openapi 8027216.482758732 ns/iter 7131025.390804255 ns/iter 1.13
E2E_Evaluator_pre_commit_hooks 321297.25986394123 ns/iter 311983.2669924897 ns/iter 1.03
E2E_Evaluator_pulumi 519071.27062931855 ns/iter 460335.8104358854 ns/iter 1.13
E2E_Evaluator_semantic_release 76884.87199021934 ns/iter 64889.063347173105 ns/iter 1.18
E2E_Evaluator_stale 109715.78210765067 ns/iter 106706.93065138548 ns/iter 1.03
E2E_Evaluator_stylecop 218245.90959179774 ns/iter 169799.92746612304 ns/iter 1.29
E2E_Evaluator_tmuxinator 79186.89963563802 ns/iter 64072.532300678366 ns/iter 1.24
E2E_Evaluator_ui5 476734.80142856576 ns/iter 301195.09141864465 ns/iter 1.58
E2E_Evaluator_ui5_manifest 1880934.1549295424 ns/iter 1441026.568825964 ns/iter 1.31
E2E_Evaluator_unreal_engine_uproject 300188.3395089647 ns/iter 302843.74533623195 ns/iter 0.99
E2E_Evaluator_vercel 229548.15263480283 ns/iter 214333.25553817424 ns/iter 1.07
E2E_Evaluator_yamllint 5375.166586756419 ns/iter 5322.4201724492195 ns/iter 1.01
Micro_Draft4_Meta_1_No_Callback 123.68895892547428 ns/iter 117.00504037234533 ns/iter 1.06
Micro_Draft4_Required_Properties 579.9859375258286 ns/iter 572.8293927628814 ns/iter 1.01
Micro_Draft4_Many_Optional_Properties_Minimal_Match 14.97378625244345 ns/iter 14.501941958710466 ns/iter 1.03
Micro_Draft4_Few_Optional_Properties_Minimal_Match 6.72860700994026 ns/iter 6.470763601053714 ns/iter 1.04
Micro_Draft4_Items_Schema 239.76707582530045 ns/iter 235.7020474436882 ns/iter 1.02
Micro_Draft4_Nested_Object 0.6395678874254311 ns/iter 0.6279601247264177 ns/iter 1.02
Micro_Draft4_Properties_Triad_Optional 199.99287624869712 ns/iter 183.20752933526825 ns/iter 1.09
Micro_Draft4_Properties_Triad_Closed 165.85645439427068 ns/iter 150.7479168611827 ns/iter 1.10
Micro_Draft4_Properties_Triad_Required 204.83312433298377 ns/iter 202.15112946231133 ns/iter 1.01
Micro_Draft4_Properties_Closed 35.22033533594568 ns/iter 34.09887787791834 ns/iter 1.03
Micro_Draft4_Non_Recursive_Ref 12.107347592205992 ns/iter 11.704055136467348 ns/iter 1.03
Micro_Draft4_Pattern_Properties_True 137.77817349800745 ns/iter 134.65662977909122 ns/iter 1.02
Micro_Draft4_Ref_To_Single_Property 6.87446274672986 ns/iter 6.467898644252196 ns/iter 1.06
Micro_Draft4_Additional_Properties_Type 24.28912650400133 ns/iter 23.518336034485905 ns/iter 1.03
Micro_Draft4_Nested_Oneof 38.48340434488681 ns/iter 37.928977884094714 ns/iter 1.01
Micro_Draft4_Short_Enum 4.666972470286035 ns/iter 4.468687451388084 ns/iter 1.04
Micro_Draft4_Long_Enum 9.618199869792743 ns/iter 9.0895603819931 ns/iter 1.06
Micro_Draft4_Long_Enum_Short_Strings 5.914919055774001 ns/iter 5.65914997773965 ns/iter 1.05
Micro_Draft4_Type_Object 2.128592265467463 ns/iter 2.0322194610247717 ns/iter 1.05
Micro_Draft4_Ref_Single_100 1666867.8229661835 ns/iter 1652101.881579152 ns/iter 1.01
Micro_Draft4_Compile_Ref_Many_Nested 1227117.7477795621 ns/iter 1118045.738782059 ns/iter 1.10
Micro_Draft4_Compile_Wrap 2054334.7650430517 ns/iter 1818863.4481865624 ns/iter 1.13
Micro_Draft6_Property_Names 100.73018322539257 ns/iter 86.96035949231617 ns/iter 1.16
Micro_Draft6_Compile_FHIR 13676364499.999863 ns/iter 6681233083.0000515 ns/iter 2.05
Micro_Draft7_If_Then_Else 22.775757556507145 ns/iter 16.656043579214995 ns/iter 1.37
Micro_2019_09_Unevaluated_Properties 33.933834884019014 ns/iter 24.374858483017864 ns/iter 1.39
Micro_2019_09_Compile_Wrap 409238791.9999965 ns/iter 261286194.66665745 ns/iter 1.57
Micro_2020_12_Dynamic_Ref 254.500337713843 ns/iter 169.97598590283494 ns/iter 1.50
Micro_2020_12_Dynamic_Ref_Single 2.5842069412342186 ns/iter 2.0192364892125676 ns/iter 1.28
Micro_2020_12_Simple_Output_Mask 67970.79776278704 ns/iter 59011.1258980655 ns/iter 1.15
Micro_2020_12_Simple_Output_Annotations 89858.14879391128 ns/iter 82088.41324849424 ns/iter 1.09
Micro_2020_12_Compile_NonCircular_Shared_Refs 956468.1372550243 ns/iter 733434.6209503876 ns/iter 1.30
Micro_2020_12_Exhaustive_Deep_Numeric 5483.08974659132 ns/iter 4865.350806169973 ns/iter 1.13
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 155240.49128306154 ns/iter 106172.44373576257 ns/iter 1.46
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 18546.669013121154 ns/iter 13243.332756192198 ns/iter 1.40
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 107.07484053819152 ns/iter 86.08880374086706 ns/iter 1.24
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 5481.216305270469 ns/iter 4412.115786823139 ns/iter 1.24
Alterschema_Check_Readibility_ISO_Language_Set_3 307108541.49992883 ns/iter 216598153.00002566 ns/iter 1.42
Alterschema_Check_Readibility_OMC 77238930.55554576 ns/iter 53057365.38460993 ns/iter 1.46
Alterschema_Check_Readibility_KrakenD 753310625.00004 ns/iter 545045834.0001205 ns/iter 1.38
Alterschema_Apply_Readibility_KrakenD 65068257250.00021 ns/iter 58250673624.99999 ns/iter 1.12
Alterschema_Check_Invalid_External_Refs 146438781.24996945 ns/iter 143550041.60001954 ns/iter 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: 9ebc1df Previous: 7630451 Ratio
E2E_Evaluator_adaptivecard 123724 ns 84269 ns 1.47
E2E_Evaluator_ansible-meta 436123 ns 379264 ns 1.15
E2E_Evaluator_aws-cdk 116164 ns 108423 ns 1.07
E2E_Evaluator_babelrc 317507 ns 287743 ns 1.10
E2E_Evaluator_cerebrum-criminal-case 2136929 ns 2070493 ns 1.03
E2E_Evaluator_clang-format 214465 ns 214832 ns 1.00
E2E_Evaluator_cmake-presets 12479174 ns 11533883 ns 1.08
E2E_Evaluator_code-climate 400564 ns 356261 ns 1.12
E2E_Evaluator_cql2 872499 ns 845022 ns 1.03
E2E_Evaluator_cspell 1439701 ns 1160464 ns 1.24
E2E_Evaluator_cypress 716054 ns 671847 ns 1.07
E2E_Evaluator_deno 902538 ns 754539 ns 1.20
E2E_Evaluator_dependabot 919181 ns 856670 ns 1.07
E2E_Evaluator_draft-04 15028551 ns 14446658 ns 1.04
E2E_Evaluator_fabric-mod 2139439 ns 1703148 ns 1.26
E2E_Evaluator_geojson 20929793 ns 20710453 ns 1.01
E2E_Evaluator_gitpod-configuration 671264 ns 597959 ns 1.12
E2E_Evaluator_helm-chart-lock 1073757 ns 981513 ns 1.09
E2E_Evaluator_importmap 224088 ns 215649 ns 1.04
E2E_Evaluator_jasmine 300405 ns 268732 ns 1.12
E2E_Evaluator_jsconfig 1423637 ns 1140115 ns 1.25
E2E_Evaluator_jshintrc 2899628 ns 2393309 ns 1.21
E2E_Evaluator_krakend 511874 ns 437006 ns 1.17
E2E_Evaluator_lazygit 409375 ns 336608 ns 1.22
E2E_Evaluator_lerna 383732 ns 360498 ns 1.06
E2E_Evaluator_nest-cli 539518 ns 556634 ns 0.97
E2E_Evaluator_omc 68091 ns 66938 ns 1.02
E2E_Evaluator_omnisharp 1279363 ns 1216879 ns 1.05
E2E_Evaluator_openapi 25469215 ns 23384200 ns 1.09
E2E_Evaluator_pre-commit-hooks 1642788 ns 1523252 ns 1.08
E2E_Evaluator_pulumi 1861649 ns 1653172 ns 1.13
E2E_Evaluator_semantic-release 223638 ns 214185 ns 1.04
E2E_Evaluator_stale 353747 ns 402092 ns 0.88
E2E_Evaluator_stylecop 879006 ns 832891 ns 1.06
E2E_Evaluator_tmuxinator 224521 ns 200069 ns 1.12
E2E_Evaluator_ui5 1719793 ns 1467167 ns 1.17
E2E_Evaluator_ui5-manifest 8989490 ns 7316825 ns 1.23
E2E_Evaluator_unreal-engine-uproject 1372580 ns 1300885 ns 1.06
E2E_Evaluator_vercel 967146 ns 822112 ns 1.18
E2E_Evaluator_yamllint 27863 ns 27917 ns 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: 9ebc1df Previous: 7630451 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 322811623.5000016 ns/iter 337518699.4999808 ns/iter 0.96
Alterschema_Check_Readibility_OMC 97914178.14283575 ns/iter 98517269.14286831 ns/iter 0.99
Alterschema_Check_Readibility_KrakenD 1556671154.0000143 ns/iter 1362882310.9999075 ns/iter 1.14
Alterschema_Apply_Readibility_KrakenD 144013292011.99997 ns/iter 131650171724.00008 ns/iter 1.09
Alterschema_Check_Invalid_External_Refs 253102746.66662738 ns/iter 302598173.5000869 ns/iter 0.84
Micro_2020_12_Dynamic_Ref 275.5492927928469 ns/iter 257.9541979222088 ns/iter 1.07
Micro_2020_12_Dynamic_Ref_Single 3.740134823526363 ns/iter 4.221438351378649 ns/iter 0.89
Micro_2020_12_Simple_Output_Mask 68734.78366005854 ns/iter 69675.67973725846 ns/iter 0.99
Micro_2020_12_Simple_Output_Annotations 107532.81942733709 ns/iter 108282.53015384129 ns/iter 0.99
Micro_2020_12_Compile_NonCircular_Shared_Refs 1104334.8960632237 ns/iter 1182769.1305085355 ns/iter 0.93
Micro_2020_12_Exhaustive_Deep_Numeric 8592.572067852443 ns/iter 7914.583310761518 ns/iter 1.09
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 141550.14988812225 ns/iter 168157.20438304087 ns/iter 0.84
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 24570.36239002757 ns/iter 26993.2959608458 ns/iter 0.91
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 139.76150853341167 ns/iter 133.1142847054579 ns/iter 1.05
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4498.359682192423 ns/iter 4383.651883774776 ns/iter 1.03
Micro_2019_09_Unevaluated_Properties 25.64307553554291 ns/iter 29.013581807264586 ns/iter 0.88
Micro_2019_09_Compile_Wrap 293010534.0000182 ns/iter 315080027.99989754 ns/iter 0.93
Micro_Draft7_If_Then_Else 22.158165205976392 ns/iter 25.079881170683702 ns/iter 0.88
Micro_Draft6_Property_Names 137.66191806676906 ns/iter 142.2559393279064 ns/iter 0.97
Micro_Draft6_Compile_FHIR 17910909575.999996 ns/iter 14551080979.000063 ns/iter 1.23
Micro_Draft4_Meta_1_No_Callback 172.57036344348225 ns/iter 172.3797441105047 ns/iter 1.00
Micro_Draft4_Required_Properties 772.6529368574907 ns/iter 860.3725721325231 ns/iter 0.90
Micro_Draft4_Many_Optional_Properties_Minimal_Match 24.07769804042805 ns/iter 21.769927327387652 ns/iter 1.11
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.806657118651959 ns/iter 12.672975066466053 ns/iter 0.93
Micro_Draft4_Items_Schema 276.30709594059175 ns/iter 317.4062824974263 ns/iter 0.87
Micro_Draft4_Nested_Object 2.0186633825885862 ns/iter 1.759086270071108 ns/iter 1.15
Micro_Draft4_Properties_Triad_Optional 325.55109826346063 ns/iter 517.4805002728937 ns/iter 0.63
Micro_Draft4_Properties_Triad_Closed 277.37614189176253 ns/iter 433.4985876579941 ns/iter 0.64
Micro_Draft4_Properties_Triad_Required 350.855839779734 ns/iter 540.8289138996787 ns/iter 0.65
Micro_Draft4_Properties_Closed 65.46593523331751 ns/iter 62.57625777402044 ns/iter 1.05
Micro_Draft4_Non_Recursive_Ref 8.566916302518006 ns/iter 9.03963127282036 ns/iter 0.95
Micro_Draft4_Pattern_Properties_True 177.47017935185812 ns/iter 198.52413917316133 ns/iter 0.89
Micro_Draft4_Ref_To_Single_Property 11.794739724403733 ns/iter 13.042777103874208 ns/iter 0.90
Micro_Draft4_Additional_Properties_Type 12.867950616391877 ns/iter 14.5877243883611 ns/iter 0.88
Micro_Draft4_Nested_Oneof 56.18542350545826 ns/iter 65.92057670019355 ns/iter 0.85
Micro_Draft4_Short_Enum 10.989458058057693 ns/iter 14.803254709785497 ns/iter 0.74
Micro_Draft4_Long_Enum 11.874837983522387 ns/iter 13.771201310971161 ns/iter 0.86
Micro_Draft4_Long_Enum_Short_Strings 10.963846525283994 ns/iter 14.806604781922253 ns/iter 0.74
Micro_Draft4_Type_Object 4.014169598832618 ns/iter 4.224989103842402 ns/iter 0.95
Micro_Draft4_Ref_Single_100 2275547.4527688483 ns/iter 2555631.3138685566 ns/iter 0.89
Micro_Draft4_Compile_Ref_Many_Nested 1681966.7259611038 ns/iter 1856356.33776554 ns/iter 0.91
Micro_Draft4_Compile_Wrap 2324263.2757480117 ns/iter 2680788.6503759692 ns/iter 0.87
E2E_Compiler_adaptivecard 63781547.36363616 ns/iter 65621658.3636251 ns/iter 0.97
E2E_Compiler_ansible_meta 27170014.6153867 ns/iter 31023745.43478301 ns/iter 0.88
E2E_Compiler_aws_cdk 369779.6181435448 ns/iter 400968.16580311285 ns/iter 0.92
E2E_Compiler_babelrc 2500569.5678576753 ns/iter 2816829.096774097 ns/iter 0.89
E2E_Compiler_clang_format 17714374.924997855 ns/iter 20097180.685713414 ns/iter 0.88
E2E_Compiler_cmake_presets 25260343.88888884 ns/iter 28160179.44000123 ns/iter 0.90
E2E_Compiler_code_climate 2526098.1438852614 ns/iter 2867921.8775509144 ns/iter 0.88
E2E_Compiler_cql2 13030269.830190966 ns/iter 14282252.551023405 ns/iter 0.91
E2E_Compiler_cspell 22145655.18750078 ns/iter 24839342.32142409 ns/iter 0.89
E2E_Compiler_cypress 3792910.461956096 ns/iter 4297628.580247088 ns/iter 0.88
E2E_Compiler_deno 7276956.614584643 ns/iter 8384755.698794417 ns/iter 0.87
E2E_Compiler_dependabot 3712922.196808798 ns/iter 4276326.243901933 ns/iter 0.87
E2E_Compiler_draft_04 2678258.3778629988 ns/iter 2964569.7500007497 ns/iter 0.90
E2E_Compiler_fabric_mod 4653112.655630036 ns/iter 5222245.977611848 ns/iter 0.89
E2E_Compiler_geojson 21785732.74999707 ns/iter 24499636.58620524 ns/iter 0.89
E2E_Compiler_gitpod_configuration 4786423.564627246 ns/iter 5368104.297710092 ns/iter 0.89
E2E_Compiler_helm_chart_lock 664732.4985782627 ns/iter 734995.8384050631 ns/iter 0.90
E2E_Compiler_importmap 284189.0826052418 ns/iter 300495.3435081662 ns/iter 0.95
E2E_Compiler_jasmine 1334979.6380953193 ns/iter 1460458.3117156776 ns/iter 0.91
E2E_Compiler_jshintrc 4131395.739644569 ns/iter 4710914.832215369 ns/iter 0.88
E2E_Compiler_jsconfig 20470117.799998533 ns/iter 23560929.03332865 ns/iter 0.87
E2E_Compiler_krakend 133211490.3999809 ns/iter 142786668.99999735 ns/iter 0.93
E2E_Compiler_lazygit 32245088.90909047 ns/iter 36404167.947358996 ns/iter 0.89
E2E_Compiler_lerna 1560987.1495537877 ns/iter 1745223.9108913748 ns/iter 0.89
E2E_Compiler_nest_cli 7129535.191919823 ns/iter 8082076.747126033 ns/iter 0.88
E2E_Compiler_omc 155127707.80001122 ns/iter 164968904.99996653 ns/iter 0.94
E2E_Compiler_omnisharp 6365025.396394844 ns/iter 7293306.9270841135 ns/iter 0.87
E2E_Compiler_openapi 24553513.86206844 ns/iter 27152949.423076767 ns/iter 0.90
E2E_Compiler_pre_commit_hooks 5058587.971013591 ns/iter 5842151.966667567 ns/iter 0.87
E2E_Compiler_pulumi 3951956.288135033 ns/iter 4420290.468354186 ns/iter 0.89
E2E_Compiler_semantic_release 1564660.3652564506 ns/iter 1713806.2181373367 ns/iter 0.91
E2E_Compiler_stale 1519634.9224139724 ns/iter 1672741.7422438203 ns/iter 0.91
E2E_Compiler_stylecop 5488848.796876056 ns/iter 6431945.697248578 ns/iter 0.85
E2E_Compiler_tmuxinator 1888762.0594593524 ns/iter 2106605.072507113 ns/iter 0.90
E2E_Compiler_ui5 46674169.35714235 ns/iter 51497683.785718046 ns/iter 0.91
E2E_Compiler_ui5_manifest 300521917.4999638 ns/iter 319959528.0000267 ns/iter 0.94
E2E_Compiler_unreal_engine_uproject 4420400.481011758 ns/iter 5003989.749999554 ns/iter 0.88
E2E_Compiler_vercel 12046340.896553185 ns/iter 13601873.749997558 ns/iter 0.89
E2E_Compiler_yamllint 340909.58337399166 ns/iter 368764.92808401684 ns/iter 0.92
E2E_Evaluator_adaptivecard 22120.189562354553 ns/iter 23280.587673755057 ns/iter 0.95
E2E_Evaluator_ansible_meta 215797.024044376 ns/iter 223595.21330788176 ns/iter 0.97
E2E_Evaluator_aws_cdk 44571.76871658145 ns/iter 45044.03103185296 ns/iter 0.99
E2E_Evaluator_babelrc 90653.57785742608 ns/iter 86133.94412798286 ns/iter 1.05
E2E_Evaluator_cerebrum_criminal_case 1324464.277566294 ns/iter 1314851.9291187148 ns/iter 1.01
E2E_Evaluator_clang_format 101741.113951805 ns/iter 102006.04116185762 ns/iter 1.00
E2E_Evaluator_cmake_presets 5099529.707691685 ns/iter 4521959.799999862 ns/iter 1.13
E2E_Evaluator_code_climate 187419.24678457042 ns/iter 160101.4898192853 ns/iter 1.17
E2E_Evaluator_cql2 190983.73369420663 ns/iter 202932.9886595063 ns/iter 0.94
E2E_Evaluator_cspell 530132.3765337603 ns/iter 514720.6963767425 ns/iter 1.03
E2E_Evaluator_cypress 157922.52561797714 ns/iter 145454.53494126748 ns/iter 1.09
E2E_Evaluator_deno 344529.715136512 ns/iter 274182.7339307095 ns/iter 1.26
E2E_Evaluator_dependabot 454451.64097494306 ns/iter 446418.2864385593 ns/iter 1.02
E2E_Evaluator_draft_04 7287509.104166646 ns/iter 6649339.831681411 ns/iter 1.10
E2E_Evaluator_fabric_mod 713052.1035896192 ns/iter 709303.7700915809 ns/iter 1.01
E2E_Evaluator_geojson 16789712.0465124 ns/iter 17164748.77500218 ns/iter 0.98
E2E_Evaluator_gitpod_configuration 240681.84580890986 ns/iter 225567.23621531035 ns/iter 1.07
E2E_Evaluator_helm_chart_lock 352363.53636365593 ns/iter 214592.55073365648 ns/iter 1.64
E2E_Evaluator_importmap 30642.169295238262 ns/iter 40848.13815090698 ns/iter 0.75
E2E_Evaluator_jasmine 105830.44559115452 ns/iter 102899.3494380378 ns/iter 1.03
E2E_Evaluator_jshintrc 1055611.6354005807 ns/iter 1028372.9896450252 ns/iter 1.03
E2E_Evaluator_jsconfig 358783.9657113006 ns/iter 370304.22556787555 ns/iter 0.97
E2E_Evaluator_krakend 173409.85292641495 ns/iter 182644.13404474675 ns/iter 0.95
E2E_Evaluator_lazygit 118590.95314614844 ns/iter 121716.27766035001 ns/iter 0.97
E2E_Evaluator_lerna 171195.6352650838 ns/iter 121946.74081773343 ns/iter 1.40
E2E_Evaluator_nest_cli 191611.06392314914 ns/iter 176653.68573603226 ns/iter 1.08
E2E_Evaluator_omc 18357.39346917131 ns/iter 18885.47102682865 ns/iter 0.97
E2E_Evaluator_omnisharp 566312.082247448 ns/iter 519582.3413533391 ns/iter 1.09
E2E_Evaluator_openapi 14044004.080001287 ns/iter 12934316.462966071 ns/iter 1.09
E2E_Evaluator_pre_commit_hooks 521091.43468477024 ns/iter 479805.7522185033 ns/iter 1.09
E2E_Evaluator_pulumi 754668.1274509692 ns/iter 733747.3280589341 ns/iter 1.03
E2E_Evaluator_semantic_release 83819.49440344062 ns/iter 87739.08637752266 ns/iter 0.96
E2E_Evaluator_stale 152534.43762202765 ns/iter 148941.9519455636 ns/iter 1.02
E2E_Evaluator_stylecop 278158.9508000252 ns/iter 285260.1569106181 ns/iter 0.98
E2E_Evaluator_tmuxinator 86097.32587586048 ns/iter 86531.83567957203 ns/iter 0.99
E2E_Evaluator_ui5 491351.69527895364 ns/iter 497284.46926965576 ns/iter 0.99
E2E_Evaluator_ui5_manifest 2708813.923076237 ns/iter 2689775.1423068536 ns/iter 1.01
E2E_Evaluator_unreal_engine_uproject 447041.97455476644 ns/iter 435914.8100490705 ns/iter 1.03
E2E_Evaluator_vercel 351540.1836427007 ns/iter 264914.2393617679 ns/iter 1.33
E2E_Evaluator_yamllint 9199.636422376056 ns/iter 10419.281046335462 ns/iter 0.88

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: 9ebc1df Previous: 7630451 Ratio
E2E_Evaluator_adaptivecard 114145 ns 118073 ns 0.97
E2E_Evaluator_ansible-meta 595493 ns 598925 ns 0.99
E2E_Evaluator_aws-cdk 143098 ns 131064 ns 1.09
E2E_Evaluator_babelrc 467810 ns 311209 ns 1.50
E2E_Evaluator_cerebrum-criminal-case 2622621 ns 2813820 ns 0.93
E2E_Evaluator_clang-format 350843 ns 254714 ns 1.38
E2E_Evaluator_cmake-presets 21019756 ns 18758540 ns 1.12
E2E_Evaluator_code-climate 481178 ns 428727 ns 1.12
E2E_Evaluator_cql2 1117308 ns 1217246 ns 0.92
E2E_Evaluator_cspell 2026508 ns 1605731 ns 1.26
E2E_Evaluator_cypress 1149709 ns 864921 ns 1.33
E2E_Evaluator_deno 1224683 ns 1089140 ns 1.12
E2E_Evaluator_dependabot 1240530 ns 1072568 ns 1.16
E2E_Evaluator_draft-04 21087727 ns 22596838 ns 0.93
E2E_Evaluator_fabric-mod 2698084 ns 2569847 ns 1.05
E2E_Evaluator_geojson 27104634 ns 21080611 ns 1.29
E2E_Evaluator_gitpod-configuration 899997 ns 789892 ns 1.14
E2E_Evaluator_helm-chart-lock 1226146 ns 1031588 ns 1.19
E2E_Evaluator_importmap 344238 ns 287579 ns 1.20
E2E_Evaluator_jasmine 373725 ns 291260 ns 1.28
E2E_Evaluator_jsconfig 1874889 ns 1412570 ns 1.33
E2E_Evaluator_jshintrc 3577019 ns 3174619 ns 1.13
E2E_Evaluator_krakend 714155 ns 711798 ns 1.00
E2E_Evaluator_lazygit 551446 ns 485206 ns 1.14
E2E_Evaluator_lerna 531574 ns 468477 ns 1.13
E2E_Evaluator_nest-cli 794551 ns 662339 ns 1.20
E2E_Evaluator_omc 82441 ns 87353 ns 0.94
E2E_Evaluator_omnisharp 1824514 ns 1636734 ns 1.11
E2E_Evaluator_openapi 35104323 ns 36336044 ns 0.97
E2E_Evaluator_pre-commit-hooks 2198171 ns 2034487 ns 1.08
E2E_Evaluator_pulumi 2321623 ns 2073805 ns 1.12
E2E_Evaluator_semantic-release 313152 ns 243450 ns 1.29
E2E_Evaluator_stale 498429 ns 426562 ns 1.17
E2E_Evaluator_stylecop 1246507 ns 1222101 ns 1.02
E2E_Evaluator_tmuxinator 304856 ns 227051 ns 1.34
E2E_Evaluator_ui5 2203060 ns 2268852 ns 0.97
E2E_Evaluator_ui5-manifest 10591249 ns 10045321 ns 1.05
E2E_Evaluator_unreal-engine-uproject 1756510 ns 1598905 ns 1.10
E2E_Evaluator_vercel 1153446 ns 1057319 ns 1.09
E2E_Evaluator_yamllint 25489 ns 23425 ns 1.09

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit f3487a0 into main Apr 13, 2026
15 checks passed
@jviotti jviotti deleted the canonical-draft6-bugs branch April 13, 2026 20:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant