Add enum Draft 3 trace tests

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[augmentcode]

🤖 Augment PR Summary

Summary: This PR expands the Draft-03 evaluator trace test suite to cover enum behavior and its interaction with type-related optimizations.

Changes:

• Added a large set of new Draft-03 enum trace test cases to test/evaluator/evaluator_draft3.json.
• Covered mixed-type enumerations (numbers/strings/objects), singleton enums (enabling AssertionEqual), and empty enums (AssertionFail).
• Added coverage for enum combined with type (including any and array-form type), exercising short-circuit behavior between assertions.
• Introduced two C++ trace tests asserting that a real/decimal instance 3.0 matches an integer enum member 3 in both Fast and Exhaustive modes.

Technical Notes:
The new failure-message expectations align with the evaluator’s sorted formatting for multi-valued enums, and the added numeric test protects the intended numeric equality semantics in enum comparisons.

_{🤖 Was this summary useful? React with 👍 or 👎}

[augmentcode]

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

[cubic-dev-ai]

No issues found across 2 files

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: 76d4689	Previous: 5b9baeb	Ratio
E2E_Compiler_adaptivecard	67417461.22222342 ns/iter	62571882.22222491 ns/iter	1.08
E2E_Compiler_ansible_meta	30228093.478260983 ns/iter	29074107.374995604 ns/iter	1.04
E2E_Compiler_aws_cdk	371611.5143160084 ns/iter	384483.85447556106 ns/iter	0.97
E2E_Compiler_babelrc	2622629.3843283607 ns/iter	2598974.5703702318 ns/iter	1.01
E2E_Compiler_clang_format	18991481.89189062 ns/iter	18421220.105264377 ns/iter	1.03
E2E_Compiler_cmake_presets	26628954.461535577 ns/iter	26033876.296297524 ns/iter	1.02
E2E_Compiler_code_climate	2678675.923371619 ns/iter	2611182.8768656226 ns/iter	1.03
E2E_Compiler_cql2	13626577.44230616 ns/iter	13228982.074074928 ns/iter	1.03
E2E_Compiler_cspell	23517108.900000494 ns/iter	23141715.666668005 ns/iter	1.02
E2E_Compiler_cypress	4054882.0924850376 ns/iter	3987083.954545379 ns/iter	1.02
E2E_Compiler_deno	7822946.876403927 ns/iter	7749940.966666852 ns/iter	1.01
E2E_Compiler_dependabot	4013289.9252869026 ns/iter	3953578.830508526 ns/iter	1.02
E2E_Compiler_draft_04	2707440.9111968754 ns/iter	2701415.2653844818 ns/iter	1.00
E2E_Compiler_fabric_mod	4831934.291667197 ns/iter	4803956.572413881 ns/iter	1.01
E2E_Compiler_geojson	22586945.709675886 ns/iter	22140360.593752462 ns/iter	1.02
E2E_Compiler_gitpod_configuration	4985513.900000375 ns/iter	4933122.359154406 ns/iter	1.01
E2E_Compiler_helm_chart_lock	683133.9480900628 ns/iter	714402.0746421617 ns/iter	0.96
E2E_Compiler_importmap	279318.2586687878 ns/iter	291143.8801824235 ns/iter	0.96
E2E_Compiler_jasmine	1362713.3444227607 ns/iter	1381006.6962524387 ns/iter	0.99
E2E_Compiler_jshintrc	4384998.700000154 ns/iter	4409553.597483922 ns/iter	0.99
E2E_Compiler_jsconfig	22184184.687500164 ns/iter	22171319.468750283 ns/iter	1.00
E2E_Compiler_krakend	141488394.8000124 ns/iter	141210759.1999984 ns/iter	1.00
E2E_Compiler_lazygit	34393836.99999894 ns/iter	33666970.95238383 ns/iter	1.02
E2E_Compiler_lerna	1605564.7116704064 ns/iter	1625339.765661251 ns/iter	0.99
E2E_Compiler_nest_cli	7606467.032608723 ns/iter	7533547.1290328875 ns/iter	1.01
E2E_Compiler_omc	178468308.00002068 ns/iter	154457368.5000046 ns/iter	1.16
E2E_Compiler_omnisharp	6838107.686275287 ns/iter	6812705.349514465 ns/iter	1.00
E2E_Compiler_openapi	25407364.142860647 ns/iter	25086002.642857306 ns/iter	1.01
E2E_Compiler_pre_commit_hooks	5444672.156249553 ns/iter	5421639.839695471 ns/iter	1.00
E2E_Compiler_pulumi	4099612.976608369 ns/iter	4075353.941860073 ns/iter	1.01
E2E_Compiler_semantic_release	1584501.2963799227 ns/iter	1580904.112866892 ns/iter	1.00
E2E_Compiler_stale	1566977.930648539 ns/iter	1580096.3685394258 ns/iter	0.99
E2E_Compiler_stylecop	6277097.607143186 ns/iter	6202844.72566343 ns/iter	1.01
E2E_Compiler_tmuxinator	1944307.738888698 ns/iter	1945047.2465374519 ns/iter	1.00
E2E_Compiler_ui5	48942566.92857165 ns/iter	47394475.599996135 ns/iter	1.03
E2E_Compiler_ui5_manifest	332167276.99999636 ns/iter	312612872.0000452 ns/iter	1.06
E2E_Compiler_unreal_engine_uproject	4660201.97999948 ns/iter	4642309.200000151 ns/iter	1.00
E2E_Compiler_users_array	776474.0490524658 ns/iter	799200.4079999658 ns/iter	0.97
E2E_Compiler_vercel	12515375.339284722 ns/iter	12544964.5535716 ns/iter	1.00
E2E_Compiler_yamllint	338936.2759787349 ns/iter	354352.31052093813 ns/iter	0.96
E2E_Evaluator_adaptivecard	23943.203511408796 ns/iter	25977.664237105113 ns/iter	0.92
E2E_Evaluator_ansible_meta	202909.7413220785 ns/iter	239854.86377397715 ns/iter	0.85
E2E_Evaluator_aws_cdk	42567.82356935721 ns/iter	50074.36171132684 ns/iter	0.85
E2E_Evaluator_babelrc	86616.07522123549 ns/iter	107915.26029037591 ns/iter	0.80
E2E_Evaluator_cerebrum_criminal_case	1005504.5968207497 ns/iter	966968.8630137836 ns/iter	1.04
E2E_Evaluator_clang_format	117358.98387367264 ns/iter	122924.84694589676 ns/iter	0.95
E2E_Evaluator_cmake_presets	4132610.103030829 ns/iter	4222020.425149305 ns/iter	0.98
E2E_Evaluator_code_climate	150789.28923474398 ns/iter	177364.4263881874 ns/iter	0.85
E2E_Evaluator_cql2	182471.31021043897 ns/iter	222675.3542780999 ns/iter	0.82
E2E_Evaluator_cspell	539590.5003927374 ns/iter	564480.1435484089 ns/iter	0.96
E2E_Evaluator_cypress	166205.05307197597 ns/iter	191219.6197260266 ns/iter	0.87
E2E_Evaluator_deno	247150.8628549748 ns/iter	320584.6672727313 ns/iter	0.77
E2E_Evaluator_dependabot	298476.72890793363 ns/iter	317815.1261384318 ns/iter	0.94
E2E_Evaluator_draft_04	9351979.041667845 ns/iter	7146376.0412373245 ns/iter	1.31
E2E_Evaluator_fabric_mod	651517.5694315145 ns/iter	707204.7352647661 ns/iter	0.92
E2E_Evaluator_geojson	17073543.682926822 ns/iter	16238030.697673969 ns/iter	1.05
E2E_Evaluator_gitpod_configuration	197436.51887870824 ns/iter	229728.6466557858 ns/iter	0.86
E2E_Evaluator_helm_chart_lock	237327.29815574508 ns/iter	351818.19454266777 ns/iter	0.67
E2E_Evaluator_importmap	41766.887926435804 ns/iter	48563.147078761824 ns/iter	0.86
E2E_Evaluator_jasmine	96605.38947224621 ns/iter	105151.96382660822 ns/iter	0.92
E2E_Evaluator_jshintrc	1178743.7885906938 ns/iter	1204343.637607022 ns/iter	0.98
E2E_Evaluator_jsconfig	403683.2039170415 ns/iter	425538.5286316981 ns/iter	0.95
E2E_Evaluator_krakend	175360.4065123553 ns/iter	211626.3119348832 ns/iter	0.83
E2E_Evaluator_lazygit	120751.24043810119 ns/iter	153241.79931463118 ns/iter	0.79
E2E_Evaluator_lerna	109332.7858499379 ns/iter	148719.38282723445 ns/iter	0.74
E2E_Evaluator_nest_cli	165650.46560225857 ns/iter	192134.96633716943 ns/iter	0.86
E2E_Evaluator_omc	17229.16183380694 ns/iter	18564.814794846417 ns/iter	0.93
E2E_Evaluator_omnisharp	560914.9263999825 ns/iter	611587.4007029445 ns/iter	0.92
E2E_Evaluator_openapi	11478454.384615151 ns/iter	8613013.92307595 ns/iter	1.33
E2E_Evaluator_pre_commit_hooks	460391.1521739051 ns/iter	473533.91683576285 ns/iter	0.97
E2E_Evaluator_pulumi	656552.0764150681 ns/iter	664984.287749289 ns/iter	0.99
E2E_Evaluator_semantic_release	80772.64464486662 ns/iter	96543.57008453955 ns/iter	0.84
E2E_Evaluator_stale	144390.9398621796 ns/iter	150005.33638688253 ns/iter	0.96
E2E_Evaluator_stylecop	254880.98611111112 ns/iter	284619.4261895248 ns/iter	0.90
E2E_Evaluator_tmuxinator	81685.53598157666 ns/iter	94624.94108042265 ns/iter	0.86
E2E_Evaluator_ui5	465057.19537950435 ns/iter	517772.3751846169 ns/iter	0.90
E2E_Evaluator_ui5_manifest	2411767.215947073 ns/iter	2444605.2166063925 ns/iter	0.99
E2E_Evaluator_unreal_engine_uproject	430098.7770700403 ns/iter	429304.6077111141 ns/iter	1.00
E2E_Evaluator_users_array	549213.3250773359 ns/iter	544135.9659090667 ns/iter	1.01
E2E_Evaluator_vercel	254072.79430135546 ns/iter	302437.9743923333 ns/iter	0.84
E2E_Evaluator_yamllint	8088.800190068408 ns/iter	8222.226097588838 ns/iter	0.98
Micro_Draft4_Meta_1_No_Callback	193.65541100915723 ns/iter	187.37622330664576 ns/iter	1.03
Micro_Draft4_Required_Properties	885.3809611918633 ns/iter	796.6977426240992 ns/iter	1.11
Micro_Draft4_Many_Optional_Properties_Minimal_Match	23.77061683827612 ns/iter	20.910711422459876 ns/iter	1.14
Micro_Draft4_Few_Optional_Properties_Minimal_Match	10.85807164228225 ns/iter	10.89927126172308 ns/iter	1.00
Micro_Draft4_Items_Schema	263.16860160696 ns/iter	319.66664216910743 ns/iter	0.82
Micro_Draft4_Nested_Object	1.4084774554313435 ns/iter	1.775764339396278 ns/iter	0.79
Micro_Draft4_Properties_Triad_Optional	318.4519945408287 ns/iter	342.36217654352686 ns/iter	0.93
Micro_Draft4_Properties_Triad_Closed	265.42920481617097 ns/iter	258.5895868899412 ns/iter	1.03
Micro_Draft4_Properties_Triad_Required	331.8142569238346 ns/iter	352.77729257421214 ns/iter	0.94
Micro_Draft4_Properties_Closed	59.555049242080266 ns/iter	54.89551942085449 ns/iter	1.08
Micro_Draft4_Non_Recursive_Ref	14.776633143565867 ns/iter	12.407116452284011 ns/iter	1.19
Micro_Draft4_Pattern_Properties_True	148.842897000015 ns/iter	149.82501772383702 ns/iter	0.99
Micro_Draft4_Ref_To_Single_Property	10.99672479603691 ns/iter	10.901481809823181 ns/iter	1.01
Micro_Draft4_Additional_Properties_Type	30.61210891523446 ns/iter	22.379460394122 ns/iter	1.37
Micro_Draft4_Nested_Oneof	54.56508316679862 ns/iter	58.07489409517935 ns/iter	0.94
Micro_Draft4_Short_Enum	14.069725769533704 ns/iter	14.040428008564504 ns/iter	1.00
Micro_Draft4_Long_Enum	13.404116066562828 ns/iter	14.028692720844678 ns/iter	0.96
Micro_Draft4_Long_Enum_Short_Strings	14.06904453920348 ns/iter	14.03270244840292 ns/iter	1.00
Micro_Draft4_Type_Object	3.5203748787395743 ns/iter	3.4252307370005477 ns/iter	1.03
Micro_Draft4_Ref_Single_100	2349684.7617447134 ns/iter	2389063.515254177 ns/iter	0.98
Micro_Draft4_Compile_Ref_Many_Nested	1724805.1330049743 ns/iter	1725887.8719212813 ns/iter	1.00
Micro_Draft4_Compile_Wrap	2384866.941979329 ns/iter	2372965.47635155 ns/iter	1.01
Micro_Draft6_Property_Names	115.01876941833676 ns/iter	118.92905324849364 ns/iter	0.97
Micro_Draft6_Compile_FHIR	17479835042.99998 ns/iter	13689091751.000092 ns/iter	1.28
Micro_Draft7_If_Then_Else	23.664351986490985 ns/iter	23.352474079869307 ns/iter	1.01
Micro_2019_09_Unevaluated_Properties	26.304836252847778 ns/iter	28.317472561834172 ns/iter	0.93
Micro_2019_09_Compile_Wrap	348166385.0000132 ns/iter	286174940.00002354 ns/iter	1.22
Micro_2020_12_Dynamic_Ref	227.02562867829297 ns/iter	224.3310334140283 ns/iter	1.01
Micro_2020_12_Dynamic_Ref_Single	3.517850405435815 ns/iter	3.425683644889007 ns/iter	1.03
Micro_2020_12_Simple_Output_Mask	1013.942332115701 ns/iter	1063.8115652100919 ns/iter	0.95
Micro_2020_12_Simple_Output_Annotations	91596.656722296 ns/iter	104518.0535635354 ns/iter	0.88
Micro_2020_12_Compile_NonCircular_Shared_Refs	1108452.7113565316 ns/iter	1103177.1350078946 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric	8475.739241999827 ns/iter	8376.028534783329 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	169511.63259803667 ns/iter	174515.03310587205 ns/iter	0.97
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	23280.643294711143 ns/iter	22371.54280329671 ns/iter	1.04
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	145.48698510332906 ns/iter	141.91269592935137 ns/iter	1.03
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4057.6346076646882 ns/iter	4275.615260728439 ns/iter	0.95
Alterschema_Check_Readibility_ISO_Language_Set_3	343194317.4999788 ns/iter	340260378.5000338 ns/iter	1.01
Alterschema_Check_Readibility_OMC	90272072.49999946 ns/iter	85372127.24999677 ns/iter	1.06
Alterschema_Check_Readibility_KrakenD	1311698720.9999707 ns/iter	1186923354.9999762 ns/iter	1.11
Alterschema_Apply_Readibility_KrakenD	131512935663 ns/iter	117085564365.99997 ns/iter	1.12
Alterschema_Check_Invalid_External_Refs	278595603.6666827 ns/iter	295322177.00000274 ns/iter	0.94

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: 76d4689	Previous: 5b9baeb	Ratio
E2E_Evaluator_adaptivecard	118015 ns	116880 ns	1.01
E2E_Evaluator_ansible-meta	557384 ns	512039 ns	1.09
E2E_Evaluator_aws-cdk	130369 ns	142541 ns	0.91
E2E_Evaluator_babelrc	326356 ns	311756 ns	1.05
E2E_Evaluator_cerebrum-criminal-case	2768461 ns	2450556 ns	1.13
E2E_Evaluator_clang-format	290871 ns	249858 ns	1.16
E2E_Evaluator_cmake-presets	18655398 ns	16496787 ns	1.13
E2E_Evaluator_code-climate	503332 ns	499690 ns	1.01
E2E_Evaluator_cql2	1252097 ns	1233977 ns	1.01
E2E_Evaluator_cspell	1743128 ns	1457411 ns	1.20
E2E_Evaluator_cypress	889012 ns	761828 ns	1.17
E2E_Evaluator_deno	1177342 ns	1039793 ns	1.13
E2E_Evaluator_dependabot	1261764 ns	1073330 ns	1.18
E2E_Evaluator_draft-04	29992900 ns	21095829 ns	1.42
E2E_Evaluator_fabric-mod	2554012 ns	2287048 ns	1.12
E2E_Evaluator_geojson	21535467 ns	23543793 ns	0.91
E2E_Evaluator_gitpod-configuration	755912 ns	706611 ns	1.07
E2E_Evaluator_helm-chart-lock	999156 ns	1000202 ns	1.00
E2E_Evaluator_importmap	269660 ns	262946 ns	1.03
E2E_Evaluator_jasmine	284790 ns	285866 ns	1.00
E2E_Evaluator_jsconfig	1470111 ns	1205827 ns	1.22
E2E_Evaluator_jshintrc	2960397 ns	2639918 ns	1.12
E2E_Evaluator_krakend	644209 ns	651856 ns	0.99
E2E_Evaluator_lazygit	482676 ns	499723 ns	0.97
E2E_Evaluator_lerna	453426 ns	457228 ns	0.99
E2E_Evaluator_nest-cli	624328 ns	586977 ns	1.06
E2E_Evaluator_omc	92173 ns	92352 ns	1.00
E2E_Evaluator_omnisharp	1536146 ns	1403094 ns	1.09
E2E_Evaluator_openapi	28626834 ns	22156297 ns	1.29
E2E_Evaluator_pre-commit-hooks	2143906 ns	1942952 ns	1.10
E2E_Evaluator_pulumi	2128057 ns	1840419 ns	1.16
E2E_Evaluator_semantic-release	235902 ns	253788 ns	0.93
E2E_Evaluator_stale	385897 ns	380825 ns	1.01
E2E_Evaluator_stylecop	1292427 ns	1193373 ns	1.08
E2E_Evaluator_tmuxinator	220367 ns	220546 ns	1.00
E2E_Evaluator_ui5	2325065 ns	2348293 ns	0.99
E2E_Evaluator_ui5-manifest	10772834 ns	10351137 ns	1.04
E2E_Evaluator_unreal-engine-uproject	1651751 ns	1467831 ns	1.13
E2E_Evaluator_users-array	2562450 ns	2466440 ns	1.04
E2E_Evaluator_vercel	1094793 ns	956265 ns	1.14
E2E_Evaluator_yamllint	24407 ns	25425 ns	0.96

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: 76d4689	Previous: 5b9baeb	Ratio
E2E_Compiler_adaptivecard	112686541.66667603 ns/iter	62967054.199998535 ns/iter	1.79
E2E_Compiler_ansible_meta	38934589.89473162 ns/iter	24992126.55555783 ns/iter	1.56
E2E_Compiler_aws_cdk	524904.4117646815 ns/iter	278832.73319994257 ns/iter	1.88
E2E_Compiler_babelrc	3939964.947058423 ns/iter	2226353.9756841334 ns/iter	1.77
E2E_Compiler_clang_format	26827049.407403238 ns/iter	17589115.85365817 ns/iter	1.53
E2E_Compiler_cmake_presets	46672143.25000657 ns/iter	28717357.954550687 ns/iter	1.63
E2E_Compiler_code_climate	3809206.3886008738 ns/iter	2257842.2538228845 ns/iter	1.69
E2E_Compiler_cql2	20556663.08571225 ns/iter	12087670.258618597 ns/iter	1.70
E2E_Compiler_cspell	32476676.136370357 ns/iter	20315457.16667122 ns/iter	1.60
E2E_Compiler_cypress	5860572.716981226 ns/iter	3538757.224489751 ns/iter	1.66
E2E_Compiler_deno	10531491.258065686 ns/iter	6691861.374998955 ns/iter	1.57
E2E_Compiler_dependabot	6235650.186814022 ns/iter	3616464.743590069 ns/iter	1.72
E2E_Compiler_draft_04	3258337.1047621765 ns/iter	2000694.560224054 ns/iter	1.63
E2E_Compiler_fabric_mod	5741677.253967831 ns/iter	3648070.394736255 ns/iter	1.57
E2E_Compiler_geojson	42229377.333329566 ns/iter	22870110.1935463 ns/iter	1.85
E2E_Compiler_gitpod_configuration	7852757.39999886 ns/iter	4663070.660818018 ns/iter	1.68
E2E_Compiler_helm_chart_lock	844086.1516908117 ns/iter	612434.3220338501 ns/iter	1.38
E2E_Compiler_importmap	304987.2420962133 ns/iter	233056.98800548937 ns/iter	1.31
E2E_Compiler_jasmine	1453196.2365591396 ns/iter	1064273.085585665 ns/iter	1.37
E2E_Compiler_jshintrc	4530771.897810546 ns/iter	3240054.1474649077 ns/iter	1.40
E2E_Compiler_jsconfig	26085307.111113958 ns/iter	18926844.59459348 ns/iter	1.38
E2E_Compiler_krakend	184816864.50002143 ns/iter	132881333.20002088 ns/iter	1.39
E2E_Compiler_lazygit	46397191.66666509 ns/iter	36525554.90909683 ns/iter	1.27
E2E_Compiler_lerna	2034735.6305418645 ns/iter	1310431.6754223264 ns/iter	1.55
E2E_Compiler_nest_cli	10618187.71133928 ns/iter	6127060.14151129 ns/iter	1.73
E2E_Compiler_omc	261991062.50010118 ns/iter	183717583.2500293 ns/iter	1.43
E2E_Compiler_omnisharp	9716528.677418737 ns/iter	5898135.416667098 ns/iter	1.65
E2E_Compiler_openapi	35884825.94117897 ns/iter	22423104.187495824 ns/iter	1.60
E2E_Compiler_pre_commit_hooks	5849381.57894749 ns/iter	4739772.794117497 ns/iter	1.23
E2E_Compiler_pulumi	4772589.850339884 ns/iter	4456082.973913157 ns/iter	1.07
E2E_Compiler_semantic_release	1724808.871121477 ns/iter	1729135.8931297094 ns/iter	1.00
E2E_Compiler_stale	1894800.0334726146 ns/iter	1653318.541300694 ns/iter	1.15
E2E_Compiler_stylecop	9522371.926315922 ns/iter	5559220.507692631 ns/iter	1.71
E2E_Compiler_tmuxinator	2994482.1597443563 ns/iter	1501849.8755363727 ns/iter	1.99
E2E_Compiler_ui5	105793992.99998234 ns/iter	55908440.916671984 ns/iter	1.89
E2E_Compiler_ui5_manifest	617737457.9999651 ns/iter	305402166.5000164 ns/iter	2.02
E2E_Compiler_unreal_engine_uproject	5965909.558139272 ns/iter	3705127.6178010358 ns/iter	1.61
E2E_Compiler_users_array	1456012.6273584862 ns/iter	753671.7265048627 ns/iter	1.93
E2E_Compiler_vercel	21388132.57575941 ns/iter	11928088.199999819 ns/iter	1.79
E2E_Compiler_yamllint	481869.46459826006 ns/iter	253000.3336971814 ns/iter	1.90
E2E_Evaluator_adaptivecard	35797.32039906181 ns/iter	18379.167512563054 ns/iter	1.95
E2E_Evaluator_ansible_meta	304043.0924444687 ns/iter	179524.96512441637 ns/iter	1.69
E2E_Evaluator_aws_cdk	52444.57243264711 ns/iter	36077.3268162503 ns/iter	1.45
E2E_Evaluator_babelrc	127587.20427716016 ns/iter	77296.87939637378 ns/iter	1.65
E2E_Evaluator_cerebrum_criminal_case	1160096.4777947036 ns/iter	639605.1836733472 ns/iter	1.81
E2E_Evaluator_clang_format	159517.0863309181 ns/iter	92634.9689382824 ns/iter	1.72
E2E_Evaluator_cmake_presets	5158523.462185013 ns/iter	3165465.742222295 ns/iter	1.63
E2E_Evaluator_code_climate	205596.89642731962 ns/iter	123248.01183647763 ns/iter	1.67
E2E_Evaluator_cql2	242367.69859808907 ns/iter	140785.09740911558 ns/iter	1.72
E2E_Evaluator_cspell	775260.7230098519 ns/iter	374087.05357142544 ns/iter	2.07
E2E_Evaluator_cypress	240902.02581563254 ns/iter	133419.78340314442 ns/iter	1.81
E2E_Evaluator_deno	440570.27737811604 ns/iter	209610.77431079038 ns/iter	2.10
E2E_Evaluator_dependabot	489759.83483489347 ns/iter	226068.15266194506 ns/iter	2.17
E2E_Evaluator_draft_04	8461672.34091023 ns/iter	5588929.417911853 ns/iter	1.51
E2E_Evaluator_fabric_mod	949811.0181310273 ns/iter	547956.3347548652 ns/iter	1.73
E2E_Evaluator_geojson	19894319.07894581 ns/iter	11712120.833332544 ns/iter	1.70
E2E_Evaluator_gitpod_configuration	283908.48140663415 ns/iter	176873.07844069685 ns/iter	1.61
E2E_Evaluator_helm_chart_lock	352132.38607933774 ns/iter	221989.92800705833 ns/iter	1.59
E2E_Evaluator_importmap	54778.78750000401 ns/iter	30926.06672919867 ns/iter	1.77
E2E_Evaluator_jasmine	150013.8819512092 ns/iter	78584.81894922948 ns/iter	1.91
E2E_Evaluator_jshintrc	1576961.856459496 ns/iter	937461.2068964944 ns/iter	1.68
E2E_Evaluator_jsconfig	455593.0466249417 ns/iter	294357.21050232055 ns/iter	1.55
E2E_Evaluator_krakend	216734.20055249054 ns/iter	123448.37941512887 ns/iter	1.76
E2E_Evaluator_lazygit	169088.515888778 ns/iter	114796.74323930028 ns/iter	1.47
E2E_Evaluator_lerna	187784.2297636878 ns/iter	125986.30781332254 ns/iter	1.49
E2E_Evaluator_nest_cli	208190.682754335 ns/iter	119751.58589633617 ns/iter	1.74
E2E_Evaluator_omc	24913.861547595832 ns/iter	12700.542781239355 ns/iter	1.96
E2E_Evaluator_omnisharp	675353.666666698 ns/iter	428900.7898550524 ns/iter	1.57
E2E_Evaluator_openapi	11795508.196428273 ns/iter	5630019.287037967 ns/iter	2.10
E2E_Evaluator_pre_commit_hooks	601386.9944794199 ns/iter	326226.64844826754 ns/iter	1.84
E2E_Evaluator_pulumi	873325.0087335646 ns/iter	490826.46229745355 ns/iter	1.78
E2E_Evaluator_semantic_release	119120.66451421344 ns/iter	67588.4735780177 ns/iter	1.76
E2E_Evaluator_stale	175098.32802547218 ns/iter	107636.23859922717 ns/iter	1.63
E2E_Evaluator_stylecop	379559.82227384276 ns/iter	196107.4610340506 ns/iter	1.94
E2E_Evaluator_tmuxinator	120532.35639412506 ns/iter	77198.292022497 ns/iter	1.56
E2E_Evaluator_ui5	572593.1006037068 ns/iter	323468.4094887229 ns/iter	1.77
E2E_Evaluator_ui5_manifest	3735459.4619575 ns/iter	1510346.7847529624 ns/iter	2.47
E2E_Evaluator_unreal_engine_uproject	460418.1720962899 ns/iter	304030.9438841942 ns/iter	1.51
E2E_Evaluator_users_array	670628.9985569322 ns/iter	414454.54999996076 ns/iter	1.62
E2E_Evaluator_vercel	402176.73532799876 ns/iter	216734.26211001657 ns/iter	1.86
E2E_Evaluator_yamllint	7756.84152961621 ns/iter	5911.472787462726 ns/iter	1.31
Micro_Draft4_Meta_1_No_Callback	235.16139073158692 ns/iter	127.50304149159403 ns/iter	1.84
Micro_Draft4_Required_Properties	1079.851585458435 ns/iter	627.6103587556738 ns/iter	1.72
Micro_Draft4_Many_Optional_Properties_Minimal_Match	25.924966939300145 ns/iter	15.85327065605186 ns/iter	1.64
Micro_Draft4_Few_Optional_Properties_Minimal_Match	11.074255080245251 ns/iter	8.654368180162516 ns/iter	1.28
Micro_Draft4_Items_Schema	362.5731167432172 ns/iter	291.72714355704164 ns/iter	1.24
Micro_Draft4_Nested_Object	1.3831837352973666 ns/iter	0.7021223525163867 ns/iter	1.97
Micro_Draft4_Properties_Triad_Optional	338.2969880182723 ns/iter	207.76356069255792 ns/iter	1.63
Micro_Draft4_Properties_Triad_Closed	230.45810980712832 ns/iter	169.9623363023481 ns/iter	1.36
Micro_Draft4_Properties_Triad_Required	323.43702844787117 ns/iter	209.79534244851027 ns/iter	1.54
Micro_Draft4_Properties_Closed	66.8046371720497 ns/iter	39.27069830253191 ns/iter	1.70
Micro_Draft4_Non_Recursive_Ref	21.361255767141547 ns/iter	12.922476825134272 ns/iter	1.65
Micro_Draft4_Pattern_Properties_True	192.59696629836859 ns/iter	150.81469061330142 ns/iter	1.28
Micro_Draft4_Ref_To_Single_Property	12.736891782727135 ns/iter	7.091794243633563 ns/iter	1.80
Micro_Draft4_Additional_Properties_Type	39.956313907731925 ns/iter	25.704423237578442 ns/iter	1.55
Micro_Draft4_Nested_Oneof	64.04493401610763 ns/iter	39.971949908574395 ns/iter	1.60
Micro_Draft4_Short_Enum	9.614834661743629 ns/iter	5.317375829999946 ns/iter	1.81
Micro_Draft4_Long_Enum	18.904949263215947 ns/iter	11.314080377307263 ns/iter	1.67
Micro_Draft4_Long_Enum_Short_Strings	11.651454737171735 ns/iter	7.6232937567469214 ns/iter	1.53
Micro_Draft4_Type_Object	3.595087325573952 ns/iter	2.6495869269357133 ns/iter	1.36
Micro_Draft4_Ref_Single_100	3710530.7203382757 ns/iter	1702131.8922303764 ns/iter	2.18
Micro_Draft4_Compile_Ref_Many_Nested	2472165.3016386568 ns/iter	1267800.2245683137 ns/iter	1.95
Micro_Draft4_Compile_Wrap	3804307.5698932363 ns/iter	2090386.6484148486 ns/iter	1.82
Micro_Draft6_Property_Names	161.0376659742931 ns/iter	96.50666317873645 ns/iter	1.67
Micro_Draft6_Compile_FHIR	26075009000.000137 ns/iter	11746992666.000097 ns/iter	2.22
Micro_Draft7_If_Then_Else	25.6158966110839 ns/iter	16.935294020418066 ns/iter	1.51
Micro_2019_09_Unevaluated_Properties	47.51049285094747 ns/iter	26.352535382769716 ns/iter	1.80
Micro_2019_09_Compile_Wrap	604106666.9999964 ns/iter	349885145.5000249 ns/iter	1.73
Micro_2020_12_Dynamic_Ref	297.88792705891717 ns/iter	183.29227492447393 ns/iter	1.63
Micro_2020_12_Dynamic_Ref_Single	3.5085199928353035 ns/iter	2.1560857715110986 ns/iter	1.63
Micro_2020_12_Simple_Output_Mask	1296.197009196147 ns/iter	874.1770331592718 ns/iter	1.48
Micro_2020_12_Simple_Output_Annotations	145539.34989010656 ns/iter	101830.9218377201 ns/iter	1.43
Micro_2020_12_Compile_NonCircular_Shared_Refs	1474776.2557074246 ns/iter	842676.7299864177 ns/iter	1.75
Micro_2020_12_Exhaustive_Deep_Numeric	9177.687952569528 ns/iter	5288.046262663957 ns/iter	1.74
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	210910.7067287314 ns/iter	120964.86148256547 ns/iter	1.74
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	35026.35444024286 ns/iter	19204.073371333863 ns/iter	1.82
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	156.61587332781463 ns/iter	107.432183764256 ns/iter	1.46
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	10777.923568638362 ns/iter	5078.347920000397 ns/iter	2.12
Alterschema_Check_Readibility_ISO_Language_Set_3	511254250.00009274 ns/iter	284459430.6666295 ns/iter	1.80
Alterschema_Check_Readibility_OMC	95492173.66664682 ns/iter	63763996.18180916 ns/iter	1.50
Alterschema_Check_Readibility_KrakenD	1499698332.9999692 ns/iter	687956624.9999698 ns/iter	2.18
Alterschema_Apply_Readibility_KrakenD	152991954208.00015 ns/iter	74778475584.00003 ns/iter	2.05
Alterschema_Check_Invalid_External_Refs	357770583.00004685 ns/iter	192426447.74999464 ns/iter	1.86

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: 76d4689	Previous: 5b9baeb	Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3	368299202.4999976 ns/iter	321090483.49991554 ns/iter	1.15
Alterschema_Check_Readibility_OMC	97785275.00001083 ns/iter	100379991.5714418 ns/iter	0.97
Alterschema_Check_Readibility_KrakenD	1343465304.0001194 ns/iter	1594982646.0000622 ns/iter	0.84
Alterschema_Apply_Readibility_KrakenD	124617689274.99997 ns/iter	154364211557.0001 ns/iter	0.81
Alterschema_Check_Invalid_External_Refs	339741552.0000777 ns/iter	253438748.66666737 ns/iter	1.34
Micro_2020_12_Dynamic_Ref	260.43914182198694 ns/iter	272.53150469091474 ns/iter	0.96
Micro_2020_12_Dynamic_Ref_Single	4.670894768193363 ns/iter	3.699487853644915 ns/iter	1.26
Micro_2020_12_Simple_Output_Mask	1139.9709330913752 ns/iter	1030.8474491151262 ns/iter	1.11
Micro_2020_12_Simple_Output_Annotations	118929.35784227593 ns/iter	108075.58053016219 ns/iter	1.10
Micro_2020_12_Compile_NonCircular_Shared_Refs	1244455.104982119 ns/iter	1108604.717908116 ns/iter	1.12
Micro_2020_12_Exhaustive_Deep_Numeric	8148.381462904489 ns/iter	8764.691730730854 ns/iter	0.93
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	170108.39698741178 ns/iter	142930.58340200418 ns/iter	1.19
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	25896.11393012328 ns/iter	24386.764509041648 ns/iter	1.06
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	138.50595499999716 ns/iter	141.97370798848021 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	5024.900989600191 ns/iter	4635.135607884758 ns/iter	1.08
Micro_2019_09_Unevaluated_Properties	29.754438583901116 ns/iter	25.20016042665127 ns/iter	1.18
Micro_2019_09_Compile_Wrap	321957651.5000426 ns/iter	284162339.4999715 ns/iter	1.13
Micro_Draft7_If_Then_Else	30.00306209747772 ns/iter	22.253133349095126 ns/iter	1.35
Micro_Draft6_Property_Names	156.05351460778718 ns/iter	147.25222185747677 ns/iter	1.06
Micro_Draft6_Compile_FHIR	14185763574.000021 ns/iter	17073635365.999962 ns/iter	0.83
Micro_Draft4_Meta_1_No_Callback	175.39555031070503 ns/iter	174.4712092653931 ns/iter	1.01
Micro_Draft4_Required_Properties	844.7172117037109 ns/iter	775.9396331665087 ns/iter	1.09
Micro_Draft4_Many_Optional_Properties_Minimal_Match	20.988035063207853 ns/iter	23.8661736063631 ns/iter	0.88
Micro_Draft4_Few_Optional_Properties_Minimal_Match	13.09373002224328 ns/iter	11.544879121317528 ns/iter	1.13
Micro_Draft4_Items_Schema	351.9105872804848 ns/iter	284.9958679204262 ns/iter	1.23
Micro_Draft4_Nested_Object	1.8705069668055048 ns/iter	1.7298614715505787 ns/iter	1.08
Micro_Draft4_Properties_Triad_Optional	459.04130244378723 ns/iter	329.7948005793451 ns/iter	1.39
Micro_Draft4_Properties_Triad_Closed	337.35517044350286 ns/iter	269.40895109625853 ns/iter	1.25
Micro_Draft4_Properties_Triad_Required	463.99689399026715 ns/iter	351.1322936420523 ns/iter	1.32
Micro_Draft4_Properties_Closed	67.6396929359627 ns/iter	65.61301366190654 ns/iter	1.03
Micro_Draft4_Non_Recursive_Ref	10.588289682781987 ns/iter	8.652049605573225 ns/iter	1.22
Micro_Draft4_Pattern_Properties_True	215.23632006604612 ns/iter	181.2478651455686 ns/iter	1.19
Micro_Draft4_Ref_To_Single_Property	13.123234600112639 ns/iter	11.468601398122944 ns/iter	1.14
Micro_Draft4_Additional_Properties_Type	15.262875123649758 ns/iter	12.978034934050296 ns/iter	1.18
Micro_Draft4_Nested_Oneof	67.0991551389102 ns/iter	54.25353913341098 ns/iter	1.24
Micro_Draft4_Short_Enum	14.676454739148 ns/iter	10.736412187761836 ns/iter	1.37
Micro_Draft4_Long_Enum	14.031646846371748 ns/iter	13.690285319820875 ns/iter	1.02
Micro_Draft4_Long_Enum_Short_Strings	14.677344977754643 ns/iter	10.673479943045276 ns/iter	1.38
Micro_Draft4_Type_Object	4.700996917070665 ns/iter	3.919728982205219 ns/iter	1.20
Micro_Draft4_Ref_Single_100	2562912.593406502 ns/iter	2276074.6123777735 ns/iter	1.13
Micro_Draft4_Compile_Ref_Many_Nested	1850363.3298151584 ns/iter	1686442.086747227 ns/iter	1.10
Micro_Draft4_Compile_Wrap	2620679.7500001253 ns/iter	2362400.663299439 ns/iter	1.11
E2E_Compiler_adaptivecard	66109478.89998897 ns/iter	63891184.99999892 ns/iter	1.03
E2E_Compiler_ansible_meta	30699726.434773844 ns/iter	27115485.23076929 ns/iter	1.13
E2E_Compiler_aws_cdk	433155.457354712 ns/iter	372152.25544335926 ns/iter	1.16
E2E_Compiler_babelrc	2838353.9065044913 ns/iter	2554817.050179322 ns/iter	1.11
E2E_Compiler_clang_format	20614196.228572316 ns/iter	17672534.897440363 ns/iter	1.17
E2E_Compiler_cmake_presets	29024829.439995304 ns/iter	25738317.000003815 ns/iter	1.13
E2E_Compiler_code_climate	2851488.4897958837 ns/iter	2581396.7095595393 ns/iter	1.10
E2E_Compiler_cql2	14246420.270832041 ns/iter	13168037.49056628 ns/iter	1.08
E2E_Compiler_cspell	24361150.103451453 ns/iter	22376095.74193254 ns/iter	1.09
E2E_Compiler_cypress	4299549.187500418 ns/iter	3823418.3715835293 ns/iter	1.12
E2E_Compiler_deno	8383813.011906092 ns/iter	7370706.189474157 ns/iter	1.14
E2E_Compiler_dependabot	4312165.585365231 ns/iter	3775046.081081372 ns/iter	1.14
E2E_Compiler_draft_04	2996747.931623152 ns/iter	2692647.2153849527 ns/iter	1.11
E2E_Compiler_fabric_mod	5245684.708955794 ns/iter	4688297.519999954 ns/iter	1.12
E2E_Compiler_geojson	24115038.62068959 ns/iter	22233928.968752537 ns/iter	1.08
E2E_Compiler_gitpod_configuration	5365487.503816974 ns/iter	4802400.496550788 ns/iter	1.12
E2E_Compiler_helm_chart_lock	778196.8987765686 ns/iter	660279.3355326417 ns/iter	1.18
E2E_Compiler_importmap	325684.726173902 ns/iter	279113.8164631618 ns/iter	1.17
E2E_Compiler_jasmine	1512807.9155843037 ns/iter	1345591.4176245579 ns/iter	1.12
E2E_Compiler_jshintrc	4795014.397259739 ns/iter	4170920.8750005257 ns/iter	1.15
E2E_Compiler_jsconfig	23474744.266665462 ns/iter	20405800.529408008 ns/iter	1.15
E2E_Compiler_krakend	146202607.1999844 ns/iter	137395543.00000235 ns/iter	1.06
E2E_Compiler_lazygit	35612276.550000384 ns/iter	32792993.28571705 ns/iter	1.09
E2E_Compiler_lerna	1787816.2531967536 ns/iter	1578114.483069899 ns/iter	1.13
E2E_Compiler_nest_cli	8118681.758620453 ns/iter	7178309.19387668 ns/iter	1.13
E2E_Compiler_omc	166450761.25001878 ns/iter	155154340.25002152 ns/iter	1.07
E2E_Compiler_omnisharp	7368082.624999773 ns/iter	6382353.954545165 ns/iter	1.15
E2E_Compiler_openapi	27107763.230770405 ns/iter	24743870.321434055 ns/iter	1.10
E2E_Compiler_pre_commit_hooks	5805300.826446263 ns/iter	5067890.963767939 ns/iter	1.15
E2E_Compiler_pulumi	4442724.560509873 ns/iter	3969178.0738644926 ns/iter	1.12
E2E_Compiler_semantic_release	1740154.4004975557 ns/iter	1570154.765100511 ns/iter	1.11
E2E_Compiler_stale	1703158.9463413628 ns/iter	1520106.6298701547 ns/iter	1.12
E2E_Compiler_stylecop	6434636.853211085 ns/iter	5528373.7355378335 ns/iter	1.16
E2E_Compiler_tmuxinator	2160267.561349747 ns/iter	1902990.8852460554 ns/iter	1.14
E2E_Compiler_ui5	49689770.42856944 ns/iter	50710981.20001806 ns/iter	0.98
E2E_Compiler_ui5_manifest	327269246.5000091 ns/iter	295698454.99997884 ns/iter	1.11
E2E_Compiler_unreal_engine_uproject	5002669.210000477 ns/iter	4464000.89240457 ns/iter	1.12
E2E_Compiler_users_array	898962.5038561696 ns/iter	815661.875291418 ns/iter	1.10
E2E_Compiler_vercel	13366860.55769248 ns/iter	12003376.931033926 ns/iter	1.11
E2E_Compiler_yamllint	393525.78265767806 ns/iter	341780.0133070596 ns/iter	1.15
E2E_Evaluator_adaptivecard	23295.295136910612 ns/iter	22471.178137650466 ns/iter	1.04
E2E_Evaluator_ansible_meta	246814.81465816524 ns/iter	216356.96780188428 ns/iter	1.14
E2E_Evaluator_aws_cdk	52805.81882158439 ns/iter	44669.064667050996 ns/iter	1.18
E2E_Evaluator_babelrc	104925.89077266742 ns/iter	91865.0889530189 ns/iter	1.14
E2E_Evaluator_cerebrum_criminal_case	1001010.4672362837 ns/iter	1071087.8841463893 ns/iter	0.93
E2E_Evaluator_clang_format	102812.08819221173 ns/iter	99140.08142672153 ns/iter	1.04
E2E_Evaluator_cmake_presets	4400992.581250307 ns/iter	4789778.123287997 ns/iter	0.92
E2E_Evaluator_code_climate	189999.4779371243 ns/iter	197795.3056027064 ns/iter	0.96
E2E_Evaluator_cql2	212301.65934067263 ns/iter	189037.65706525015 ns/iter	1.12
E2E_Evaluator_cspell	545778.3773872965 ns/iter	535233.8434382204 ns/iter	1.02
E2E_Evaluator_cypress	187446.63644891462 ns/iter	159292.3950785973 ns/iter	1.18
E2E_Evaluator_deno	330042.5368026261 ns/iter	345896.6393120015 ns/iter	0.95
E2E_Evaluator_dependabot	365507.36923872586 ns/iter	352603.0655571881 ns/iter	1.04
E2E_Evaluator_draft_04	6803781.480000453 ns/iter	7021453.927835836 ns/iter	0.97
E2E_Evaluator_fabric_mod	765624.9051725855 ns/iter	717036.306418193 ns/iter	1.07
E2E_Evaluator_geojson	15723377.159092294 ns/iter	16699401.499998938 ns/iter	0.94
E2E_Evaluator_gitpod_configuration	251505.67245046343 ns/iter	241832.13432319055 ns/iter	1.04
E2E_Evaluator_helm_chart_lock	306835.04245070985 ns/iter	350460.282153536 ns/iter	0.88
E2E_Evaluator_importmap	47190.383228573315 ns/iter	30230.00687438297 ns/iter	1.56
E2E_Evaluator_jasmine	115154.19222565944 ns/iter	107547.54164105536 ns/iter	1.07
E2E_Evaluator_jshintrc	1071384.589230757 ns/iter	1056307.5015016084 ns/iter	1.01
E2E_Evaluator_jsconfig	406174.6194638661 ns/iter	363556.3761755818 ns/iter	1.12
E2E_Evaluator_krakend	203589.5426740666 ns/iter	172791.68865370785 ns/iter	1.18
E2E_Evaluator_lazygit	132067.34066987416 ns/iter	115834.18195539914 ns/iter	1.14
E2E_Evaluator_lerna	144706.51895286658 ns/iter	172991.8803545029 ns/iter	0.84
E2E_Evaluator_nest_cli	197958.4577803276 ns/iter	190830.97676962966 ns/iter	1.04
E2E_Evaluator_omc	18437.33284891214 ns/iter	18300.10142845797 ns/iter	1.01
E2E_Evaluator_omnisharp	547787.7962381473 ns/iter	568810.0343137666 ns/iter	0.96
E2E_Evaluator_openapi	8990004.46052792 ns/iter	9413426.565215822 ns/iter	0.96
E2E_Evaluator_pre_commit_hooks	499795.11254491215 ns/iter	517546.3457804481 ns/iter	0.97
E2E_Evaluator_pulumi	708765.2401216045 ns/iter	745519.5165067564 ns/iter	0.95
E2E_Evaluator_semantic_release	102275.20109399152 ns/iter	85374.34191264957 ns/iter	1.20
E2E_Evaluator_stale	154449.14592464158 ns/iter	153637.02407006398 ns/iter	1.01
E2E_Evaluator_stylecop	322008.0415391813 ns/iter	280140.1506192493 ns/iter	1.15
E2E_Evaluator_tmuxinator	103885.02894180828 ns/iter	88344.21707470188 ns/iter	1.18
E2E_Evaluator_ui5	524395.8907310384 ns/iter	484837.8726513001 ns/iter	1.08
E2E_Evaluator_ui5_manifest	2688543.121212009 ns/iter	2634341.249071284 ns/iter	1.02
E2E_Evaluator_unreal_engine_uproject	465776.9000666893 ns/iter	443726.2501588044 ns/iter	1.05
E2E_Evaluator_users_array	605607.6841652201 ns/iter	635840.2911736562 ns/iter	0.95
E2E_Evaluator_vercel	303818.5012909357 ns/iter	343137.3000000031 ns/iter	0.89
E2E_Evaluator_yamllint	10500.3258870877 ns/iter	8870.446782145946 ns/iter	1.18

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: 76d4689	Previous: 5b9baeb	Ratio
E2E_Evaluator_adaptivecard	120665 ns	114688 ns	1.05
E2E_Evaluator_ansible-meta	521670 ns	528603 ns	0.99
E2E_Evaluator_aws-cdk	141354 ns	146749 ns	0.96
E2E_Evaluator_babelrc	316201 ns	457604 ns	0.69
E2E_Evaluator_cerebrum-criminal-case	2524455 ns	2731368 ns	0.92
E2E_Evaluator_clang-format	257280 ns	327084 ns	0.79
E2E_Evaluator_cmake-presets	16556707 ns	18728192 ns	0.88
E2E_Evaluator_code-climate	507144 ns	536827 ns	0.94
E2E_Evaluator_cql2	1231167 ns	1209702 ns	1.02
E2E_Evaluator_cspell	1513093 ns	1791023 ns	0.84
E2E_Evaluator_cypress	786169 ns	996070 ns	0.79
E2E_Evaluator_deno	1099480 ns	1141248 ns	0.96
E2E_Evaluator_dependabot	1156982 ns	1170227 ns	0.99
E2E_Evaluator_draft-04	21203189 ns	23493654 ns	0.90
E2E_Evaluator_fabric-mod	2325276 ns	2380023 ns	0.98
E2E_Evaluator_geojson	21646115 ns	25607098 ns	0.85
E2E_Evaluator_gitpod-configuration	710074 ns	795454 ns	0.89
E2E_Evaluator_helm-chart-lock	1004985 ns	1057825 ns	0.95
E2E_Evaluator_importmap	268151 ns	321087 ns	0.84
E2E_Evaluator_jasmine	294055 ns	335445 ns	0.88
E2E_Evaluator_jsconfig	1213911 ns	1613831 ns	0.75
E2E_Evaluator_jshintrc	2723131 ns	3039842 ns	0.90
E2E_Evaluator_krakend	683332 ns	627214 ns	1.09
E2E_Evaluator_lazygit	494000 ns	497056 ns	0.99
E2E_Evaluator_lerna	475613 ns	473022 ns	1.01
E2E_Evaluator_nest-cli	584282 ns	690831 ns	0.85
E2E_Evaluator_omc	89940 ns	85443 ns	1.05
E2E_Evaluator_omnisharp	1394705 ns	1522607 ns	0.92
E2E_Evaluator_openapi	22772338 ns	22942805 ns	0.99
E2E_Evaluator_pre-commit-hooks	1981412 ns	2088913 ns	0.95
E2E_Evaluator_pulumi	1907823 ns	2146153 ns	0.89
E2E_Evaluator_semantic-release	249551 ns	291424 ns	0.86
E2E_Evaluator_stale	402018 ns	436470 ns	0.92
E2E_Evaluator_stylecop	1220414 ns	1269622 ns	0.96
E2E_Evaluator_tmuxinator	231234 ns	288884 ns	0.80
E2E_Evaluator_ui5	2326210 ns	2179398 ns	1.07
E2E_Evaluator_ui5-manifest	10200684 ns	9897538 ns	1.03
E2E_Evaluator_unreal-engine-uproject	1487286 ns	1703687 ns	0.87
E2E_Evaluator_users-array	2781242 ns	2652703 ns	1.05
E2E_Evaluator_vercel	958842 ns	1099856 ns	0.87
E2E_Evaluator_yamllint	25660 ns	27283 ns	0.94

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: 76d4689	Previous: 5b9baeb	Ratio
E2E_Evaluator_adaptivecard	267174 ns	126974 ns	2.10
E2E_Evaluator_ansible-meta	741435 ns	450745 ns	1.64
E2E_Evaluator_aws-cdk	203231 ns	110079 ns	1.85
E2E_Evaluator_babelrc	517913 ns	245125 ns	2.11
E2E_Evaluator_cerebrum-criminal-case	3272524 ns	1546770 ns	2.12
E2E_Evaluator_clang-format	422149 ns	182640 ns	2.31
E2E_Evaluator_cmake-presets	29003264 ns	16716193 ns	1.74
E2E_Evaluator_code-climate	748754 ns	417987 ns	1.79
E2E_Evaluator_cql2	2254247 ns	1111457 ns	2.03
E2E_Evaluator_cspell	3045455 ns	1357816 ns	2.24
E2E_Evaluator_cypress	1338121 ns	766261 ns	1.75
E2E_Evaluator_deno	1737071 ns	887605 ns	1.96
E2E_Evaluator_dependabot	2072699 ns	881709 ns	2.35
E2E_Evaluator_draft-04	38178165 ns	19023313 ns	2.01
E2E_Evaluator_fabric-mod	3983109 ns	2189162 ns	1.82
E2E_Evaluator_geojson	28868971 ns	16426160 ns	1.76
E2E_Evaluator_gitpod-configuration	1105235 ns	674183 ns	1.64
E2E_Evaluator_helm-chart-lock	1852378 ns	1031394 ns	1.80
E2E_Evaluator_importmap	571574 ns	231199 ns	2.47
E2E_Evaluator_jasmine	382661 ns	240705 ns	1.59
E2E_Evaluator_jsconfig	1850601 ns	1061393 ns	1.74
E2E_Evaluator_jshintrc	3962509 ns	2221366 ns	1.78
E2E_Evaluator_krakend	995236 ns	465359 ns	2.14
E2E_Evaluator_lazygit	606950 ns	325640 ns	1.86
E2E_Evaluator_lerna	723095 ns	434064 ns	1.67
E2E_Evaluator_nest-cli	843415 ns	558700 ns	1.51
E2E_Evaluator_omc	170769 ns	76718 ns	2.23
E2E_Evaluator_omnisharp	2202046 ns	1021763 ns	2.16
E2E_Evaluator_openapi	32775036 ns	16915298 ns	1.94
E2E_Evaluator_pre-commit-hooks	2841213 ns	1385574 ns	2.05
E2E_Evaluator_pulumi	3127075 ns	1580227 ns	1.98
E2E_Evaluator_semantic-release	401977 ns	191236 ns	2.10
E2E_Evaluator_stale	605717 ns	343256 ns	1.76
E2E_Evaluator_stylecop	2393215 ns	982906 ns	2.43
E2E_Evaluator_tmuxinator	343808 ns	169810 ns	2.02
E2E_Evaluator_ui5	3299666 ns	1667945 ns	1.98
E2E_Evaluator_ui5-manifest	20857802 ns	8743959 ns	2.39
E2E_Evaluator_unreal-engine-uproject	2685524 ns	1265510 ns	2.12
E2E_Evaluator_users-array	5265792 ns	2247534 ns	2.34
E2E_Evaluator_vercel	1217746 ns	833511 ns	1.46
E2E_Evaluator_yamllint	42816 ns	30361 ns	1.41

This comment was automatically generated by workflow using github-action-benchmark.