Skip to content

Implement with direct instruction overloads#728

Merged
jviotti merged 4 commits into
mainfrom
experiments
Apr 16, 2026
Merged

Implement with direct instruction overloads#728
jviotti merged 4 commits into
mainfrom
experiments

Conversation

@jviotti

@jviotti jviotti commented Apr 16, 2026

Copy link
Copy Markdown
Member

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

jviotti added 2 commits April 16, 2026 13:30
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@jviotti jviotti marked this pull request as ready for review April 16, 2026 17:31
@jviotti jviotti changed the title [WIP] Experiment with direct instruction overloads Implement with direct instruction overloads Apr 16, 2026
@augmentcode

augmentcode Bot commented Apr 16, 2026

Copy link
Copy Markdown
🤖 Augment PR Summary

Summary: This PR experiments with “direct” instruction overloads to reduce evaluator dispatch overhead, and refactors the fast-path for validating object properties.

Changes:

  • Introduces `INSTRUCTION_DIRECT*`/`DIRECT()` helpers and adds direct-eval implementations for several common assertion instructions.
  • Updates instruction handlers (e.g., type checks, equality, bounded checks) to delegate to the direct-eval helpers.
  • Reworks AssertionObjectPropertiesSimple to iterate instance properties, track matched schema properties via a bitmask, and directly evaluate common child instructions without callback overhead.
  • Adds a compiler-side guard to avoid emitting AssertionObjectPropertiesSimple when the fused property set exceeds 32 entries.
  • Refactors LoopItemsIntegerBounded into a direct-eval routine used by the new fast-path.
  • Adds evaluator tests covering the 32-property fusion limit and behavior when required properties are missing.

Technical Notes: The new object-properties fast-path relies on a 32-bit “seen” mask to track which schema properties were encountered during instance iteration.

🤖 Was this summary useful? React with 👍 or 👎

@augmentcode augmentcode Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread src/evaluator/include/sourcemeta/blaze/evaluator_dispatch.h Outdated
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 3 files

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="src/evaluator/include/sourcemeta/blaze/evaluator_dispatch.h">

<violation number="1" location="src/evaluator/include/sourcemeta/blaze/evaluator_dispatch.h:1014">
P1: The completeness mask is undefined for schemas with exactly 32 fused properties.</violation>
</file>

Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.

Comment thread src/evaluator/include/sourcemeta/blaze/evaluator_dispatch.h Outdated
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: e755877 Previous: 3243d56 Ratio
E2E_Compiler_adaptivecard 61640397.19999437 ns/iter 65123607.99999644 ns/iter 0.95
E2E_Compiler_ansible_meta 25852900.703705892 ns/iter 29345848.624998894 ns/iter 0.88
E2E_Compiler_aws_cdk 330448.97640396684 ns/iter 383470.25684559584 ns/iter 0.86
E2E_Compiler_babelrc 2255410.9677417404 ns/iter 2603406.2602230334 ns/iter 0.87
E2E_Compiler_clang_format 16134207.651161041 ns/iter 18536449.342105385 ns/iter 0.87
E2E_Compiler_cmake_presets 23824156.066666547 ns/iter 26021399.555555005 ns/iter 0.92
E2E_Compiler_code_climate 2310902.7631581337 ns/iter 2648363.7698113015 ns/iter 0.87
E2E_Compiler_cql2 12138525.086205894 ns/iter 13018892.425925009 ns/iter 0.93
E2E_Compiler_cspell 21621904.484849244 ns/iter 23106513.899998996 ns/iter 0.94
E2E_Compiler_cypress 3502186.2900003954 ns/iter 3978248.6022730265 ns/iter 0.88
E2E_Compiler_deno 6685372.599999287 ns/iter 7915569.544444325 ns/iter 0.84
E2E_Compiler_dependabot 3479893.3333334783 ns/iter 3975135.818182258 ns/iter 0.88
E2E_Compiler_draft_04 2393154.1058019125 ns/iter 2709580.410852553 ns/iter 0.88
E2E_Compiler_fabric_mod 4213025.487951863 ns/iter 4819598.738805978 ns/iter 0.87
E2E_Compiler_geojson 20288834.571429756 ns/iter 22233950.18749841 ns/iter 0.91
E2E_Compiler_gitpod_configuration 4324646.666666355 ns/iter 4928435.802816732 ns/iter 0.88
E2E_Compiler_helm_chart_lock 602721.0666089224 ns/iter 714200.3159508555 ns/iter 0.84
E2E_Compiler_importmap 248484.0574919234 ns/iter 289766.1815181715 ns/iter 0.86
E2E_Compiler_jasmine 1201033.1871750602 ns/iter 1381190.0276679625 ns/iter 0.87
E2E_Compiler_jshintrc 3701374.82795699 ns/iter 4388760.006289137 ns/iter 0.84
E2E_Compiler_jsconfig 18968159.108109485 ns/iter 22159275.65625009 ns/iter 0.86
E2E_Compiler_krakend 127394668.66666286 ns/iter 148985929.80000558 ns/iter 0.86
E2E_Compiler_lazygit 30269518.086954676 ns/iter 33704958.95238231 ns/iter 0.90
E2E_Compiler_lerna 1402313.7680001128 ns/iter 1622468.5697675024 ns/iter 0.86
E2E_Compiler_nest_cli 6524342.157407378 ns/iter 7530242.086021087 ns/iter 0.87
E2E_Compiler_omc 149451249.20000127 ns/iter 164948962.0000111 ns/iter 0.91
E2E_Compiler_omnisharp 5783572.438016458 ns/iter 6793450.291261207 ns/iter 0.85
E2E_Compiler_openapi 22508590.419354204 ns/iter 25167231.964287244 ns/iter 0.89
E2E_Compiler_pre_commit_hooks 4648303.059210578 ns/iter 5358502.900764179 ns/iter 0.87
E2E_Compiler_pulumi 3539050.3857865836 ns/iter 4074430.738372421 ns/iter 0.87
E2E_Compiler_semantic_release 1404303.7690763562 ns/iter 1589214.5421412662 ns/iter 0.88
E2E_Compiler_stale 1355819.1937983949 ns/iter 1569541.810810891 ns/iter 0.86
E2E_Compiler_stylecop 5224231.281481985 ns/iter 6229462.2410712065 ns/iter 0.84
E2E_Compiler_tmuxinator 1702614.963680288 ns/iter 1973098.6536310867 ns/iter 0.86
E2E_Compiler_ui5 44555071.562498935 ns/iter 47645426.8571404 ns/iter 0.94
E2E_Compiler_ui5_manifest 289632250.000011 ns/iter 318582821.5000015 ns/iter 0.91
E2E_Compiler_unreal_engine_uproject 4011074.2171431673 ns/iter 4643230.15893982 ns/iter 0.86
E2E_Compiler_users_array 717135.5030674479 ns/iter 798393.7616875134 ns/iter 0.90
E2E_Compiler_vercel 11268823.500001287 ns/iter 12598046.017856745 ns/iter 0.89
E2E_Compiler_yamllint 305727.1465555066 ns/iter 352193.1965227087 ns/iter 0.87
E2E_Evaluator_adaptivecard 20996.03096003295 ns/iter 26295.280213027545 ns/iter 0.80
E2E_Evaluator_ansible_meta 198586.32937854764 ns/iter 232821.76350660087 ns/iter 0.85
E2E_Evaluator_aws_cdk 42820.08449334675 ns/iter 50829.46650141587 ns/iter 0.84
E2E_Evaluator_babelrc 89634.20315735468 ns/iter 109658.52722694185 ns/iter 0.82
E2E_Evaluator_cerebrum_criminal_case 1000709.820809401 ns/iter 957020.218836621 ns/iter 1.05
E2E_Evaluator_clang_format 116522.92037432324 ns/iter 122909.477320318 ns/iter 0.95
E2E_Evaluator_cmake_presets 4438802.600000002 ns/iter 5059979.330000033 ns/iter 0.88
E2E_Evaluator_code_climate 187644.6146838059 ns/iter 188742.09867020007 ns/iter 0.99
E2E_Evaluator_cql2 182532.154404146 ns/iter 212228.95945536427 ns/iter 0.86
E2E_Evaluator_cspell 541211.0996077864 ns/iter 561355.5764331027 ns/iter 0.96
E2E_Evaluator_cypress 174666.71711351088 ns/iter 194338.7260917522 ns/iter 0.90
E2E_Evaluator_deno 313594.5872662493 ns/iter 309616.6743875325 ns/iter 1.01
E2E_Evaluator_dependabot 315408.4039072878 ns/iter 334321.9722089072 ns/iter 0.94
E2E_Evaluator_draft_04 7919606.595505632 ns/iter 9330211.38157947 ns/iter 0.85
E2E_Evaluator_fabric_mod 644807.0770659078 ns/iter 671157.3355576094 ns/iter 0.96
E2E_Evaluator_geojson 16027677.795454502 ns/iter 16002613.386363734 ns/iter 1.00
E2E_Evaluator_gitpod_configuration 225737.24750881616 ns/iter 232853.83977719437 ns/iter 0.97
E2E_Evaluator_helm_chart_lock 392719.02233390877 ns/iter 354055.76314447983 ns/iter 1.11
E2E_Evaluator_importmap 36650.79464465323 ns/iter 48219.30467365567 ns/iter 0.76
E2E_Evaluator_jasmine 95218.59245643277 ns/iter 109218.34915676492 ns/iter 0.87
E2E_Evaluator_jshintrc 1133844.4732576916 ns/iter 1206894.2607944678 ns/iter 0.94
E2E_Evaluator_jsconfig 380400.9550379159 ns/iter 425977.00000000553 ns/iter 0.89
E2E_Evaluator_krakend 175545.1596173312 ns/iter 206794.19652488834 ns/iter 0.85
E2E_Evaluator_lazygit 128063.2501385676 ns/iter 149479.2280516223 ns/iter 0.86
E2E_Evaluator_lerna 129947.80668659357 ns/iter 137618.26061087765 ns/iter 0.94
E2E_Evaluator_nest_cli 174354.4156775604 ns/iter 177414.7790519641 ns/iter 0.98
E2E_Evaluator_omc 16378.123206867269 ns/iter 19310.22784599812 ns/iter 0.85
E2E_Evaluator_omnisharp 553491.0954258582 ns/iter 611693.1387683825 ns/iter 0.90
E2E_Evaluator_openapi 10154393.98529385 ns/iter 10621023.415386004 ns/iter 0.96
E2E_Evaluator_pre_commit_hooks 490951.04353936354 ns/iter 468876.2365951752 ns/iter 1.05
E2E_Evaluator_pulumi 698972.1773049524 ns/iter 667798.7309160471 ns/iter 1.05
E2E_Evaluator_semantic_release 77756.68852091493 ns/iter 97949.03927534183 ns/iter 0.79
E2E_Evaluator_stale 138249.16059701677 ns/iter 153606.37639831344 ns/iter 0.90
E2E_Evaluator_stylecop 288259.7640032943 ns/iter 285147.4105263582 ns/iter 1.01
E2E_Evaluator_tmuxinator 80675.49774749872 ns/iter 96015.39409202515 ns/iter 0.84
E2E_Evaluator_ui5 459396.30348914827 ns/iter 505460.9850634179 ns/iter 0.91
E2E_Evaluator_ui5_manifest 2401577.5290102316 ns/iter 2467501.11785689 ns/iter 0.97
E2E_Evaluator_unreal_engine_uproject 427625.3827839061 ns/iter 432733.357894732 ns/iter 0.99
E2E_Evaluator_users_array 568419.8904333215 ns/iter 680782.8156862636 ns/iter 0.83
E2E_Evaluator_vercel 321926.32062471745 ns/iter 307588.24250322365 ns/iter 1.05
E2E_Evaluator_yamllint 7456.498725801235 ns/iter 9026.880821624056 ns/iter 0.83
Micro_Draft4_Meta_1_No_Callback 188.8867059188932 ns/iter 190.00692363689362 ns/iter 0.99
Micro_Draft4_Required_Properties 816.4399707557308 ns/iter 874.0680031799344 ns/iter 0.93
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.74679023806825 ns/iter 21.637076329871082 ns/iter 1.01
Micro_Draft4_Few_Optional_Properties_Minimal_Match 10.054342918403195 ns/iter 11.205051641122072 ns/iter 0.90
Micro_Draft4_Items_Schema 284.67223833966204 ns/iter 287.91176574567623 ns/iter 0.99
Micro_Draft4_Nested_Object 1.1533871654033128 ns/iter 1.8206473744843918 ns/iter 0.63
Micro_Draft4_Properties_Triad_Optional 301.6711020303688 ns/iter 318.28178440392145 ns/iter 0.95
Micro_Draft4_Properties_Triad_Closed 254.20000512254808 ns/iter 263.0765354307927 ns/iter 0.97
Micro_Draft4_Properties_Triad_Required 311.6230371497203 ns/iter 343.53572110709484 ns/iter 0.91
Micro_Draft4_Properties_Closed 53.616902416425475 ns/iter 55.71762994947032 ns/iter 0.96
Micro_Draft4_Non_Recursive_Ref 10.38805480792531 ns/iter 11.467051951454696 ns/iter 0.91
Micro_Draft4_Pattern_Properties_True 119.00877528566728 ns/iter 164.67239825813186 ns/iter 0.72
Micro_Draft4_Ref_To_Single_Property 10.087122184425109 ns/iter 11.219508584388683 ns/iter 0.90
Micro_Draft4_Additional_Properties_Type 19.028540183640786 ns/iter 21.257654696768256 ns/iter 0.90
Micro_Draft4_Nested_Oneof 47.059615845396024 ns/iter 56.680288766999695 ns/iter 0.83
Micro_Draft4_Short_Enum 10.422887511172641 ns/iter 11.837624422236884 ns/iter 0.88
Micro_Draft4_Long_Enum 10.411799324047243 ns/iter 15.255756765331151 ns/iter 0.68
Micro_Draft4_Long_Enum_Short_Strings 10.39699508975932 ns/iter 11.83851893292263 ns/iter 0.88
Micro_Draft4_Type_Object 2.883061373915253 ns/iter 3.7376175832893064 ns/iter 0.77
Micro_Draft4_Ref_Single_100 2088055.464071544 ns/iter 2394605.887371862 ns/iter 0.87
Micro_Draft4_Compile_Ref_Many_Nested 1535262.3618422025 ns/iter 1729796.9654321235 ns/iter 0.89
Micro_Draft4_Compile_Wrap 2101888.1114455545 ns/iter 2371443.383050696 ns/iter 0.89
Micro_Draft6_Property_Names 113.88424858354 ns/iter 118.7428700020182 ns/iter 0.96
Micro_Draft6_Compile_FHIR 18177169295.99999 ns/iter 14189615287.000038 ns/iter 1.28
Micro_Draft7_If_Then_Else 20.31127261742432 ns/iter 23.346556699799418 ns/iter 0.87
Micro_2019_09_Unevaluated_Properties 26.01021414489698 ns/iter 27.770793895161297 ns/iter 0.94
Micro_2019_09_Compile_Wrap 279098361.9999755 ns/iter 302335993.49998033 ns/iter 0.92
Micro_2020_12_Dynamic_Ref 298.1852341669658 ns/iter 225.88895064181835 ns/iter 1.32
Micro_2020_12_Dynamic_Ref_Single 2.8815892537740506 ns/iter 3.4244722257445197 ns/iter 0.84
Micro_2020_12_Simple_Output_Mask 919.6952357134513 ns/iter 1074.9458122883093 ns/iter 0.86
Micro_2020_12_Simple_Output_Annotations 96864.09607292777 ns/iter 104184.21433796531 ns/iter 0.93
Micro_2020_12_Compile_NonCircular_Shared_Refs 976365.1328671427 ns/iter 1098559.16560515 ns/iter 0.89
Micro_2020_12_Exhaustive_Deep_Numeric 8341.122789233525 ns/iter 8528.792656254103 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 153235.5146160482 ns/iter 179812.52526800142 ns/iter 0.85
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 20891.612711055175 ns/iter 22212.581405668065 ns/iter 0.94
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 135.53278131246586 ns/iter 142.23999458020353 ns/iter 0.95
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 3760.465976061471 ns/iter 4335.839533545494 ns/iter 0.87
Alterschema_Check_Readibility_ISO_Language_Set_3 315600063.0000335 ns/iter 355430121.4999782 ns/iter 0.89
Alterschema_Check_Readibility_OMC 89125826.12499875 ns/iter 85496268.12499866 ns/iter 1.04
Alterschema_Check_Readibility_KrakenD 1436170590.0000744 ns/iter 1215596925.9999893 ns/iter 1.18
Alterschema_Apply_Readibility_KrakenD 139942166133 ns/iter 120622362926.00005 ns/iter 1.16
Alterschema_Check_Invalid_External_Refs 225901326.3333145 ns/iter 302096923.0000219 ns/iter 0.75

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: e755877 Previous: 3243d56 Ratio
E2E_Evaluator_adaptivecard 109881 ns 113601 ns 0.97
E2E_Evaluator_ansible-meta 507239 ns 516033 ns 0.98
E2E_Evaluator_aws-cdk 144283 ns 140157 ns 1.03
E2E_Evaluator_babelrc 434653 ns 308691 ns 1.41
E2E_Evaluator_cerebrum-criminal-case 2408419 ns 2383160 ns 1.01
E2E_Evaluator_clang-format 311368 ns 265346 ns 1.17
E2E_Evaluator_cmake-presets 18779036 ns 18618263 ns 1.01
E2E_Evaluator_code-climate 524482 ns 491144 ns 1.07
E2E_Evaluator_cql2 1164412 ns 1178269 ns 0.99
E2E_Evaluator_cspell 1665184 ns 1457074 ns 1.14
E2E_Evaluator_cypress 990969 ns 776630 ns 1.28
E2E_Evaluator_deno 1051354 ns 1020835 ns 1.03
E2E_Evaluator_dependabot 1068067 ns 1043661 ns 1.02
E2E_Evaluator_draft-04 21007852 ns 24041786 ns 0.87
E2E_Evaluator_fabric-mod 2282450 ns 2372925 ns 0.96
E2E_Evaluator_geojson 27032181 ns 27796782 ns 0.97
E2E_Evaluator_gitpod-configuration 788080 ns 703382 ns 1.12
E2E_Evaluator_helm-chart-lock 1056591 ns 1018027 ns 1.04
E2E_Evaluator_importmap 322561 ns 280243 ns 1.15
E2E_Evaluator_jasmine 342102 ns 304011 ns 1.13
E2E_Evaluator_jsconfig 1665518 ns 1256627 ns 1.33
E2E_Evaluator_jshintrc 3126086 ns 2890582 ns 1.08
E2E_Evaluator_krakend 635961 ns 707840 ns 0.90
E2E_Evaluator_lazygit 470724 ns 506884 ns 0.93
E2E_Evaluator_lerna 456697 ns 462417 ns 0.99
E2E_Evaluator_nest-cli 691312 ns 574838 ns 1.20
E2E_Evaluator_omc 82641 ns 87798 ns 0.94
E2E_Evaluator_omnisharp 1536129 ns 1431610 ns 1.07
E2E_Evaluator_openapi 23394538 ns 26290741 ns 0.89
E2E_Evaluator_pre-commit-hooks 2008058 ns 1939588 ns 1.04
E2E_Evaluator_pulumi 2071787 ns 1912742 ns 1.08
E2E_Evaluator_semantic-release 306039 ns 260548 ns 1.17
E2E_Evaluator_stale 427405 ns 394791 ns 1.08
E2E_Evaluator_stylecop 1123372 ns 1132258 ns 0.99
E2E_Evaluator_tmuxinator 294637 ns 228733 ns 1.29
E2E_Evaluator_ui5 2016596 ns 2059021 ns 0.98
E2E_Evaluator_ui5-manifest 9670618 ns 12508262 ns 0.77
E2E_Evaluator_unreal-engine-uproject 1619993 ns 1498698 ns 1.08
E2E_Evaluator_users-array 2129264 ns 2274438 ns 0.94
E2E_Evaluator_vercel 1040151 ns 955536 ns 1.09
E2E_Evaluator_yamllint 28797 ns 28531 ns 1.01

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: e755877 Previous: 3243d56 Ratio
E2E_Compiler_adaptivecard 105684208.2857169 ns/iter 63334317.75001941 ns/iter 1.67
E2E_Compiler_ansible_meta 38743261.61111538 ns/iter 25489053.571431797 ns/iter 1.52
E2E_Compiler_aws_cdk 454481.5441176846 ns/iter 287527.48191319354 ns/iter 1.58
E2E_Compiler_babelrc 3454410.331797141 ns/iter 2410397.123778494 ns/iter 1.43
E2E_Compiler_clang_format 23012658.33333067 ns/iter 18264019.736839622 ns/iter 1.26
E2E_Compiler_cmake_presets 52705700.00000134 ns/iter 26994621.80769038 ns/iter 1.95
E2E_Compiler_code_climate 3426997.644067722 ns/iter 2270051.453968422 ns/iter 1.51
E2E_Compiler_cql2 17553554.909090444 ns/iter 12028693.965519246 ns/iter 1.46
E2E_Compiler_cspell 30049399.99999806 ns/iter 19441279.771425407 ns/iter 1.55
E2E_Compiler_cypress 5629192.964538851 ns/iter 3621785.191709904 ns/iter 1.55
E2E_Compiler_deno 10527890.112500416 ns/iter 6911112.113401913 ns/iter 1.52
E2E_Compiler_dependabot 5025091.424459729 ns/iter 3723544.1459464757 ns/iter 1.35
E2E_Compiler_draft_04 3186766.771186335 ns/iter 2108660.429378477 ns/iter 1.51
E2E_Compiler_fabric_mod 5283236.249999845 ns/iter 3712953.5105266673 ns/iter 1.42
E2E_Compiler_geojson 32666666.666666325 ns/iter 22838539.062497888 ns/iter 1.43
E2E_Compiler_gitpod_configuration 5741207.615384956 ns/iter 4923357.258065798 ns/iter 1.17
E2E_Compiler_helm_chart_lock 788760.2761823933 ns/iter 537624.6821646398 ns/iter 1.47
E2E_Compiler_importmap 349105.63520510314 ns/iter 212131.15106119425 ns/iter 1.65
E2E_Compiler_jasmine 1566439.0197237604 ns/iter 1109722.2900640592 ns/iter 1.41
E2E_Compiler_jshintrc 5119100.475177214 ns/iter 3395034.2870816686 ns/iter 1.51
E2E_Compiler_jsconfig 28150367.296297595 ns/iter 19712218.749999817 ns/iter 1.43
E2E_Compiler_krakend 211389614.4999785 ns/iter 142867614.5000054 ns/iter 1.48
E2E_Compiler_lazygit 49994963.93333326 ns/iter 34641708.33333247 ns/iter 1.44
E2E_Compiler_lerna 1967668.00000008 ns/iter 1360440.3327203793 ns/iter 1.45
E2E_Compiler_nest_cli 8425794.999999426 ns/iter 6331235.745613796 ns/iter 1.33
E2E_Compiler_omc 288269653.0000051 ns/iter 176402114.74997613 ns/iter 1.63
E2E_Compiler_omnisharp 8325811.643835737 ns/iter 5986978.991869342 ns/iter 1.39
E2E_Compiler_openapi 34624649.29166723 ns/iter 25679476.00000204 ns/iter 1.35
E2E_Compiler_pre_commit_hooks 5998686.92660631 ns/iter 4227145.833333452 ns/iter 1.42
E2E_Compiler_pulumi 7488786.666666935 ns/iter 3253223.5233647274 ns/iter 2.30
E2E_Compiler_semantic_release 2302225.0431470955 ns/iter 1219440.0162160993 ns/iter 1.89
E2E_Compiler_stale 2242771.794871819 ns/iter 1235804.2735503777 ns/iter 1.81
E2E_Compiler_stylecop 8528039.893616443 ns/iter 5545035.527131066 ns/iter 1.54
E2E_Compiler_tmuxinator 2297572.704081603 ns/iter 1551402.59060407 ns/iter 1.48
E2E_Compiler_ui5 74616359.37499978 ns/iter 55990605.76922127 ns/iter 1.33
E2E_Compiler_ui5_manifest 435089833.5000011 ns/iter 303560458.49998736 ns/iter 1.43
E2E_Compiler_unreal_engine_uproject 5525968.340000417 ns/iter 3853574.0212770426 ns/iter 1.43
E2E_Compiler_users_array 1127210.3509833969 ns/iter 813953.5458562003 ns/iter 1.38
E2E_Compiler_vercel 17517276.500001345 ns/iter 12672786.728810519 ns/iter 1.38
E2E_Compiler_yamllint 394126.86870895594 ns/iter 312609.78612712986 ns/iter 1.26
E2E_Evaluator_adaptivecard 23324.70287817008 ns/iter 18548.907038241796 ns/iter 1.26
E2E_Evaluator_ansible_meta 242254.81599499084 ns/iter 160348.99677124713 ns/iter 1.51
E2E_Evaluator_aws_cdk 58560.650000003996 ns/iter 33241.91186685354 ns/iter 1.76
E2E_Evaluator_babelrc 137900.76808765015 ns/iter 77789.81665605292 ns/iter 1.77
E2E_Evaluator_cerebrum_criminal_case 963292.8229855612 ns/iter 649511.9202834169 ns/iter 1.48
E2E_Evaluator_clang_format 128505.74678688456 ns/iter 94930.65908200321 ns/iter 1.35
E2E_Evaluator_cmake_presets 5131560.412500846 ns/iter 3247552.4162897496 ns/iter 1.58
E2E_Evaluator_code_climate 216756.08462309 ns/iter 123387.60416666142 ns/iter 1.76
E2E_Evaluator_cql2 234077.92266069492 ns/iter 150140.03385102923 ns/iter 1.56
E2E_Evaluator_cspell 603084.5768218793 ns/iter 396071.2090208627 ns/iter 1.52
E2E_Evaluator_cypress 212959.325703693 ns/iter 133994.51005920544 ns/iter 1.59
E2E_Evaluator_deno 282697.24569819495 ns/iter 223227.5544249097 ns/iter 1.27
E2E_Evaluator_dependabot 316051.72368948266 ns/iter 335276.82473776577 ns/iter 0.94
E2E_Evaluator_draft_04 6566997.71874969 ns/iter 6020488.577777778 ns/iter 1.09
E2E_Evaluator_fabric_mod 845602.2595673207 ns/iter 560885.6249998553 ns/iter 1.51
E2E_Evaluator_geojson 12596888.894737085 ns/iter 12120683.785716275 ns/iter 1.04
E2E_Evaluator_gitpod_configuration 172756.40445055792 ns/iter 192015.11932652368 ns/iter 0.90
E2E_Evaluator_helm_chart_lock 217167.4791478834 ns/iter 229134.2428673627 ns/iter 0.95
E2E_Evaluator_importmap 44711.846612495494 ns/iter 32770.57811428214 ns/iter 1.36
E2E_Evaluator_jasmine 116872.90035758294 ns/iter 102440.43825603626 ns/iter 1.14
E2E_Evaluator_jshintrc 1020582.850993071 ns/iter 1079831.0276563023 ns/iter 0.95
E2E_Evaluator_jsconfig 360662.76946279267 ns/iter 328980.3695150125 ns/iter 1.10
E2E_Evaluator_krakend 126336.0574839438 ns/iter 141010.05434781656 ns/iter 0.90
E2E_Evaluator_lazygit 98730.6687991394 ns/iter 102375.21183174773 ns/iter 0.96
E2E_Evaluator_lerna 111061.93190573638 ns/iter 116340.62926435299 ns/iter 0.95
E2E_Evaluator_nest_cli 117450.12192605059 ns/iter 133787.92735041422 ns/iter 0.88
E2E_Evaluator_omc 12944.416503558152 ns/iter 15047.299830204998 ns/iter 0.86
E2E_Evaluator_omnisharp 516951.54200001527 ns/iter 493152.1827177491 ns/iter 1.05
E2E_Evaluator_openapi 6812915.816326217 ns/iter 5863844.512194236 ns/iter 1.16
E2E_Evaluator_pre_commit_hooks 320104.5102346962 ns/iter 348777.44360893307 ns/iter 0.92
E2E_Evaluator_pulumi 511028.04200013453 ns/iter 688802.7059829208 ns/iter 0.74
E2E_Evaluator_semantic_release 70657.67243092322 ns/iter 74870.49241181542 ns/iter 0.94
E2E_Evaluator_stale 111983.4694671602 ns/iter 121440.443880248 ns/iter 0.92
E2E_Evaluator_stylecop 179763.89584406573 ns/iter 205314.52044164573 ns/iter 0.88
E2E_Evaluator_tmuxinator 67240.4096034339 ns/iter 76773.21567484841 ns/iter 0.88
E2E_Evaluator_ui5 331401.6986817062 ns/iter 354474.6271452022 ns/iter 0.93
E2E_Evaluator_ui5_manifest 1541218.632516569 ns/iter 1967325.3916447503 ns/iter 0.78
E2E_Evaluator_unreal_engine_uproject 314238.3888888858 ns/iter 341811.47298587643 ns/iter 0.92
E2E_Evaluator_users_array 408459.51916372764 ns/iter 617535.5919998158 ns/iter 0.66
E2E_Evaluator_vercel 214482.5118391051 ns/iter 247148.08339452674 ns/iter 0.87
E2E_Evaluator_yamllint 6100.911891091474 ns/iter 6588.514717451714 ns/iter 0.93
Micro_Draft4_Meta_1_No_Callback 126.17800357649688 ns/iter 134.43944645349438 ns/iter 0.94
Micro_Draft4_Required_Properties 621.6405066725039 ns/iter 651.5156384657464 ns/iter 0.95
Micro_Draft4_Many_Optional_Properties_Minimal_Match 15.907909328607555 ns/iter 24.894397989284126 ns/iter 0.64
Micro_Draft4_Few_Optional_Properties_Minimal_Match 6.957808554305821 ns/iter 9.024603719713221 ns/iter 0.77
Micro_Draft4_Items_Schema 267.89033129510176 ns/iter 275.90195273885 ns/iter 0.97
Micro_Draft4_Nested_Object 0.6791525037349198 ns/iter 0.7442753361378756 ns/iter 0.91
Micro_Draft4_Properties_Triad_Optional 195.06210862660373 ns/iter 209.16801462724638 ns/iter 0.93
Micro_Draft4_Properties_Triad_Closed 161.43557738260427 ns/iter 192.3336702627979 ns/iter 0.84
Micro_Draft4_Properties_Triad_Required 211.48942861076594 ns/iter 223.02475351130948 ns/iter 0.95
Micro_Draft4_Properties_Closed 36.75108912675375 ns/iter 38.42397320956992 ns/iter 0.96
Micro_Draft4_Non_Recursive_Ref 12.33545613681706 ns/iter 13.119438524418703 ns/iter 0.94
Micro_Draft4_Pattern_Properties_True 131.86021571931855 ns/iter 152.4266735722784 ns/iter 0.87
Micro_Draft4_Ref_To_Single_Property 6.8433572698220075 ns/iter 7.345484336216691 ns/iter 0.93
Micro_Draft4_Additional_Properties_Type 24.630621422752235 ns/iter 26.343402891800025 ns/iter 0.93
Micro_Draft4_Nested_Oneof 40.690481150023 ns/iter 50.380487500024174 ns/iter 0.81
Micro_Draft4_Short_Enum 4.840597075771649 ns/iter 5.714578357148465 ns/iter 0.85
Micro_Draft4_Long_Enum 9.969738920658783 ns/iter 10.550880000544938 ns/iter 0.94
Micro_Draft4_Long_Enum_Short_Strings 6.20032930539004 ns/iter 6.387192531071904 ns/iter 0.97
Micro_Draft4_Type_Object 2.120415472065131 ns/iter 2.2867838331665036 ns/iter 0.93
Micro_Draft4_Ref_Single_100 1646097.3172411025 ns/iter 2046917.3959895384 ns/iter 0.80
Micro_Draft4_Compile_Ref_Many_Nested 1197370.4741378776 ns/iter 1291075.2403845785 ns/iter 0.93
Micro_Draft4_Compile_Wrap 1930152.661156517 ns/iter 2202655.0711981473 ns/iter 0.88
Micro_Draft6_Property_Names 92.84675727227854 ns/iter 103.24345071089076 ns/iter 0.90
Micro_Draft6_Compile_FHIR 8486889250.000104 ns/iter 12761245832.999975 ns/iter 0.67
Micro_Draft7_If_Then_Else 17.646270138323143 ns/iter 18.395119289093778 ns/iter 0.96
Micro_2019_09_Unevaluated_Properties 26.238788079542296 ns/iter 27.848772324217514 ns/iter 0.94
Micro_2019_09_Compile_Wrap 297957332.9999994 ns/iter 423191395.49999815 ns/iter 0.70
Micro_2020_12_Dynamic_Ref 181.69857580311256 ns/iter 235.06681581779796 ns/iter 0.77
Micro_2020_12_Dynamic_Ref_Single 2.175207689736997 ns/iter 2.43769368496607 ns/iter 0.89
Micro_2020_12_Simple_Output_Mask 781.5152741501189 ns/iter 889.5204384532661 ns/iter 0.88
Micro_2020_12_Simple_Output_Annotations 83899.24643712651 ns/iter 95308.3051398297 ns/iter 0.88
Micro_2020_12_Compile_NonCircular_Shared_Refs 808292.1528587437 ns/iter 913548.6440283116 ns/iter 0.88
Micro_2020_12_Exhaustive_Deep_Numeric 5200.915132549444 ns/iter 5253.990568090646 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 115754.06681477968 ns/iter 116961.09555300014 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 14376.956517402516 ns/iter 14236.267422514424 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 91.39134086400988 ns/iter 93.50124840593648 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4665.635120573777 ns/iter 5148.884237568722 ns/iter 0.91
Alterschema_Check_Readibility_ISO_Language_Set_3 220546166.6666603 ns/iter 294478513.66664207 ns/iter 0.75
Alterschema_Check_Readibility_OMC 56111544.84614207 ns/iter 91079430.55556057 ns/iter 0.62
Alterschema_Check_Readibility_KrakenD 592924291.9999069 ns/iter 857433291.9997687 ns/iter 0.69
Alterschema_Apply_Readibility_KrakenD 69356846041.99991 ns/iter 78883855832.99988 ns/iter 0.88
Alterschema_Check_Invalid_External_Refs 164805447.74998406 ns/iter 168558770.99999362 ns/iter 0.98

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: e755877 Previous: 3243d56 Ratio
E2E_Evaluator_adaptivecard 112541 ns 102273 ns 1.10
E2E_Evaluator_ansible-meta 417373 ns 394223 ns 1.06
E2E_Evaluator_aws-cdk 125883 ns 145256 ns 0.87
E2E_Evaluator_babelrc 279476 ns 290539 ns 0.96
E2E_Evaluator_cerebrum-criminal-case 2006017 ns 1806914 ns 1.11
E2E_Evaluator_clang-format 227674 ns 200569 ns 1.14
E2E_Evaluator_cmake-presets 14323713 ns 12885938 ns 1.11
E2E_Evaluator_code-climate 649012 ns 406350 ns 1.60
E2E_Evaluator_cql2 1121264 ns 1051243 ns 1.07
E2E_Evaluator_cspell 1239893 ns 1207043 ns 1.03
E2E_Evaluator_cypress 654946 ns 635595 ns 1.03
E2E_Evaluator_deno 697007 ns 754990 ns 0.92
E2E_Evaluator_dependabot 721600 ns 728135 ns 0.99
E2E_Evaluator_draft-04 16134865 ns 16067553 ns 1.00
E2E_Evaluator_fabric-mod 1556999 ns 1551307 ns 1.00
E2E_Evaluator_geojson 19371832 ns 17944491 ns 1.08
E2E_Evaluator_gitpod-configuration 513002 ns 588988 ns 0.87
E2E_Evaluator_helm-chart-lock 901933 ns 962226 ns 0.94
E2E_Evaluator_importmap 222372 ns 259975 ns 0.86
E2E_Evaluator_jasmine 220854 ns 249087 ns 0.89
E2E_Evaluator_jsconfig 914760 ns 1087896 ns 0.84
E2E_Evaluator_jshintrc 2138496 ns 2890891 ns 0.74
E2E_Evaluator_krakend 485125 ns 487277 ns 1.00
E2E_Evaluator_lazygit 299136 ns 412361 ns 0.73
E2E_Evaluator_lerna 325244 ns 334040 ns 0.97
E2E_Evaluator_nest-cli 413829 ns 461500 ns 0.90
E2E_Evaluator_omc 70176 ns 70705 ns 0.99
E2E_Evaluator_omnisharp 999813 ns 1021783 ns 0.98
E2E_Evaluator_openapi 16266222 ns 17020214 ns 0.96
E2E_Evaluator_pre-commit-hooks 1505117 ns 1365340 ns 1.10
E2E_Evaluator_pulumi 1607263 ns 1417874 ns 1.13
E2E_Evaluator_semantic-release 184669 ns 214405 ns 0.86
E2E_Evaluator_stale 290251 ns 296987 ns 0.98
E2E_Evaluator_stylecop 747339 ns 732892 ns 1.02
E2E_Evaluator_tmuxinator 161091 ns 164787 ns 0.98
E2E_Evaluator_ui5 1575592 ns 1596037 ns 0.99
E2E_Evaluator_ui5-manifest 7778226 ns 7533652 ns 1.03
E2E_Evaluator_unreal-engine-uproject 1216285 ns 1304060 ns 0.93
E2E_Evaluator_users-array 1896110 ns 2095905 ns 0.90
E2E_Evaluator_vercel 755083 ns 752085 ns 1.00
E2E_Evaluator_yamllint 25743 ns 29044 ns 0.89

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: e755877 Previous: 3243d56 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 278123449.000077 ns/iter 333191799.00001925 ns/iter 0.83
Alterschema_Check_Readibility_OMC 78639183.66666035 ns/iter 99216165.4285805 ns/iter 0.79
Alterschema_Check_Readibility_KrakenD 1105440517.0000336 ns/iter 1413951574.000066 ns/iter 0.78
Alterschema_Apply_Readibility_KrakenD 105430150457.99985 ns/iter 131587600655.99995 ns/iter 0.80
Alterschema_Check_Invalid_External_Refs 231773912.0000321 ns/iter 300409267.99995303 ns/iter 0.77
Micro_2020_12_Dynamic_Ref 203.52846362510846 ns/iter 257.93964287289543 ns/iter 0.79
Micro_2020_12_Dynamic_Ref_Single 3.329736377617089 ns/iter 4.576742041766192 ns/iter 0.73
Micro_2020_12_Simple_Output_Mask 868.0204722636728 ns/iter 1123.9546881442213 ns/iter 0.77
Micro_2020_12_Simple_Output_Annotations 81459.28483795341 ns/iter 103447.38956367482 ns/iter 0.79
Micro_2020_12_Compile_NonCircular_Shared_Refs 931390.9445175447 ns/iter 1201271.6820512044 ns/iter 0.78
Micro_2020_12_Exhaustive_Deep_Numeric 6235.2937424381 ns/iter 8064.3160162648865 ns/iter 0.77
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 124940.07091069555 ns/iter 167340.41979272684 ns/iter 0.75
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 21569.167361618132 ns/iter 26422.880460387096 ns/iter 0.82
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 104.63690719626072 ns/iter 135.48790929325267 ns/iter 0.77
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 3427.312956035609 ns/iter 4534.970776400878 ns/iter 0.76
Micro_2019_09_Unevaluated_Properties 21.892480652799847 ns/iter 29.012215018087467 ns/iter 0.75
Micro_2019_09_Compile_Wrap 277954844.6666619 ns/iter 313226673.00003105 ns/iter 0.89
Micro_Draft7_If_Then_Else 19.587609648635556 ns/iter 25.184048026262893 ns/iter 0.78
Micro_Draft6_Property_Names 118.1615920075993 ns/iter 143.52559825992887 ns/iter 0.82
Micro_Draft6_Compile_FHIR 12357993787.000168 ns/iter 14748167392.999903 ns/iter 0.84
Micro_Draft4_Meta_1_No_Callback 135.2262555983179 ns/iter 174.486392767868 ns/iter 0.77
Micro_Draft4_Required_Properties 684.1196826240342 ns/iter 825.1280917813372 ns/iter 0.83
Micro_Draft4_Many_Optional_Properties_Minimal_Match 16.576193607924477 ns/iter 22.641227276729115 ns/iter 0.73
Micro_Draft4_Few_Optional_Properties_Minimal_Match 10.163479763033596 ns/iter 12.668169963755975 ns/iter 0.80
Micro_Draft4_Items_Schema 251.6455152500045 ns/iter 315.7421716642742 ns/iter 0.80
Micro_Draft4_Nested_Object 1.9149165999727067 ns/iter 1.7600460566310043 ns/iter 1.09
Micro_Draft4_Properties_Triad_Optional 316.6802841045686 ns/iter 523.4362564436358 ns/iter 0.61
Micro_Draft4_Properties_Triad_Closed 266.93475070281244 ns/iter 431.0924147854824 ns/iter 0.62
Micro_Draft4_Properties_Triad_Required 369.2733077312687 ns/iter 534.687274318832 ns/iter 0.69
Micro_Draft4_Properties_Closed 49.78091614648408 ns/iter 62.37280024302244 ns/iter 0.80
Micro_Draft4_Non_Recursive_Ref 6.872520632814311 ns/iter 8.830675839169595 ns/iter 0.78
Micro_Draft4_Pattern_Properties_True 143.3899189894223 ns/iter 206.83865257517058 ns/iter 0.69
Micro_Draft4_Ref_To_Single_Property 10.179343102576066 ns/iter 12.669399526574857 ns/iter 0.80
Micro_Draft4_Additional_Properties_Type 11.87436511521633 ns/iter 14.93325748549227 ns/iter 0.80
Micro_Draft4_Nested_Oneof 50.79845625965015 ns/iter 68.83616991139566 ns/iter 0.74
Micro_Draft4_Short_Enum 11.531071053649029 ns/iter 14.819456212424372 ns/iter 0.78
Micro_Draft4_Long_Enum 10.939554657653296 ns/iter 15.108746059367524 ns/iter 0.72
Micro_Draft4_Long_Enum_Short_Strings 11.53550339906482 ns/iter 14.923247468465924 ns/iter 0.77
Micro_Draft4_Type_Object 3.2829019885420156 ns/iter 4.573555793859449 ns/iter 0.72
Micro_Draft4_Ref_Single_100 1887682.7169812182 ns/iter 2498422.4767023833 ns/iter 0.76
Micro_Draft4_Compile_Ref_Many_Nested 1374054.433593841 ns/iter 1826052.9270831917 ns/iter 0.75
Micro_Draft4_Compile_Wrap 2039624.6704870316 ns/iter 2593463.011110678 ns/iter 0.79
E2E_Compiler_adaptivecard 52362815.1538385 ns/iter 68435399.100008 ns/iter 0.77
E2E_Compiler_ansible_meta 24485820.285714712 ns/iter 31481725.454537727 ns/iter 0.78
E2E_Compiler_aws_cdk 312987.8207420536 ns/iter 409982.5561403995 ns/iter 0.76
E2E_Compiler_babelrc 2199869.396874732 ns/iter 2831983.069105574 ns/iter 0.78
E2E_Compiler_clang_format 15474031.933333917 ns/iter 20548362.617646758 ns/iter 0.75
E2E_Compiler_cmake_presets 21610606.34374934 ns/iter 28595239.79167496 ns/iter 0.76
E2E_Compiler_code_climate 2230198.003236156 ns/iter 2910345.608333387 ns/iter 0.77
E2E_Compiler_cql2 10879140.45312388 ns/iter 14202304.979595024 ns/iter 0.77
E2E_Compiler_cspell 19220830.722221963 ns/iter 24554210.137929313 ns/iter 0.78
E2E_Compiler_cypress 3264003.317756879 ns/iter 4259430.317072812 ns/iter 0.77
E2E_Compiler_deno 6472459.185185168 ns/iter 8516555.439025912 ns/iter 0.76
E2E_Compiler_dependabot 3345051.842856741 ns/iter 4363862.662499685 ns/iter 0.77
E2E_Compiler_draft_04 2271285.38311679 ns/iter 2998342.081545368 ns/iter 0.76
E2E_Compiler_fabric_mod 4032098.4399997024 ns/iter 5300923.674242036 ns/iter 0.76
E2E_Compiler_geojson 19072621.77777764 ns/iter 25043059.28571122 ns/iter 0.76
E2E_Compiler_gitpod_configuration 4195699.702380905 ns/iter 5451785.379845269 ns/iter 0.77
E2E_Compiler_helm_chart_lock 566847.0299594707 ns/iter 741440.0329436752 ns/iter 0.76
E2E_Compiler_importmap 232834.5480545862 ns/iter 302274.03369328234 ns/iter 0.77
E2E_Compiler_jasmine 1146974.6557914696 ns/iter 1489255.0170214507 ns/iter 0.77
E2E_Compiler_jshintrc 3613366.098444707 ns/iter 4776577.836733838 ns/iter 0.76
E2E_Compiler_jsconfig 18110362.46153773 ns/iter 23874364.448272835 ns/iter 0.76
E2E_Compiler_krakend 109600386.166638 ns/iter 144255187.3999946 ns/iter 0.76
E2E_Compiler_lazygit 28137920.280005347 ns/iter 36658663.578954905 ns/iter 0.77
E2E_Compiler_lerna 1355463.8820116674 ns/iter 1763461.9548869953 ns/iter 0.77
E2E_Compiler_nest_cli 6297459.144145643 ns/iter 8172674.71764567 ns/iter 0.77
E2E_Compiler_omc 133108607.79997711 ns/iter 169837492.2500534 ns/iter 0.78
E2E_Compiler_omnisharp 5659173.934958286 ns/iter 7383094.69473662 ns/iter 0.77
E2E_Compiler_openapi 21086352.696970195 ns/iter 27391189.03999952 ns/iter 0.77
E2E_Compiler_pre_commit_hooks 4450887.942307593 ns/iter 5892483.218487251 ns/iter 0.76
E2E_Compiler_pulumi 3425640.745098124 ns/iter 4465325.917198341 ns/iter 0.77
E2E_Compiler_semantic_release 1320081.390566163 ns/iter 1739884.8511166258 ns/iter 0.76
E2E_Compiler_stale 1305150.8888890094 ns/iter 1689074.4396136329 ns/iter 0.77
E2E_Compiler_stylecop 5052436.659420035 ns/iter 6658180.380953213 ns/iter 0.76
E2E_Compiler_tmuxinator 1629457.2116278284 ns/iter 2138645.8567074593 ns/iter 0.76
E2E_Compiler_ui5 41198937.23529512 ns/iter 51062785.1428548 ns/iter 0.81
E2E_Compiler_ui5_manifest 272839285.0000318 ns/iter 325588440.00004685 ns/iter 0.84
E2E_Compiler_unreal_engine_uproject 3849863.640884126 ns/iter 5034406.330935734 ns/iter 0.76
E2E_Compiler_users_array 651592.791044633 ns/iter 852497.9523227626 ns/iter 0.76
E2E_Compiler_vercel 10431038.573528895 ns/iter 13403066.88461204 ns/iter 0.78
E2E_Compiler_yamllint 290674.6137109315 ns/iter 369699.70116149966 ns/iter 0.79
E2E_Evaluator_adaptivecard 17986.490466329866 ns/iter 23378.14415766371 ns/iter 0.77
E2E_Evaluator_ansible_meta 175597.3140035876 ns/iter 224864.88504545268 ns/iter 0.78
E2E_Evaluator_aws_cdk 34150.226958303676 ns/iter 44582.47475461299 ns/iter 0.77
E2E_Evaluator_babelrc 65219.45513180142 ns/iter 87886.77046709666 ns/iter 0.74
E2E_Evaluator_cerebrum_criminal_case 833115.4546538871 ns/iter 1063350.684627355 ns/iter 0.78
E2E_Evaluator_clang_format 74254.78129213609 ns/iter 99259.85392780436 ns/iter 0.75
E2E_Evaluator_cmake_presets 3614197.664892635 ns/iter 4488719.286764067 ns/iter 0.81
E2E_Evaluator_code_climate 128684.44375959519 ns/iter 173691.76172838637 ns/iter 0.74
E2E_Evaluator_cql2 158799.24224020552 ns/iter 208256.02824021463 ns/iter 0.76
E2E_Evaluator_cspell 383065.29732680466 ns/iter 495608.0358187474 ns/iter 0.77
E2E_Evaluator_cypress 111606.17016906872 ns/iter 143080.67971457524 ns/iter 0.78
E2E_Evaluator_deno 212631.91352483977 ns/iter 281886.83913223806 ns/iter 0.75
E2E_Evaluator_dependabot 259336.00929022412 ns/iter 381272.52178646065 ns/iter 0.68
E2E_Evaluator_draft_04 8862537.10975724 ns/iter 7944609.062498387 ns/iter 1.12
E2E_Evaluator_fabric_mod 551582.3835069331 ns/iter 713531.659509196 ns/iter 0.77
E2E_Evaluator_geojson 17062431.76190691 ns/iter 18683021.026312847 ns/iter 0.91
E2E_Evaluator_gitpod_configuration 172044.89735342943 ns/iter 226511.60244955804 ns/iter 0.76
E2E_Evaluator_helm_chart_lock 169661.4795869742 ns/iter 211986.94505489827 ns/iter 0.80
E2E_Evaluator_importmap 30233.361403358667 ns/iter 39169.25801438325 ns/iter 0.77
E2E_Evaluator_jasmine 81264.45595089109 ns/iter 101934.10261975879 ns/iter 0.80
E2E_Evaluator_jshintrc 788901.7531144907 ns/iter 1028419.0502958401 ns/iter 0.77
E2E_Evaluator_jsconfig 291583.2239477209 ns/iter 372142.03626657155 ns/iter 0.78
E2E_Evaluator_krakend 141831.89569567447 ns/iter 182833.2207253719 ns/iter 0.78
E2E_Evaluator_lazygit 95378.31163870981 ns/iter 122609.2741098791 ns/iter 0.78
E2E_Evaluator_lerna 90919.6307231987 ns/iter 125921.49464515658 ns/iter 0.72
E2E_Evaluator_nest_cli 138441.61700452218 ns/iter 177501.6880080886 ns/iter 0.78
E2E_Evaluator_omc 14211.126786911607 ns/iter 21715.14993972347 ns/iter 0.65
E2E_Evaluator_omnisharp 407490.0207493289 ns/iter 523240.75574276055 ns/iter 0.78
E2E_Evaluator_openapi 9106039.170453848 ns/iter 10422919.4583354 ns/iter 0.87
E2E_Evaluator_pre_commit_hooks 368140.44963282015 ns/iter 490541.3863308051 ns/iter 0.75
E2E_Evaluator_pulumi 582091.9202400745 ns/iter 720137.7730570522 ns/iter 0.81
E2E_Evaluator_semantic_release 67500.84768402234 ns/iter 86287.65457257474 ns/iter 0.78
E2E_Evaluator_stale 117894.18693770579 ns/iter 151029.25302508453 ns/iter 0.78
E2E_Evaluator_stylecop 231096.40357718052 ns/iter 286466.0199837536 ns/iter 0.81
E2E_Evaluator_tmuxinator 68498.4730222756 ns/iter 86287.37764574995 ns/iter 0.79
E2E_Evaluator_ui5 388390.011791218 ns/iter 516865.51871254836 ns/iter 0.75
E2E_Evaluator_ui5_manifest 2561728.2787875826 ns/iter 2642067.2981134453 ns/iter 0.97
E2E_Evaluator_unreal_engine_uproject 335125.2130373837 ns/iter 442319.0165442413 ns/iter 0.76
E2E_Evaluator_users_array 506216.64667151 ns/iter 901198.8173691649 ns/iter 0.56
E2E_Evaluator_vercel 199892.28283411817 ns/iter 260973.77022062027 ns/iter 0.77
E2E_Evaluator_yamllint 7134.78470457956 ns/iter 9259.136010909766 ns/iter 0.77

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: e755877 Previous: 3243d56 Ratio
E2E_Evaluator_adaptivecard 90542 ns 117679 ns 0.77
E2E_Evaluator_ansible-meta 443059 ns 526340 ns 0.84
E2E_Evaluator_aws-cdk 103388 ns 124616 ns 0.83
E2E_Evaluator_babelrc 260598 ns 296664 ns 0.88
E2E_Evaluator_cerebrum-criminal-case 2249663 ns 2634494 ns 0.85
E2E_Evaluator_clang-format 235716 ns 262220 ns 0.90
E2E_Evaluator_cmake-presets 15238890 ns 17414581 ns 0.88
E2E_Evaluator_code-climate 404880 ns 479583 ns 0.84
E2E_Evaluator_cql2 944018 ns 1196115 ns 0.79
E2E_Evaluator_cspell 1409768 ns 1568378 ns 0.90
E2E_Evaluator_cypress 744464 ns 832732 ns 0.89
E2E_Evaluator_deno 898375 ns 1013885 ns 0.89
E2E_Evaluator_dependabot 935924 ns 1006523 ns 0.93
E2E_Evaluator_draft-04 26750125 ns 20267740 ns 1.32
E2E_Evaluator_fabric-mod 2105493 ns 2431968 ns 0.87
E2E_Evaluator_geojson 18246583 ns 27457388 ns 0.66
E2E_Evaluator_gitpod-configuration 599391 ns 698122 ns 0.86
E2E_Evaluator_helm-chart-lock 781026 ns 989571 ns 0.79
E2E_Evaluator_importmap 213467 ns 273178 ns 0.78
E2E_Evaluator_jasmine 224733 ns 291957 ns 0.77
E2E_Evaluator_jsconfig 1329875 ns 1430338 ns 0.93
E2E_Evaluator_jshintrc 2425036 ns 2927949 ns 0.83
E2E_Evaluator_krakend 526179 ns 657127 ns 0.80
E2E_Evaluator_lazygit 381162 ns 438083 ns 0.87
E2E_Evaluator_lerna 357829 ns 436735 ns 0.82
E2E_Evaluator_nest-cli 493972 ns 572755 ns 0.86
E2E_Evaluator_omc 70371 ns 90817 ns 0.77
E2E_Evaluator_omnisharp 1263252 ns 1472945 ns 0.86
E2E_Evaluator_openapi 20640424 ns 22507554 ns 0.92
E2E_Evaluator_pre-commit-hooks 1686492 ns 1903760 ns 0.89
E2E_Evaluator_pulumi 1608847 ns 1904854 ns 0.84
E2E_Evaluator_semantic-release 186241 ns 231185 ns 0.81
E2E_Evaluator_stale 307430 ns 367128 ns 0.84
E2E_Evaluator_stylecop 943598 ns 1117144 ns 0.84
E2E_Evaluator_tmuxinator 170122 ns 213318 ns 0.80
E2E_Evaluator_ui5 1654565 ns 1970844 ns 0.84
E2E_Evaluator_ui5-manifest 8460322 ns 9583553 ns 0.88
E2E_Evaluator_unreal-engine-uproject 1332831 ns 1520906 ns 0.88
E2E_Evaluator_users-array 1867525 ns 2279256 ns 0.82
E2E_Evaluator_vercel 784814 ns 950032 ns 0.83
E2E_Evaluator_yamllint 21693 ns 26404 ns 0.82

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit d462d56 into main Apr 16, 2026
15 checks passed
@jviotti jviotti deleted the experiments branch April 16, 2026 18:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant