Add proper Draft 3 `type` trace tests by jviotti · Pull Request #782 · sourcemeta/blaze

jviotti · 2026-05-05T19:23:20Z

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>

cubic-dev-ai

2 issues found across 4 files

Prompt for AI agents (unresolved issues)


Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="src/compiler/default_compiler_draft3.h">

<violation number="1" location="src/compiler/default_compiler_draft3.h:1901">
P2: Compile the single-object subschema with `relative_dynamic_context()` so its schema/instance locations match the rest of the type-array handling.</violation>
</file>

<file name="test/evaluator/evaluator_draft3.json">

<violation number="1" location="test/evaluator/evaluator_draft3.json:199">
P2: These Draft 3 tests incorrectly mark `3.0` as invalid integer input; update both cases to expect success.</violation>
</file>

_{Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.}

augmentcode · 2026-05-05T19:32:16Z

🤖 Augment PR Summary

Summary: This PR expands the evaluator trace suite to properly cover JSON Schema Draft 3 type behavior, including the special Draft 3 "any" type and type arrays containing subschemas.

Changes:

Adds a new test/evaluator/evaluator_draft3.json trace fixture with Draft 3 type test cases (strings, arrays, subschema arms, any, and empty arrays).
Registers the Draft 3 trace suite in test/evaluator/tracesuite.cc so it runs alongside existing draft suites.
Updates the Draft 3 compiler’s type handling to emit appropriate traceable instructions for "any" (exhaustive-only) and to handle empty type arrays as an explicit failure.
Adds the new Draft 3 trace JSON file to the blaze_format_trace_json formatting target in CMake.

Technical Notes: In exhaustive mode, Draft 3 type: "any" now compiles to AssertionTypeStrictAny over all JSON types to support deterministic traces, while fast validation keeps it as a no-op (vacuously true).

_{🤖 Was this summary useful? React with 👍 or 👎}

augmentcode

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>

cubic-dev-ai

1 issue found across 3 files (changes from recent commits).

Prompt for AI agents (unresolved issues)


Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="test/evaluator/evaluator_draft3_test.cc">

<violation number="1" location="test/evaluator/evaluator_draft3_test.cc:17">
P2: Use a non-integer real here; `3.0` is an integer-valued number, so this failure trace is incorrect.</violation>
</file>

_{Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.}

github-actions

Benchmark (linux/llvm)

Details

Benchmark suite	Current: `5991c40`	Previous: `bac3ea7`	Ratio
`E2E_Compiler_adaptivecard`	`62231025.33334037` ns/iter	`62712256.09999647` ns/iter	`0.99`
`E2E_Compiler_ansible_meta`	`29056525.000001445` ns/iter	`26015224.814816266` ns/iter	`1.12`
`E2E_Compiler_aws_cdk`	`383953.0275330625` ns/iter	`340294.66440674796` ns/iter	`1.13`
`E2E_Compiler_babelrc`	`2587474.93726928` ns/iter	`2314114.702970316` ns/iter	`1.12`
`E2E_Compiler_clang_format`	`18266306.947369132` ns/iter	`16362112.488372775` ns/iter	`1.12`
`E2E_Compiler_cmake_presets`	`25570911.666666992` ns/iter	`23879979.724138767` ns/iter	`1.07`
`E2E_Compiler_code_climate`	`2601624.144981323` ns/iter	`2344103.7866666648` ns/iter	`1.11`
`E2E_Compiler_cql2`	`12819669.092592718` ns/iter	`12016047.84482854` ns/iter	`1.07`
`E2E_Compiler_cspell`	`22619990.129035085` ns/iter	`20963685.24242583` ns/iter	`1.08`
`E2E_Compiler_cypress`	`3924290.4101121915` ns/iter	`3543831.530302641` ns/iter	`1.11`
`E2E_Compiler_deno`	`7734954.736264086` ns/iter	`6953390.490383963` ns/iter	`1.11`
`E2E_Compiler_dependabot`	`3932725.46067388` ns/iter	`3502388.6815916914` ns/iter	`1.12`
`E2E_Compiler_draft_04`	`2682000.9576922003` ns/iter	`2429433.5224912865` ns/iter	`1.10`
`E2E_Compiler_fabric_mod`	`4778340.000000468` ns/iter	`4292135.085888954` ns/iter	`1.11`
`E2E_Compiler_geojson`	`22294398.749998834` ns/iter	`20765033.82352926` ns/iter	`1.07`
`E2E_Compiler_gitpod_configuration`	`4886647.482516997` ns/iter	`4381705.575000439` ns/iter	`1.12`
`E2E_Compiler_helm_chart_lock`	`706185.3113590168` ns/iter	`615041.2222222725` ns/iter	`1.15`
`E2E_Compiler_importmap`	`288511.0194214602` ns/iter	`254836.38405532233` ns/iter	`1.13`
`E2E_Compiler_jasmine`	`1363286.4269006604` ns/iter	`1226790.273996501` ns/iter	`1.11`
`E2E_Compiler_jshintrc`	`4356930.385093303` ns/iter	`3775673.853260618` ns/iter	`1.15`
`E2E_Compiler_jsconfig`	`21772915.875001077` ns/iter	`19211531.459460102` ns/iter	`1.13`
`E2E_Compiler_krakend`	`137059110.600012` ns/iter	`130234054.2000138` ns/iter	`1.05`
`E2E_Compiler_lazygit`	`33174650.28571102` ns/iter	`30691434.43478286` ns/iter	`1.08`
`E2E_Compiler_lerna`	`1610423.7356320033` ns/iter	`1444825.4197532153` ns/iter	`1.11`
`E2E_Compiler_nest_cli`	`7433710.361701839` ns/iter	`6589200.152380466` ns/iter	`1.13`
`E2E_Compiler_omc`	`150824831.7499863` ns/iter	`151872868.60000312` ns/iter	`0.99`
`E2E_Compiler_omnisharp`	`6750827.711537857` ns/iter	`5893925.7542377515` ns/iter	`1.15`
`E2E_Compiler_openapi`	`24794140.2500008` ns/iter	`22742215.483870704` ns/iter	`1.09`
`E2E_Compiler_pre_commit_hooks`	`5306118.3560609585` ns/iter	`4657026.430463522` ns/iter	`1.14`
`E2E_Compiler_pulumi`	`4034316.6494250293` ns/iter	`3604629.5103094904` ns/iter	`1.12`
`E2E_Compiler_semantic_release`	`1573531.9011235312` ns/iter	`1426777.822810477` ns/iter	`1.10`
`E2E_Compiler_stale`	`1559400.4177776496` ns/iter	`1383480.716599212` ns/iter	`1.13`
`E2E_Compiler_stylecop`	`6171952.285713798` ns/iter	`5319396.878787309` ns/iter	`1.16`
`E2E_Compiler_tmuxinator`	`1944707.2679558136` ns/iter	`1738951.227722926` ns/iter	`1.12`
`E2E_Compiler_ui5`	`46482894.20000159` ns/iter	`45416610.43749911` ns/iter	`1.02`
`E2E_Compiler_ui5_manifest`	`304214881.50000185` ns/iter	`297856951.99996096` ns/iter	`1.02`
`E2E_Compiler_unreal_engine_uproject`	`4590146.7236844655` ns/iter	`4069955.5263160104` ns/iter	`1.13`
`E2E_Compiler_users_array`	`790803.1391106251` ns/iter	`728921.0167014556` ns/iter	`1.08`
`E2E_Compiler_vercel`	`12399390.140350925` ns/iter	`11346038.150001429` ns/iter	`1.09`
`E2E_Compiler_yamllint`	`351099.0966281272` ns/iter	`312194.94809844944` ns/iter	`1.12`
`E2E_Evaluator_adaptivecard`	`24129.801342373677` ns/iter	`21255.302758996808` ns/iter	`1.14`
`E2E_Evaluator_ansible_meta`	`228476.35976599497` ns/iter	`195074.21641998953` ns/iter	`1.17`
`E2E_Evaluator_aws_cdk`	`48595.981270810466` ns/iter	`42433.59066405271` ns/iter	`1.15`
`E2E_Evaluator_babelrc`	`105326.99189918724` ns/iter	`90062.03796818844` ns/iter	`1.17`
`E2E_Evaluator_cerebrum_criminal_case`	`932453.3445039839` ns/iter	`1023284.3845028849` ns/iter	`0.91`
`E2E_Evaluator_clang_format`	`121674.25672627092` ns/iter	`113521.08616483584` ns/iter	`1.07`
`E2E_Evaluator_cmake_presets`	`4110860.8882355466` ns/iter	`4564067.803797467` ns/iter	`0.90`
`E2E_Evaluator_code_climate`	`173702.52801191816` ns/iter	`193746.18138887928` ns/iter	`0.90`
`E2E_Evaluator_cql2`	`216466.75380313868` ns/iter	`184145.07688256726` ns/iter	`1.18`
`E2E_Evaluator_cspell`	`551035.9344392319` ns/iter	`547580.4859154569` ns/iter	`1.01`
`E2E_Evaluator_cypress`	`189113.1400862217` ns/iter	`174509.270573565` ns/iter	`1.08`
`E2E_Evaluator_deno`	`318690.7107175035` ns/iter	`321030.25342464773` ns/iter	`0.99`
`E2E_Evaluator_dependabot`	`315818.1719517569` ns/iter	`316356.08359835175` ns/iter	`1.00`
`E2E_Evaluator_draft_04`	`6891573.063157204` ns/iter	`7993402.662790696` ns/iter	`0.86`
`E2E_Evaluator_fabric_mod`	`694804.1016782491` ns/iter	`650965.3642321536` ns/iter	`1.07`
`E2E_Evaluator_geojson`	`15826247.318182658` ns/iter	`17015309.309521228` ns/iter	`0.93`
`E2E_Evaluator_gitpod_configuration`	`221574.5508905906` ns/iter	`225709.16477822722` ns/iter	`0.98`
`E2E_Evaluator_helm_chart_lock`	`337561.98703169083` ns/iter	`403694.9086236327` ns/iter	`0.84`
`E2E_Evaluator_importmap`	`46333.69637900942` ns/iter	`35309.01876007631` ns/iter	`1.31`
`E2E_Evaluator_jasmine`	`104633.1604606066` ns/iter	`96409.68725922286` ns/iter	`1.09`
`E2E_Evaluator_jshintrc`	`1195114.4625849489` ns/iter	`1149830.2631579058` ns/iter	`1.04`
`E2E_Evaluator_jsconfig`	`419124.9617909972` ns/iter	`371634.8489361624` ns/iter	`1.13`
`E2E_Evaluator_krakend`	`201464.83085880041` ns/iter	`173374.2294799168` ns/iter	`1.16`
`E2E_Evaluator_lazygit`	`148932.70708796583` ns/iter	`137348.18493822654` ns/iter	`1.08`
`E2E_Evaluator_lerna`	`140474.71844264225` ns/iter	`125912.32944182256` ns/iter	`1.12`
`E2E_Evaluator_nest_cli`	`171779.9097239423` ns/iter	`176331.14238911215` ns/iter	`0.97`
`E2E_Evaluator_omc`	`17460.215774293356` ns/iter	`16278.522257311684` ns/iter	`1.07`
`E2E_Evaluator_omnisharp`	`605321.4389179784` ns/iter	`550366.1878931153` ns/iter	`1.10`
`E2E_Evaluator_openapi`	`8486158.948718032` ns/iter	`10492554.846155144` ns/iter	`0.81`
`E2E_Evaluator_pre_commit_hooks`	`468099.4950099929` ns/iter	`495588.6893134691` ns/iter	`0.94`
`E2E_Evaluator_pulumi`	`657872.3984819502` ns/iter	`689125.5717111686` ns/iter	`0.95`
`E2E_Evaluator_semantic_release`	`96804.17761456898` ns/iter	`77064.02365279345` ns/iter	`1.26`
`E2E_Evaluator_stale`	`148219.65160876705` ns/iter	`137277.54475703285` ns/iter	`1.08`
`E2E_Evaluator_stylecop`	`280900.57661291125` ns/iter	`298508.7458563513` ns/iter	`0.94`
`E2E_Evaluator_tmuxinator`	`94694.04972826112` ns/iter	`81551.78752458731` ns/iter	`1.16`
`E2E_Evaluator_ui5`	`490821.1087569987` ns/iter	`458536.13627381955` ns/iter	`1.07`
`E2E_Evaluator_ui5_manifest`	`2421416.782758883` ns/iter	`2464728.5907472204` ns/iter	`0.98`
`E2E_Evaluator_unreal_engine_uproject`	`424528.34042552515` ns/iter	`425424.7959804951` ns/iter	`1.00`
`E2E_Evaluator_users_array`	`526372.6022472627` ns/iter	`588647.1062553653` ns/iter	`0.89`
`E2E_Evaluator_vercel`	`301768.76414689433` ns/iter	`327828.777414868` ns/iter	`0.92`
`E2E_Evaluator_yamllint`	`8007.517922709605` ns/iter	`7466.392173838094` ns/iter	`1.07`
`Micro_Draft4_Meta_1_No_Callback`	`187.88763544769333` ns/iter	`188.63123598186183` ns/iter	`1.00`
`Micro_Draft4_Required_Properties`	`793.979651218924` ns/iter	`812.2097680009548` ns/iter	`0.98`
`Micro_Draft4_Many_Optional_Properties_Minimal_Match`	`20.84554131234893` ns/iter	`21.541965543355353` ns/iter	`0.97`
`Micro_Draft4_Few_Optional_Properties_Minimal_Match`	`10.892043127109833` ns/iter	`9.908913539552234` ns/iter	`1.10`
`Micro_Draft4_Items_Schema`	`291.2579449270664` ns/iter	`281.17032744062203` ns/iter	`1.04`
`Micro_Draft4_Nested_Object`	`1.8266266286868837` ns/iter	`1.1536902335771497` ns/iter	`1.58`
`Micro_Draft4_Properties_Triad_Optional`	`314.56684835223723` ns/iter	`303.57228777690256` ns/iter	`1.04`
`Micro_Draft4_Properties_Triad_Closed`	`261.711918433738` ns/iter	`251.07608581886242` ns/iter	`1.04`
`Micro_Draft4_Properties_Triad_Required`	`330.1370737253374` ns/iter	`315.53984578141075` ns/iter	`1.05`
`Micro_Draft4_Properties_Closed`	`54.75958767908013` ns/iter	`54.317560083985015` ns/iter	`1.01`
`Micro_Draft4_Non_Recursive_Ref`	`12.360496571950673` ns/iter	`10.396425726846447` ns/iter	`1.19`
`Micro_Draft4_Pattern_Properties_True`	`149.77714107288026` ns/iter	`117.51709839739756` ns/iter	`1.27`
`Micro_Draft4_Ref_To_Single_Property`	`10.897399142119433` ns/iter	`9.922401646271215` ns/iter	`1.10`
`Micro_Draft4_Additional_Properties_Type`	`22.164247504104946` ns/iter	`19.09823716195436` ns/iter	`1.16`
`Micro_Draft4_Nested_Oneof`	`57.91673451837924` ns/iter	`47.55855010941698` ns/iter	`1.22`
`Micro_Draft4_Short_Enum`	`11.82942257927205` ns/iter	`10.135860656484043` ns/iter	`1.17`
`Micro_Draft4_Long_Enum`	`13.818821699444875` ns/iter	`10.867131390080248` ns/iter	`1.27`
`Micro_Draft4_Long_Enum_Short_Strings`	`11.827746153968702` ns/iter	`10.125083714043605` ns/iter	`1.17`
`Micro_Draft4_Type_Object`	`3.424292635904115` ns/iter	`2.885524690238123` ns/iter	`1.19`
`Micro_Draft4_Ref_Single_100`	`2364624.0574324057` ns/iter	`2102146.018072394` ns/iter	`1.12`
`Micro_Draft4_Compile_Ref_Many_Nested`	`1711953.8288506921` ns/iter	`1551158.119733895` ns/iter	`1.10`
`Micro_Draft4_Compile_Wrap`	`2345146.856187346` ns/iter	`2117317.123494112` ns/iter	`1.11`
`Micro_Draft6_Property_Names`	`119.03483455301662` ns/iter	`115.31591374797794` ns/iter	`1.03`
`Micro_Draft6_Compile_FHIR`	`14704160321.000017` ns/iter	`18715767884.999992` ns/iter	`0.79`
`Micro_Draft7_If_Then_Else`	`23.377108146641703` ns/iter	`20.37400502851139` ns/iter	`1.15`
`Micro_2019_09_Unevaluated_Properties`	`28.074222176584968` ns/iter	`25.364938916423444` ns/iter	`1.11`
`Micro_2019_09_Compile_Wrap`	`286558352.4999806` ns/iter	`281171514.9999827` ns/iter	`1.02`
`Micro_2020_12_Dynamic_Ref`	`224.6678386226699` ns/iter	`294.8088383822615` ns/iter	`0.76`
`Micro_2020_12_Dynamic_Ref_Single`	`3.4212941796610203` ns/iter	`2.8821818279699776` ns/iter	`1.19`
`Micro_2020_12_Simple_Output_Mask`	`1064.0734309008149` ns/iter	`949.1535019597131` ns/iter	`1.12`
`Micro_2020_12_Simple_Output_Annotations`	`103537.32196130228` ns/iter	`95550.56405354383` ns/iter	`1.08`
`Micro_2020_12_Compile_NonCircular_Shared_Refs`	`1100509.981102288` ns/iter	`998088.7991453701` ns/iter	`1.10`
`Micro_2020_12_Exhaustive_Deep_Numeric`	`8111.689571488791` ns/iter	`8452.619674914915` ns/iter	`0.96`
`Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput`	`170735.1946924759` ns/iter	`151502.94715446886` ns/iter	`1.13`
`Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput`	`22727.135143041887` ns/iter	`21088.384107554688` ns/iter	`1.08`
`Micro_2020_12_Exhaustive_Deep_Numeric_Fail`	`142.74818194907027` ns/iter	`135.00371654889076` ns/iter	`1.06`
`Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput`	`4226.624857661924` ns/iter	`3816.5285386392` ns/iter	`1.11`
`Alterschema_Check_Readibility_ISO_Language_Set_3`	`338337719.49997526` ns/iter	`326000363.4999862` ns/iter	`1.04`
`Alterschema_Check_Readibility_OMC`	`84141389.75000185` ns/iter	`92583351.42856465` ns/iter	`0.91`
`Alterschema_Check_Readibility_KrakenD`	`1159006849.9999688` ns/iter	`1485328385.999992` ns/iter	`0.78`
`Alterschema_Apply_Readibility_KrakenD`	`116480119288.99985` ns/iter	`146916932944.00012` ns/iter	`0.79`
`Alterschema_Check_Invalid_External_Refs`	`288566447.4999885` ns/iter	`227323490.66670093` ns/iter	`1.27`

This comment was automatically generated by workflow using github-action-benchmark.

github-actions

JavaScript (linux/llvm)

Details

Benchmark suite	Current: `5991c40`	Previous: `bac3ea7`	Ratio
`E2E_Evaluator_adaptivecard`	`119649` ns	`113261` ns	`1.06`
`E2E_Evaluator_ansible-meta`	`509963` ns	`532732` ns	`0.96`
`E2E_Evaluator_aws-cdk`	`138594` ns	`147612` ns	`0.94`
`E2E_Evaluator_babelrc`	`318068` ns	`453546` ns	`0.70`
`E2E_Evaluator_cerebrum-criminal-case`	`2405865` ns	`2540707` ns	`0.95`
`E2E_Evaluator_clang-format`	`258409` ns	`320804` ns	`0.81`
`E2E_Evaluator_cmake-presets`	`16604331` ns	`18551430` ns	`0.90`
`E2E_Evaluator_code-climate`	`493434` ns	`524126` ns	`0.94`
`E2E_Evaluator_cql2`	`1239015` ns	`1190869` ns	`1.04`
`E2E_Evaluator_cspell`	`1441992` ns	`1752265` ns	`0.82`
`E2E_Evaluator_cypress`	`763534` ns	`999500` ns	`0.76`
`E2E_Evaluator_deno`	`1039634` ns	`1098242` ns	`0.95`
`E2E_Evaluator_dependabot`	`1212846` ns	`1162937` ns	`1.04`
`E2E_Evaluator_draft-04`	`20190489` ns	`25259357` ns	`0.80`
`E2E_Evaluator_fabric-mod`	`2253630` ns	`2396933` ns	`0.94`
`E2E_Evaluator_geojson`	`18867973` ns	`27305801` ns	`0.69`
`E2E_Evaluator_gitpod-configuration`	`706447` ns	`822883` ns	`0.86`
`E2E_Evaluator_helm-chart-lock`	`974864` ns	`1056712` ns	`0.92`
`E2E_Evaluator_importmap`	`264083` ns	`326824` ns	`0.81`
`E2E_Evaluator_jasmine`	`293352` ns	`343906` ns	`0.85`
`E2E_Evaluator_jsconfig`	`1209798` ns	`1710360` ns	`0.71`
`E2E_Evaluator_jshintrc`	`2670742` ns	`3120392` ns	`0.86`
`E2E_Evaluator_krakend`	`670823` ns	`613156` ns	`1.09`
`E2E_Evaluator_lazygit`	`486590` ns	`495893` ns	`0.98`
`E2E_Evaluator_lerna`	`448870` ns	`497468` ns	`0.90`
`E2E_Evaluator_nest-cli`	`592386` ns	`724603` ns	`0.82`
`E2E_Evaluator_omc`	`91681` ns	`83866` ns	`1.09`
`E2E_Evaluator_omnisharp`	`1354585` ns	`1545914` ns	`0.88`
`E2E_Evaluator_openapi`	`22488918` ns	`23773444` ns	`0.95`
`E2E_Evaluator_pre-commit-hooks`	`1981172` ns	`2151569` ns	`0.92`
`E2E_Evaluator_pulumi`	`1843939` ns	`2138532` ns	`0.86`
`E2E_Evaluator_semantic-release`	`247176` ns	`304999` ns	`0.81`
`E2E_Evaluator_stale`	`395643` ns	`453927` ns	`0.87`
`E2E_Evaluator_stylecop`	`1226222` ns	`1310481` ns	`0.94`
`E2E_Evaluator_tmuxinator`	`221939` ns	`291376` ns	`0.76`
`E2E_Evaluator_ui5`	`2333858` ns	`2236850` ns	`1.04`
`E2E_Evaluator_ui5-manifest`	`9960314` ns	`11642666` ns	`0.86`
`E2E_Evaluator_unreal-engine-uproject`	`1474234` ns	`1708406` ns	`0.86`
`E2E_Evaluator_users-array`	`2548264` ns	`2448301` ns	`1.04`
`E2E_Evaluator_vercel`	`980468` ns	`1103638` ns	`0.89`
`E2E_Evaluator_yamllint`	`25769` ns	`27134` ns	`0.95`

This comment was automatically generated by workflow using github-action-benchmark.

github-actions

Benchmark (macos/llvm)

Details

Benchmark suite	Current: `5991c40`	Previous: `bac3ea7`	Ratio
`E2E_Compiler_adaptivecard`	`71093239.50001568` ns/iter	`63799454.10000118` ns/iter	`1.11`
`E2E_Compiler_ansible_meta`	`31125455.00000124` ns/iter	`28967317.70833109` ns/iter	`1.07`
`E2E_Compiler_aws_cdk`	`355594.62218378444` ns/iter	`367852.14615050313` ns/iter	`0.97`
`E2E_Compiler_babelrc`	`2461274.1164381155` ns/iter	`2308725.2329317317` ns/iter	`1.07`
`E2E_Compiler_clang_format`	`21851576.199995697` ns/iter	`16166034.729167223` ns/iter	`1.35`
`E2E_Compiler_cmake_presets`	`32875783.320005212` ns/iter	`27598196.640001334` ns/iter	`1.19`
`E2E_Compiler_code_climate`	`2527257.561181621` ns/iter	`2338134.462151395` ns/iter	`1.08`
`E2E_Compiler_cql2`	`12690297.216666598` ns/iter	`15182857.804347806` ns/iter	`0.84`
`E2E_Compiler_cspell`	`19511035.256411374` ns/iter	`24217262.606060956` ns/iter	`0.81`
`E2E_Compiler_cypress`	`3589225.378788677` ns/iter	`4260018.231249774` ns/iter	`0.84`
`E2E_Compiler_deno`	`7520813.307691627` ns/iter	`8945128.604938682` ns/iter	`0.84`
`E2E_Compiler_dependabot`	`4014165.070063549` ns/iter	`4376589.20134254` ns/iter	`0.92`
`E2E_Compiler_draft_04`	`2218370.885802617` ns/iter	`2612110.5451896284` ns/iter	`0.85`
`E2E_Compiler_fabric_mod`	`4190383.7297293134` ns/iter	`4929477.428571464` ns/iter	`0.85`
`E2E_Compiler_geojson`	`32242340.29166458` ns/iter	`26624923.07692114` ns/iter	`1.21`
`E2E_Compiler_gitpod_configuration`	`5452554.579999287` ns/iter	`5462582.08999916` ns/iter	`1.00`
`E2E_Compiler_helm_chart_lock`	`707577.3595376784` ns/iter	`688698.3388306422` ns/iter	`1.03`
`E2E_Compiler_importmap`	`319305.70039677486` ns/iter	`259682.33298933026` ns/iter	`1.23`
`E2E_Compiler_jasmine`	`1558291.66758232` ns/iter	`1710011.247443593` ns/iter	`0.91`
`E2E_Compiler_jshintrc`	`3946159.999999281` ns/iter	`4364157.515151522` ns/iter	`0.90`
`E2E_Compiler_jsconfig`	`23533957.16666758` ns/iter	`25251579.034484793` ns/iter	`0.93`
`E2E_Compiler_krakend`	`220261916.75001884` ns/iter	`147823125.00001353` ns/iter	`1.49`
`E2E_Compiler_lazygit`	`42544356.44444735` ns/iter	`37792109.6315779` ns/iter	`1.13`
`E2E_Compiler_lerna`	`1662145.2314047215` ns/iter	`1495719.3036093824` ns/iter	`1.11`
`E2E_Compiler_nest_cli`	`6843088.594594208` ns/iter	`8950888.198020075` ns/iter	`0.76`
`E2E_Compiler_omc`	`203604447.99996457` ns/iter	`244570805.66670203` ns/iter	`0.83`
`E2E_Compiler_omnisharp`	`10868438.106794626` ns/iter	`8151728.781819078` ns/iter	`1.33`
`E2E_Compiler_openapi`	`29882778.409087636` ns/iter	`27492345.499998312` ns/iter	`1.09`
`E2E_Compiler_pre_commit_hooks`	`7304412.920000231` ns/iter	`5041176.991453462` ns/iter	`1.45`
`E2E_Compiler_pulumi`	`5117564.200000507` ns/iter	`3815634.7336948584` ns/iter	`1.34`
`E2E_Compiler_semantic_release`	`1853648.4375001227` ns/iter	`1507264.6004273533` ns/iter	`1.23`
`E2E_Compiler_stale`	`1879542.7057355987` ns/iter	`1357043.2760618068` ns/iter	`1.39`
`E2E_Compiler_stylecop`	`7230335.729507372` ns/iter	`5891526.173552261` ns/iter	`1.23`
`E2E_Compiler_tmuxinator`	`1889942.6666666842` ns/iter	`1700808.791208776` ns/iter	`1.11`
`E2E_Compiler_ui5`	`64007749.99999233` ns/iter	`57462598.54545727` ns/iter	`1.11`
`E2E_Compiler_ui5_manifest`	`412876020.4999935` ns/iter	`325515042.0000064` ns/iter	`1.27`
`E2E_Compiler_unreal_engine_uproject`	`5179693.205480374` ns/iter	`4387005.586592582` ns/iter	`1.18`
`E2E_Compiler_users_array`	`1044177.8149386689` ns/iter	`1204299.0780030263` ns/iter	`0.87`
`E2E_Compiler_vercel`	`18034983.050846044` ns/iter	`12435432.956522165` ns/iter	`1.45`
`E2E_Compiler_yamllint`	`291827.1790187431` ns/iter	`266168.6017316547` ns/iter	`1.10`
`E2E_Evaluator_adaptivecard`	`24538.968847345077` ns/iter	`21435.593818743717` ns/iter	`1.14`
`E2E_Evaluator_ansible_meta`	`201645.53269877413` ns/iter	`247428.2651072176` ns/iter	`0.81`
`E2E_Evaluator_aws_cdk`	`43828.29028350192` ns/iter	`42597.733507755605` ns/iter	`1.03`
`E2E_Evaluator_babelrc`	`92052.68493150632` ns/iter	`106957.87965935143` ns/iter	`0.86`
`E2E_Evaluator_cerebrum_criminal_case`	`729736.2838077539` ns/iter	`820340.4554760364` ns/iter	`0.89`
`E2E_Evaluator_clang_format`	`120679.4391317225` ns/iter	`121415.87571633302` ns/iter	`0.99`
`E2E_Evaluator_cmake_presets`	`3568149.513368777` ns/iter	`3642847.5935823605` ns/iter	`0.98`
`E2E_Evaluator_code_climate`	`146761.98298500074` ns/iter	`161291.02099897916` ns/iter	`0.91`
`E2E_Evaluator_cql2`	`152998.44321095292` ns/iter	`172076.37144664055` ns/iter	`0.89`
`E2E_Evaluator_cspell`	`398116.79676671594` ns/iter	`421057.0692194458` ns/iter	`0.95`
`E2E_Evaluator_cypress`	`158368.20573982017` ns/iter	`165667.17796159093` ns/iter	`0.96`
`E2E_Evaluator_deno`	`235742.8195328476` ns/iter	`280989.933628361` ns/iter	`0.84`
`E2E_Evaluator_dependabot`	`264926.2857695035` ns/iter	`335234.6744186007` ns/iter	`0.79`
`E2E_Evaluator_draft_04`	`5568694.244605487` ns/iter	`5834014.622805945` ns/iter	`0.95`
`E2E_Evaluator_fabric_mod`	`619029.8749997964` ns/iter	`616921.3726899202` ns/iter	`1.00`
`E2E_Evaluator_geojson`	`15214320.000000043` ns/iter	`13593215.283333393` ns/iter	`1.12`
`E2E_Evaluator_gitpod_configuration`	`209020.0599532722` ns/iter	`251652.04735543826` ns/iter	`0.83`
`E2E_Evaluator_helm_chart_lock`	`264889.81725384825` ns/iter	`312856.53417837346` ns/iter	`0.85`
`E2E_Evaluator_importmap`	`41021.08687830546` ns/iter	`42437.335428769446` ns/iter	`0.97`
`E2E_Evaluator_jasmine`	`101114.5010278098` ns/iter	`87544.90568401212` ns/iter	`1.16`
`E2E_Evaluator_jshintrc`	`1262246.618868184` ns/iter	`1206434.8802396525` ns/iter	`1.05`
`E2E_Evaluator_jsconfig`	`348042.0151753135` ns/iter	`372584.844510768` ns/iter	`0.93`
`E2E_Evaluator_krakend`	`126325.32151671764` ns/iter	`209920.4926829251` ns/iter	`0.60`
`E2E_Evaluator_lazygit`	`111759.15854799167` ns/iter	`148208.88275123283` ns/iter	`0.75`
`E2E_Evaluator_lerna`	`156956.3961587098` ns/iter	`120738.24897316555` ns/iter	`1.30`
`E2E_Evaluator_nest_cli`	`133508.0728191609` ns/iter	`132029.44427054925` ns/iter	`1.01`
`E2E_Evaluator_omc`	`13895.900367730725` ns/iter	`14399.541010396715` ns/iter	`0.97`
`E2E_Evaluator_omnisharp`	`499804.0231904888` ns/iter	`457961.7212911584` ns/iter	`1.09`
`E2E_Evaluator_openapi`	`8595970.759614602` ns/iter	`5723937.669421697` ns/iter	`1.50`
`E2E_Evaluator_pre_commit_hooks`	`400649.0206235084` ns/iter	`336915.53913050983` ns/iter	`1.19`
`E2E_Evaluator_pulumi`	`629908.5839998496` ns/iter	`505214.18604656117` ns/iter	`1.25`
`E2E_Evaluator_semantic_release`	`92918.76678055004` ns/iter	`73098.81529411042` ns/iter	`1.27`
`E2E_Evaluator_stale`	`116611.09523030272` ns/iter	`118708.03164313667` ns/iter	`0.98`
`E2E_Evaluator_stylecop`	`191895.86000511644` ns/iter	`182009.612147051` ns/iter	`1.05`
`E2E_Evaluator_tmuxinator`	`74383.27390570051` ns/iter	`75614.10198582032` ns/iter	`0.98`
`E2E_Evaluator_ui5`	`376687.20410312567` ns/iter	`494348.6333334154` ns/iter	`0.76`
`E2E_Evaluator_ui5_manifest`	`2100106.2544985386` ns/iter	`1921634.5845068288` ns/iter	`1.09`
`E2E_Evaluator_unreal_engine_uproject`	`323932.82786512596` ns/iter	`325448.0652873914` ns/iter	`1.00`
`E2E_Evaluator_users_array`	`429363.5364832876` ns/iter	`429666.96748940914` ns/iter	`1.00`
`E2E_Evaluator_vercel`	`222516.39474514674` ns/iter	`219043.7156279812` ns/iter	`1.02`
`E2E_Evaluator_yamllint`	`6285.308706872081` ns/iter	`7860.945443042677` ns/iter	`0.80`
`Micro_Draft4_Meta_1_No_Callback`	`136.21262958795745` ns/iter	`178.86230132594724` ns/iter	`0.76`
`Micro_Draft4_Required_Properties`	`646.4754808906` ns/iter	`814.3991939931213` ns/iter	`0.79`
`Micro_Draft4_Many_Optional_Properties_Minimal_Match`	`21.52854634500198` ns/iter	`20.437865624592686` ns/iter	`1.05`
`Micro_Draft4_Few_Optional_Properties_Minimal_Match`	`9.605456251585137` ns/iter	`9.463380313637014` ns/iter	`1.02`
`Micro_Draft4_Items_Schema`	`354.67782257683683` ns/iter	`330.8368902362445` ns/iter	`1.07`
`Micro_Draft4_Nested_Object`	`0.9374867554481521` ns/iter	`0.8820987334968184` ns/iter	`1.06`
`Micro_Draft4_Properties_Triad_Optional`	`285.5557256582632` ns/iter	`251.60251529069396` ns/iter	`1.13`
`Micro_Draft4_Properties_Triad_Closed`	`210.70349465234622` ns/iter	`219.61846307720032` ns/iter	`0.96`
`Micro_Draft4_Properties_Triad_Required`	`280.81733805420737` ns/iter	`276.88268545134827` ns/iter	`1.01`
`Micro_Draft4_Properties_Closed`	`52.6998125000091` ns/iter	`47.86087893344783` ns/iter	`1.10`
`Micro_Draft4_Non_Recursive_Ref`	`17.602732544552953` ns/iter	`14.382497775112164` ns/iter	`1.22`
`Micro_Draft4_Pattern_Properties_True`	`183.6793477678708` ns/iter	`205.8782159093026` ns/iter	`0.89`
`Micro_Draft4_Ref_To_Single_Property`	`10.322986116763659` ns/iter	`13.140567402244708` ns/iter	`0.79`
`Micro_Draft4_Additional_Properties_Type`	`36.46090780331538` ns/iter	`39.672464981253825` ns/iter	`0.92`
`Micro_Draft4_Nested_Oneof`	`67.59297746636548` ns/iter	`61.760030199769474` ns/iter	`1.09`
`Micro_Draft4_Short_Enum`	`7.136610939273382` ns/iter	`6.925376407924874` ns/iter	`1.03`
`Micro_Draft4_Long_Enum`	`15.590539402238214` ns/iter	`12.539424464176486` ns/iter	`1.24`
`Micro_Draft4_Long_Enum_Short_Strings`	`10.125915863231414` ns/iter	`8.566581352060517` ns/iter	`1.18`
`Micro_Draft4_Type_Object`	`3.08597727645209` ns/iter	`2.8930818070589512` ns/iter	`1.07`
`Micro_Draft4_Ref_Single_100`	`4531248.8738738205` ns/iter	`2655749.6570244776` ns/iter	`1.71`
`Micro_Draft4_Compile_Ref_Many_Nested`	`2124682.186246658` ns/iter	`1874709.2284945787` ns/iter	`1.13`
`Micro_Draft4_Compile_Wrap`	`3340339.2629309264` ns/iter	`3217922.536363072` ns/iter	`1.04`
`Micro_Draft6_Property_Names`	`144.94450673610783` ns/iter	`129.8258371248718` ns/iter	`1.12`
`Micro_Draft6_Compile_FHIR`	`22222654708.999928` ns/iter	`16847490958.99997` ns/iter	`1.32`
`Micro_Draft7_If_Then_Else`	`25.39518175054968` ns/iter	`19.449153650652253` ns/iter	`1.31`
`Micro_2019_09_Unevaluated_Properties`	`31.47853471532837` ns/iter	`28.907988183364438` ns/iter	`1.09`
`Micro_2019_09_Compile_Wrap`	`493238583.4999877` ns/iter	`372550062.5000677` ns/iter	`1.32`
`Micro_2020_12_Dynamic_Ref`	`204.3777033190803` ns/iter	`212.9943691967734` ns/iter	`0.96`
`Micro_2020_12_Dynamic_Ref_Single`	`2.5613852175376794` ns/iter	`2.505779797660395` ns/iter	`1.02`
`Micro_2020_12_Simple_Output_Mask`	`926.8706365904551` ns/iter	`779.1363877937276` ns/iter	`1.19`
`Micro_2020_12_Simple_Output_Annotations`	`106943.18134142405` ns/iter	`87540.72964522276` ns/iter	`1.22`
`Micro_2020_12_Compile_NonCircular_Shared_Refs`	`1107800.7111111344` ns/iter	`883034.5982144012` ns/iter	`1.25`
`Micro_2020_12_Exhaustive_Deep_Numeric`	`7495.904459549686` ns/iter	`6015.339981007055` ns/iter	`1.25`
`Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput`	`154694.3876841238` ns/iter	`117905.49907579526` ns/iter	`1.31`
`Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput`	`21904.540596789317` ns/iter	`14789.27733317277` ns/iter	`1.48`
`Micro_2020_12_Exhaustive_Deep_Numeric_Fail`	`109.65434074665066` ns/iter	`96.81864431241539` ns/iter	`1.13`
`Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput`	`6943.231869988767` ns/iter	`4489.008026661319` ns/iter	`1.55`
`Alterschema_Check_Readibility_ISO_Language_Set_3`	`338932062.5000209` ns/iter	`232850430.66660666` ns/iter	`1.46`
`Alterschema_Check_Readibility_OMC`	`93161423.66666706` ns/iter	`57694364.58333152` ns/iter	`1.61`
`Alterschema_Check_Readibility_KrakenD`	`1142149958.0001183` ns/iter	`614307708.0000694` ns/iter	`1.86`
`Alterschema_Apply_Readibility_KrakenD`	`84127468790.99973` ns/iter	`65990777792.000015` ns/iter	`1.27`
`Alterschema_Check_Invalid_External_Refs`	`216837486.33336106` ns/iter	`174810510.49998087` ns/iter	`1.24`

This comment was automatically generated by workflow using github-action-benchmark.

github-actions

JavaScript (macos/llvm)

Details

Benchmark suite	Current: `5991c40`	Previous: `bac3ea7`	Ratio
`E2E_Evaluator_adaptivecard`	`97357` ns	`123884` ns	`0.79`
`E2E_Evaluator_ansible-meta`	`370599` ns	`481140` ns	`0.77`
`E2E_Evaluator_aws-cdk`	`121737` ns	`134257` ns	`0.91`
`E2E_Evaluator_babelrc`	`262511` ns	`282958` ns	`0.93`
`E2E_Evaluator_cerebrum-criminal-case`	`1627787` ns	`1934910` ns	`0.84`
`E2E_Evaluator_clang-format`	`188764` ns	`201373` ns	`0.94`
`E2E_Evaluator_cmake-presets`	`11918782` ns	`12764366` ns	`0.93`
`E2E_Evaluator_code-climate`	`391435` ns	`393795` ns	`0.99`
`E2E_Evaluator_cql2`	`1215510` ns	`1061633` ns	`1.14`
`E2E_Evaluator_cspell`	`1320079` ns	`1131666` ns	`1.17`
`E2E_Evaluator_cypress`	`664696` ns	`639544` ns	`1.04`
`E2E_Evaluator_deno`	`765917` ns	`786903` ns	`0.97`
`E2E_Evaluator_dependabot`	`817062` ns	`934863` ns	`0.87`
`E2E_Evaluator_draft-04`	`19046428` ns	`17736510` ns	`1.07`
`E2E_Evaluator_fabric-mod`	`1763586` ns	`1484406` ns	`1.19`
`E2E_Evaluator_geojson`	`16489025` ns	`15231015` ns	`1.08`
`E2E_Evaluator_gitpod-configuration`	`523031` ns	`497514` ns	`1.05`
`E2E_Evaluator_helm-chart-lock`	`959761` ns	`866180` ns	`1.11`
`E2E_Evaluator_importmap`	`236090` ns	`211248` ns	`1.12`
`E2E_Evaluator_jasmine`	`251777` ns	`228932` ns	`1.10`
`E2E_Evaluator_jsconfig`	`1055032` ns	`830668` ns	`1.27`
`E2E_Evaluator_jshintrc`	`2244737` ns	`1976674` ns	`1.14`
`E2E_Evaluator_krakend`	`451188` ns	`437149` ns	`1.03`
`E2E_Evaluator_lazygit`	`311335` ns	`274695` ns	`1.13`
`E2E_Evaluator_lerna`	`387522` ns	`316056` ns	`1.23`
`E2E_Evaluator_nest-cli`	`445421` ns	`416324` ns	`1.07`
`E2E_Evaluator_omc`	`76228` ns	`71046` ns	`1.07`
`E2E_Evaluator_omnisharp`	`960035` ns	`946836` ns	`1.01`
`E2E_Evaluator_openapi`	`15360566` ns	`14773980` ns	`1.04`
`E2E_Evaluator_pre-commit-hooks`	`1468780` ns	`1300184` ns	`1.13`
`E2E_Evaluator_pulumi`	`1584854` ns	`1380557` ns	`1.15`
`E2E_Evaluator_semantic-release`	`195415` ns	`180724` ns	`1.08`
`E2E_Evaluator_stale`	`315959` ns	`338876` ns	`0.93`
`E2E_Evaluator_stylecop`	`815004` ns	`775696` ns	`1.05`
`E2E_Evaluator_tmuxinator`	`164112` ns	`164167` ns	`1.00`
`E2E_Evaluator_ui5`	`1536882` ns	`1542268` ns	`1.00`
`E2E_Evaluator_ui5-manifest`	`7423918` ns	`8111573` ns	`0.92`
`E2E_Evaluator_unreal-engine-uproject`	`1098397` ns	`1208660` ns	`0.91`
`E2E_Evaluator_users-array`	`1835813` ns	`1933489` ns	`0.95`
`E2E_Evaluator_vercel`	`700934` ns	`723734` ns	`0.97`
`E2E_Evaluator_yamllint`	`22971` ns	`29358` ns	`0.78`

This comment was automatically generated by workflow using github-action-benchmark.

github-actions

Benchmark (linux/gcc)

Details

Benchmark suite	Current: `5991c40`	Previous: `5b9baeb`	Ratio
`Alterschema_Check_Readibility_ISO_Language_Set_3`	`352106526.50005156` ns/iter	`358235898.00008905` ns/iter	`0.98`
`Alterschema_Check_Readibility_OMC`	`99509797.57143484` ns/iter	`96820354.42857082` ns/iter	`1.03`
`Alterschema_Check_Readibility_KrakenD`	`1410864627.0001373` ns/iter	`1323455539.9999409` ns/iter	`1.07`
`Alterschema_Apply_Readibility_KrakenD`	`133001844573.0002` ns/iter	`124564622828.00021` ns/iter	`1.07`
`Alterschema_Check_Invalid_External_Refs`	`305583790.00001425` ns/iter	`336062904.99994886` ns/iter	`0.91`
`Micro_2020_12_Dynamic_Ref`	`259.4628232017266` ns/iter	`262.806379837153` ns/iter	`0.99`
`Micro_2020_12_Dynamic_Ref_Single`	`4.571116930476695` ns/iter	`4.986833737890224` ns/iter	`0.92`
`Micro_2020_12_Simple_Output_Mask`	`1136.2654053778538` ns/iter	`1138.211366799869` ns/iter	`1.00`
`Micro_2020_12_Simple_Output_Annotations`	`103954.69711610682` ns/iter	`118895.22030683982` ns/iter	`0.87`
`Micro_2020_12_Compile_NonCircular_Shared_Refs`	`1194993.9488925354` ns/iter	`1224537.6073296398` ns/iter	`0.98`
`Micro_2020_12_Exhaustive_Deep_Numeric`	`7973.82797056835` ns/iter	`8372.107184923485` ns/iter	`0.95`
`Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput`	`165708.0406139497` ns/iter	`168473.30478712433` ns/iter	`0.98`
`Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput`	`26448.329055326183` ns/iter	`26642.96880831734` ns/iter	`0.99`
`Micro_2020_12_Exhaustive_Deep_Numeric_Fail`	`136.08314604162084` ns/iter	`138.02488354937168` ns/iter	`0.99`
`Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput`	`4478.054965828074` ns/iter	`4928.082266589598` ns/iter	`0.91`
`Micro_2019_09_Unevaluated_Properties`	`29.56979213994572` ns/iter	`29.66856263827967` ns/iter	`1.00`
`Micro_2019_09_Compile_Wrap`	`314574235.99999857` ns/iter	`321307731.5000419` ns/iter	`0.98`
`Micro_Draft7_If_Then_Else`	`25.16095908826541` ns/iter	`24.33081690897657` ns/iter	`1.03`
`Micro_Draft6_Property_Names`	`150.72257965084435` ns/iter	`142.3829317530807` ns/iter	`1.06`
`Micro_Draft6_Compile_FHIR`	`15307437533.999973` ns/iter	`13614982983.99988` ns/iter	`1.12`
`Micro_Draft4_Meta_1_No_Callback`	`173.27347994881578` ns/iter	`173.1695751841687` ns/iter	`1.00`
`Micro_Draft4_Required_Properties`	`815.3951443023473` ns/iter	`834.7094278617517` ns/iter	`0.98`
`Micro_Draft4_Many_Optional_Properties_Minimal_Match`	`21.10597184004122` ns/iter	`20.934052991813296` ns/iter	`1.01`
`Micro_Draft4_Few_Optional_Properties_Minimal_Match`	`12.662571150607567` ns/iter	`14.0945451433402` ns/iter	`0.90`
`Micro_Draft4_Items_Schema`	`317.47076450889716` ns/iter	`334.684871009177` ns/iter	`0.95`
`Micro_Draft4_Nested_Object`	`2.1099204610527744` ns/iter	`1.5580926572642908` ns/iter	`1.35`
`Micro_Draft4_Properties_Triad_Optional`	`453.26078317013804` ns/iter	`379.77096527162416` ns/iter	`1.19`
`Micro_Draft4_Properties_Triad_Closed`	`414.142983574989` ns/iter	`322.65912505315646` ns/iter	`1.28`
`Micro_Draft4_Properties_Triad_Required`	`436.40450280679664` ns/iter	`406.5647282091034` ns/iter	`1.07`
`Micro_Draft4_Properties_Closed`	`62.400136681314315` ns/iter	`61.83281300325118` ns/iter	`1.01`
`Micro_Draft4_Non_Recursive_Ref`	`8.837951457312938` ns/iter	`9.65834409508717` ns/iter	`0.92`
`Micro_Draft4_Pattern_Properties_True`	`199.96817654795592` ns/iter	`199.52214596901482` ns/iter	`1.00`
`Micro_Draft4_Ref_To_Single_Property`	`12.66049508280013` ns/iter	`13.135724951816002` ns/iter	`0.96`
`Micro_Draft4_Additional_Properties_Type`	`15.061026494673124` ns/iter	`14.64546056989718` ns/iter	`1.03`
`Micro_Draft4_Nested_Oneof`	`65.85043726999325` ns/iter	`64.62438898069097` ns/iter	`1.02`
`Micro_Draft4_Short_Enum`	`14.80229403976055` ns/iter	`14.736052153879644` ns/iter	`1.00`
`Micro_Draft4_Long_Enum`	`13.38448046730727` ns/iter	`15.279862627816096` ns/iter	`0.88`
`Micro_Draft4_Long_Enum_Short_Strings`	`14.836890859971241` ns/iter	`14.691156250608104` ns/iter	`1.01`
`Micro_Draft4_Type_Object`	`4.224059664679693` ns/iter	`4.680383580201538` ns/iter	`0.90`
`Micro_Draft4_Ref_Single_100`	`2529762.931655025` ns/iter	`2548235.1702892273` ns/iter	`0.99`
`Micro_Draft4_Compile_Ref_Many_Nested`	`1836199.0392669018` ns/iter	`1841092.0183728754` ns/iter	`1.00`
`Micro_Draft4_Compile_Wrap`	`2582975.8966794605` ns/iter	`2591950.8745390787` ns/iter	`1.00`
`E2E_Compiler_adaptivecard`	`67206965.39998698` ns/iter	`67287439.00000402` ns/iter	`1.00`
`E2E_Compiler_ansible_meta`	`31327876.999997977` ns/iter	`30216079.34782799` ns/iter	`1.04`
`E2E_Compiler_aws_cdk`	`408225.22650318174` ns/iter	`425182.41469328816` ns/iter	`0.96`
`E2E_Compiler_babelrc`	`2817154.895582239` ns/iter	`2795131.875000005` ns/iter	`1.01`
`E2E_Compiler_clang_format`	`20064124.171429805` ns/iter	`19676122.722223178` ns/iter	`1.02`
`E2E_Compiler_cmake_presets`	`28138544.43999844` ns/iter	`27433425.038461443` ns/iter	`1.03`
`E2E_Compiler_code_climate`	`2861291.057142436` ns/iter	`2831004.3775103893` ns/iter	`1.01`
`E2E_Compiler_cql2`	`14226696.20408168` ns/iter	`14563900.26530652` ns/iter	`0.98`
`E2E_Compiler_cspell`	`24600253.896551292` ns/iter	`24182957.24137822` ns/iter	`1.02`
`E2E_Compiler_cypress`	`4272473.243901924` ns/iter	`4195952.279503065` ns/iter	`1.02`
`E2E_Compiler_deno`	`8418328.614458138` ns/iter	`8255207.623530141` ns/iter	`1.02`
`E2E_Compiler_dependabot`	`4326252.9627328655` ns/iter	`4267725.993902165` ns/iter	`1.01`
`E2E_Compiler_draft_04`	`2971236.0932202023` ns/iter	`3006943.3474575095` ns/iter	`0.99`
`E2E_Compiler_fabric_mod`	`5246909.195487486` ns/iter	`5214837.888888724` ns/iter	`1.01`
`E2E_Compiler_geojson`	`24576767.357140332` ns/iter	`23971260.586206663` ns/iter	`1.03`
`E2E_Compiler_gitpod_configuration`	`5363647.815385356` ns/iter	`5317236.409091424` ns/iter	`1.01`
`E2E_Compiler_helm_chart_lock`	`743624.5910543496` ns/iter	`759713.2931596651` ns/iter	`0.98`
`E2E_Compiler_importmap`	`304500.20748148987` ns/iter	`315884.9670429718` ns/iter	`0.96`
`E2E_Compiler_jasmine`	`1486669.712473445` ns/iter	`1485984.32127683` ns/iter	`1.00`
`E2E_Compiler_jshintrc`	`4760120.102041057` ns/iter	`4725365.770270486` ns/iter	`1.01`
`E2E_Compiler_jsconfig`	`23594831.19999671` ns/iter	`23330496.49999642` ns/iter	`1.01`
`E2E_Compiler_krakend`	`142999789.60002592` ns/iter	`150093400.20001218` ns/iter	`0.95`
`E2E_Compiler_lazygit`	`36173621.36841812` ns/iter	`35659433.299997546` ns/iter	`1.01`
`E2E_Compiler_lerna`	`1752342.580000459` ns/iter	`1769082.3308080693` ns/iter	`0.99`
`E2E_Compiler_nest_cli`	`8137085.802326679` ns/iter	`8029425.356321606` ns/iter	`1.01`
`E2E_Compiler_omc`	`170021792.49999472` ns/iter	`164897144.50000292` ns/iter	`1.03`
`E2E_Compiler_omnisharp`	`7346382.957894093` ns/iter	`7297027.876289182` ns/iter	`1.01`
`E2E_Compiler_openapi`	`27229301.461532556` ns/iter	`26890765.384616945` ns/iter	`1.01`
`E2E_Compiler_pre_commit_hooks`	`5796805.347107851` ns/iter	`5725220.585364748` ns/iter	`1.01`
`E2E_Compiler_pulumi`	`4422491.088050419` ns/iter	`4397691.300000872` ns/iter	`1.01`
`E2E_Compiler_semantic_release`	`1725608.5492609544` ns/iter	`1718033.100736652` ns/iter	`1.00`
`E2E_Compiler_stale`	`1682184.7529972817` ns/iter	`1681013.0937503667` ns/iter	`1.00`
`E2E_Compiler_stylecop`	`6557333.149532632` ns/iter	`6310221.990990105` ns/iter	`1.04`
`E2E_Compiler_tmuxinator`	`2127187.048632124` ns/iter	`2135542.249240331` ns/iter	`1.00`
`E2E_Compiler_ui5`	`51120996.85714253` ns/iter	`49675965.071433626` ns/iter	`1.03`
`E2E_Compiler_ui5_manifest`	`327912357.99993503` ns/iter	`332638543.50002474` ns/iter	`0.99`
`E2E_Compiler_unreal_engine_uproject`	`4980189.120566938` ns/iter	`4972438.633801727` ns/iter	`1.00`
`E2E_Compiler_users_array`	`859340.3394607267` ns/iter	`888449.2191083056` ns/iter	`0.97`
`E2E_Compiler_vercel`	`13267150.1698093` ns/iter	`13277535.566040346` ns/iter	`1.00`
`E2E_Compiler_yamllint`	`370175.8022269408` ns/iter	`386089.9944963702` ns/iter	`0.96`
`E2E_Evaluator_adaptivecard`	`23296.904559489994` ns/iter	`24909.6762476851` ns/iter	`0.94`
`E2E_Evaluator_ansible_meta`	`222658.1484896686` ns/iter	`243462.6561633981` ns/iter	`0.91`
`E2E_Evaluator_aws_cdk`	`43931.62101408287` ns/iter	`52068.792359064224` ns/iter	`0.84`
`E2E_Evaluator_babelrc`	`83632.00636329962` ns/iter	`111192.7329279682` ns/iter	`0.75`
`E2E_Evaluator_cerebrum_criminal_case`	`1041921.9049773932` ns/iter	`997505.649855652` ns/iter	`1.04`
`E2E_Evaluator_clang_format`	`92516.54269500924` ns/iter	`102531.44043373258` ns/iter	`0.90`
`E2E_Evaluator_cmake_presets`	`4486817.980769513` ns/iter	`4547763.753164504` ns/iter	`0.99`
`E2E_Evaluator_code_climate`	`166035.25509471973` ns/iter	`194206.93390255712` ns/iter	`0.85`
`E2E_Evaluator_cql2`	`201278.56802529606` ns/iter	`216642.49662610923` ns/iter	`0.93`
`E2E_Evaluator_cspell`	`505482.3480462888` ns/iter	`537355.217958608` ns/iter	`0.94`
`E2E_Evaluator_cypress`	`140535.3837162473` ns/iter	`172940.60187470133` ns/iter	`0.81`
`E2E_Evaluator_deno`	`272573.9416325955` ns/iter	`341278.28907393635` ns/iter	`0.80`
`E2E_Evaluator_dependabot`	`334568.2225406245` ns/iter	`349270.77351924684` ns/iter	`0.96`
`E2E_Evaluator_draft_04`	`7299203.666666517` ns/iter	`7123471.000001053` ns/iter	`1.02`
`E2E_Evaluator_fabric_mod`	`708208.4313726032` ns/iter	`737452.2344243691` ns/iter	`0.96`
`E2E_Evaluator_geojson`	`16295558.146339318` ns/iter	`16516933.333334582` ns/iter	`0.99`
`E2E_Evaluator_gitpod_configuration`	`219697.65181935817` ns/iter	`250319.59024388494` ns/iter	`0.88`
`E2E_Evaluator_helm_chart_lock`	`202221.19292608957` ns/iter	`310629.13182021223` ns/iter	`0.65`
`E2E_Evaluator_importmap`	`40876.8058806568` ns/iter	`47527.40070028329` ns/iter	`0.86`
`E2E_Evaluator_jasmine`	`102112.4511896089` ns/iter	`117225.82307561398` ns/iter	`0.87`
`E2E_Evaluator_jshintrc`	`1024137.8857978575` ns/iter	`1056953.4231331656` ns/iter	`0.97`
`E2E_Evaluator_jsconfig`	`371499.9320021873` ns/iter	`400084.70304413274` ns/iter	`0.93`
`E2E_Evaluator_krakend`	`184996.50479396037` ns/iter	`204670.76412052437` ns/iter	`0.90`
`E2E_Evaluator_lazygit`	`122061.51355084324` ns/iter	`133592.21529100154` ns/iter	`0.91`
`E2E_Evaluator_lerna`	`119178.78703864374` ns/iter	`145405.73996293475` ns/iter	`0.82`
`E2E_Evaluator_nest_cli`	`176919.78123415879` ns/iter	`194001.78901341703` ns/iter	`0.91`
`E2E_Evaluator_omc`	`18171.49546843817` ns/iter	`18874.727946541447` ns/iter	`0.96`
`E2E_Evaluator_omnisharp`	`532918.2289789093` ns/iter	`556389.0249195874` ns/iter	`0.96`
`E2E_Evaluator_openapi`	`9245688.986302162` ns/iter	`9352641.17333342` ns/iter	`0.99`
`E2E_Evaluator_pre_commit_hooks`	`457012.04128434835` ns/iter	`502856.9791215412` ns/iter	`0.91`
`E2E_Evaluator_pulumi`	`710400.0732453229` ns/iter	`697347.7065327447` ns/iter	`1.02`
`E2E_Evaluator_semantic_release`	`86375.96945615845` ns/iter	`101095.41000422105` ns/iter	`0.85`
`E2E_Evaluator_stale`	`145389.63061739338` ns/iter	`157108.752167123` ns/iter	`0.93`
`E2E_Evaluator_stylecop`	`286553.112072501` ns/iter	`307624.88650962006` ns/iter	`0.93`
`E2E_Evaluator_tmuxinator`	`86712.61143350645` ns/iter	`100547.62451836432` ns/iter	`0.86`
`E2E_Evaluator_ui5`	`493209.6487053242` ns/iter	`543965.4284596782` ns/iter	`0.91`
`E2E_Evaluator_ui5_manifest`	`2580299.7255633594` ns/iter	`2726551.9115382214` ns/iter	`0.95`
`E2E_Evaluator_unreal_engine_uproject`	`423304.15351940354` ns/iter	`457840.53429134423` ns/iter	`0.92`
`E2E_Evaluator_users_array`	`614323.2362489157` ns/iter	`630002.8700265436` ns/iter	`0.98`
`E2E_Evaluator_vercel`	`258788.88978691603` ns/iter	`314566.6793997328` ns/iter	`0.82`
`E2E_Evaluator_yamllint`	`9213.489360582447` ns/iter	`10667.83248540804` ns/iter	`0.86`

This comment was automatically generated by workflow using github-action-benchmark.

github-actions

JavaScript (linux/gcc)

Details

Benchmark suite	Current: `5991c40`	Previous: `5b9baeb`	Ratio
`E2E_Evaluator_adaptivecard`	`118325` ns	`119282` ns	`0.99`
`E2E_Evaluator_ansible-meta`	`537499` ns	`537125` ns	`1.00`
`E2E_Evaluator_aws-cdk`	`128107` ns	`150394` ns	`0.85`
`E2E_Evaluator_babelrc`	`302591` ns	`324841` ns	`0.93`
`E2E_Evaluator_cerebrum-criminal-case`	`2646746` ns	`2564331` ns	`1.03`
`E2E_Evaluator_clang-format`	`260980` ns	`267327` ns	`0.98`
`E2E_Evaluator_cmake-presets`	`17652213` ns	`16702080` ns	`1.06`
`E2E_Evaluator_code-climate`	`488721` ns	`506615` ns	`0.96`
`E2E_Evaluator_cql2`	`1250077` ns	`1229808` ns	`1.02`
`E2E_Evaluator_cspell`	`1621075` ns	`1472438` ns	`1.10`
`E2E_Evaluator_cypress`	`859708` ns	`786037` ns	`1.09`
`E2E_Evaluator_deno`	`1095411` ns	`1081758` ns	`1.01`
`E2E_Evaluator_dependabot`	`1251445` ns	`1221562` ns	`1.02`
`E2E_Evaluator_draft-04`	`29344655` ns	`24181904` ns	`1.21`
`E2E_Evaluator_fabric-mod`	`2495104` ns	`2344155` ns	`1.06`
`E2E_Evaluator_geojson`	`21351834` ns	`19588111` ns	`1.09`
`E2E_Evaluator_gitpod-configuration`	`732201` ns	`716972` ns	`1.02`
`E2E_Evaluator_helm-chart-lock`	`1054997` ns	`1006288` ns	`1.05`
`E2E_Evaluator_importmap`	`262026` ns	`266183` ns	`0.98`
`E2E_Evaluator_jasmine`	`280239` ns	`288362` ns	`0.97`
`E2E_Evaluator_jsconfig`	`1416174` ns	`1235980` ns	`1.15`
`E2E_Evaluator_jshintrc`	`2925534` ns	`2711983` ns	`1.08`
`E2E_Evaluator_krakend`	`649386` ns	`680587` ns	`0.95`
`E2E_Evaluator_lazygit`	`457980` ns	`496498` ns	`0.92`
`E2E_Evaluator_lerna`	`434878` ns	`466128` ns	`0.93`
`E2E_Evaluator_nest-cli`	`602876` ns	`606315` ns	`0.99`
`E2E_Evaluator_omc`	`93125` ns	`91576` ns	`1.02`
`E2E_Evaluator_omnisharp`	`1451253` ns	`1401383` ns	`1.04`
`E2E_Evaluator_openapi`	`24404250` ns	`22665951` ns	`1.08`
`E2E_Evaluator_pre-commit-hooks`	`2166343` ns	`2000451` ns	`1.08`
`E2E_Evaluator_pulumi`	`2016423` ns	`1904183` ns	`1.06`
`E2E_Evaluator_semantic-release`	`235249` ns	`254278` ns	`0.93`
`E2E_Evaluator_stale`	`381617` ns	`393880` ns	`0.97`
`E2E_Evaluator_stylecop`	`1269368` ns	`1213967` ns	`1.05`
`E2E_Evaluator_tmuxinator`	`214619` ns	`219325` ns	`0.98`
`E2E_Evaluator_ui5`	`2288155` ns	`2368547` ns	`0.97`
`E2E_Evaluator_ui5-manifest`	`11544868` ns	`10264840` ns	`1.12`
`E2E_Evaluator_unreal-engine-uproject`	`1615526` ns	`1518486` ns	`1.06`
`E2E_Evaluator_users-array`	`2562262` ns	`2444787` ns	`1.05`
`E2E_Evaluator_vercel`	`1002911` ns	`965575` ns	`1.04`
`E2E_Evaluator_yamllint`	`23975` ns	`25601` ns	`0.94`

This comment was automatically generated by workflow using github-action-benchmark.

Add proper Draft 3 type trace tests

8c1038b

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>

cubic-dev-ai Bot reviewed May 5, 2026

View reviewed changes

Comment thread src/compiler/default_compiler_draft3.h

Comment thread test/evaluator/evaluator_draft3.json

augmentcode Bot reviewed May 5, 2026

View reviewed changes

Fix JS

5991c40

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>

cubic-dev-ai Bot reviewed May 5, 2026

View reviewed changes

Comment thread test/evaluator/evaluator_draft3_test.cc

jviotti merged commit 5b9baeb into main May 5, 2026
15 checks passed

jviotti deleted the draft3-trace-tests branch May 5, 2026 20:08

github-actions Bot reviewed May 5, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add proper Draft 3 `type` trace tests#782

Add proper Draft 3 `type` trace tests#782
jviotti merged 2 commits intomainfrom
draft3-trace-tests

jviotti commented May 5, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Uh oh!

Uh oh!

Uh oh!

augmentcode Bot commented May 5, 2026

Uh oh!

augmentcode Bot left a comment

Uh oh!

cubic-dev-ai Bot left a comment

Uh oh!

Uh oh!

Uh oh!

github-actions Bot left a comment

Uh oh!

github-actions Bot left a comment

Uh oh!

github-actions Bot left a comment

Uh oh!

github-actions Bot left a comment

Uh oh!

github-actions Bot left a comment

Uh oh!

github-actions Bot left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Conversation

jviotti commented May 5, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

augmentcode Bot commented May 5, 2026

Uh oh!

augmentcode Bot left a comment

Choose a reason for hiding this comment

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

github-actions Bot left a comment

Choose a reason for hiding this comment

Benchmark (linux/llvm)

Uh oh!

github-actions Bot left a comment

Choose a reason for hiding this comment

JavaScript (linux/llvm)

Uh oh!

github-actions Bot left a comment

Choose a reason for hiding this comment

Benchmark (macos/llvm)

Uh oh!

github-actions Bot left a comment

Choose a reason for hiding this comment

JavaScript (macos/llvm)

Uh oh!

github-actions Bot left a comment

Choose a reason for hiding this comment

Benchmark (linux/gcc)

Uh oh!

github-actions Bot left a comment

Choose a reason for hiding this comment

JavaScript (linux/gcc)

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant