Add a linter rule to check for ECMA-262 in pattern#842
Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
🤖 Augment PR SummarySummary: This PR adds a new alterschema linter rule that flags schemas whose Changes:
Technical Notes: The rule is non-mutating (lint-only) and only applies when the active vocabularies indicate a JSON Schema validation context where 🤖 Was this summary useful? React with 👍 or 👎 |
| EXPECT_EQ(document, expected); | ||
| } | ||
|
|
||
| TEST(AlterSchema_lint_openapi_3_1, pattern_non_ecma_regex_invalid_escape) { |
There was a problem hiding this comment.
test/alterschema/alterschema_lint_openapi_test.cc:247: The new rule is covered for OpenAPI 3.1, but this repo also has OpenAPI 3.2 dialect tests in the same file; consider adding a similar pattern_non_ecma_regex test for the 3.2 dialect URI to ensure the vocabulary mapping triggers the rule there too.
Severity: low
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
There was a problem hiding this comment.
1 issue found across 9 files
Prompt for AI agents (unresolved issues)
Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.
<file name="src/alterschema/linter/pattern_non_ecma_regex.h">
<violation number="1" location="src/alterschema/linter/pattern_non_ecma_regex.h:35">
P3: The vocabulary list includes `JSON_Schema_Draft_0`, `Draft_1`, and `Draft_2` entries, but no corresponding test coverage is added for those dialects (tests start at Draft 3). Without tests, regressions in those vocabulary mappings would go undetected.</violation>
</file>
Reply with feedback, questions, or to request a fix.
Re-trigger cubic
| Vocabularies::Known::JSON_Schema_Draft_2_Hyper, | ||
| Vocabularies::Known::JSON_Schema_Draft_1, | ||
| Vocabularies::Known::JSON_Schema_Draft_1_Hyper, | ||
| Vocabularies::Known::JSON_Schema_Draft_0, |
There was a problem hiding this comment.
P3: The vocabulary list includes JSON_Schema_Draft_0, Draft_1, and Draft_2 entries, but no corresponding test coverage is added for those dialects (tests start at Draft 3). Without tests, regressions in those vocabulary mappings would go undetected.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/alterschema/linter/pattern_non_ecma_regex.h, line 35:
<comment>The vocabulary list includes `JSON_Schema_Draft_0`, `Draft_1`, and `Draft_2` entries, but no corresponding test coverage is added for those dialects (tests start at Draft 3). Without tests, regressions in those vocabulary mappings would go undetected.</comment>
<file context>
@@ -0,0 +1,46 @@
+ Vocabularies::Known::JSON_Schema_Draft_2_Hyper,
+ Vocabularies::Known::JSON_Schema_Draft_1,
+ Vocabularies::Known::JSON_Schema_Draft_1_Hyper,
+ Vocabularies::Known::JSON_Schema_Draft_0,
+ Vocabularies::Known::JSON_Schema_Draft_0_Hyper}));
+ ONLY_CONTINUE_IF(schema.is_object());
</file context>
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: d648028 | Previous: 77c1d98 | Ratio |
|---|---|---|---|
Schema_Iterator_ISO_Language |
2991471.911391733 ns/iter |
3048424.692307781 ns/iter |
0.98 |
Schema_Tracker_ISO_Language |
4783653.569444053 ns/iter |
4796215.465278111 ns/iter |
1.00 |
Schema_Tracker_ISO_Language_To_JSON |
20822009.93939323 ns/iter |
20704843.151513543 ns/iter |
1.01 |
Schema_Frame_WoT_References |
5320670.1666681515 ns/iter |
5238392.485073835 ns/iter |
1.02 |
Schema_Frame_OMC_References |
21493757.843749963 ns/iter |
21732049.437499512 ns/iter |
0.99 |
Schema_Frame_OMC_Locations |
19785637.828571063 ns/iter |
19971796.057143364 ns/iter |
0.99 |
Schema_Frame_ISO_Language_Locations |
100943779.33334424 ns/iter |
103518275.1666639 ns/iter |
0.98 |
Schema_Frame_KrakenD_References |
39049591.22222509 ns/iter |
40436718.35294096 ns/iter |
0.97 |
Schema_Frame_KrakenD_Reachable |
546510444.9999671 ns/iter |
556384986.0000118 ns/iter |
0.98 |
Schema_Frame_ISO_Language_Locations_To_JSON |
119731678.80000801 ns/iter |
118496223.66666305 ns/iter |
1.01 |
Schema_Frame_Many_Resources_References |
369225430.0000286 ns/iter |
367423390.49999374 ns/iter |
1.00 |
Schema_Bundle_Meta_2020_12 |
1760551.360903515 ns/iter |
1716569.9632313116 ns/iter |
1.03 |
Schema_Format_ISO_Language_To_JSON |
107140279.16666661 ns/iter |
108094156.16665775 ns/iter |
0.99 |
E2E_Compiler_adaptivecard |
63077849.09090102 ns/iter |
62419336.27272415 ns/iter |
1.01 |
E2E_Compiler_ansible_meta |
29611514.291673303 ns/iter |
28942941.41666383 ns/iter |
1.02 |
E2E_Compiler_aws_cdk |
393681.3724605074 ns/iter |
384457.56167402474 ns/iter |
1.02 |
E2E_Compiler_babelrc |
2656673.4790868177 ns/iter |
2623209.772388467 ns/iter |
1.01 |
E2E_Compiler_clang_format |
18945666.27026654 ns/iter |
18550174.105263595 ns/iter |
1.02 |
E2E_Compiler_cmake_presets |
26238247.851846676 ns/iter |
25960209.85185566 ns/iter |
1.01 |
E2E_Compiler_code_climate |
2664463.6717552925 ns/iter |
2617993.1992485016 ns/iter |
1.02 |
E2E_Compiler_cql2 |
13106533.0000003 ns/iter |
12979926.09259095 ns/iter |
1.01 |
E2E_Compiler_cspell |
23343270.00000182 ns/iter |
23094649.133334618 ns/iter |
1.01 |
E2E_Compiler_cypress |
4072733.0643272176 ns/iter |
4015663.454023441 ns/iter |
1.01 |
E2E_Compiler_deno |
8108247.6395342685 ns/iter |
7945691.602272249 ns/iter |
1.02 |
E2E_Compiler_dependabot |
4055766.1436781636 ns/iter |
3988465.517044853 ns/iter |
1.02 |
E2E_Compiler_draft_04 |
2797220.512000422 ns/iter |
2745294.176470541 ns/iter |
1.02 |
E2E_Compiler_fabric_mod |
4913353.014084235 ns/iter |
4826362.082758351 ns/iter |
1.02 |
E2E_Compiler_geojson |
22566285.290321827 ns/iter |
22179156.516131118 ns/iter |
1.02 |
E2E_Compiler_gitpod_configuration |
5088760.430657615 ns/iter |
4995771.928570645 ns/iter |
1.02 |
E2E_Compiler_helm_chart_lock |
737123.7888655398 ns/iter |
733711.8256409434 ns/iter |
1.00 |
E2E_Compiler_importmap |
297714.8507652964 ns/iter |
290916.1104192435 ns/iter |
1.02 |
E2E_Compiler_jasmine |
1412322.4626262235 ns/iter |
1386596.4840637883 ns/iter |
1.02 |
E2E_Compiler_jshintrc |
4570732.155844166 ns/iter |
4449032.09493624 ns/iter |
1.03 |
E2E_Compiler_jsconfig |
22292169.741934143 ns/iter |
22118376.51612592 ns/iter |
1.01 |
E2E_Compiler_krakend |
142073824.9999886 ns/iter |
145394916.39998233 ns/iter |
0.98 |
E2E_Compiler_lazygit |
34034142.047619835 ns/iter |
33837233.761904 ns/iter |
1.01 |
E2E_Compiler_lerna |
1665853.862232973 ns/iter |
1643767.6635513671 ns/iter |
1.01 |
E2E_Compiler_nest_cli |
7692045.318680567 ns/iter |
7585036.010870345 ns/iter |
1.01 |
E2E_Compiler_omc |
160747628.5000189 ns/iter |
161237366.7500151 ns/iter |
1.00 |
E2E_Compiler_omnisharp |
6969103.9900995325 ns/iter |
6900724.745097411 ns/iter |
1.01 |
E2E_Compiler_openapi |
25862739.518515807 ns/iter |
25389355.259263806 ns/iter |
1.02 |
E2E_Compiler_pre_commit_hooks |
5469776.117188019 ns/iter |
5368418.832060467 ns/iter |
1.02 |
E2E_Compiler_pulumi |
4182580.321428629 ns/iter |
4091507.7543862327 ns/iter |
1.02 |
E2E_Compiler_semantic_release |
1624078.4358973487 ns/iter |
1584871.7426638822 ns/iter |
1.02 |
E2E_Compiler_stale |
1620371.6420320044 ns/iter |
1585003.9636368572 ns/iter |
1.02 |
E2E_Compiler_stylecop |
6417264.146790297 ns/iter |
6255869.732143537 ns/iter |
1.03 |
E2E_Compiler_tmuxinator |
2001586.9885712944 ns/iter |
1957062.535014223 ns/iter |
1.02 |
E2E_Compiler_ui5 |
47386958.80000705 ns/iter |
47657342.26666609 ns/iter |
0.99 |
E2E_Compiler_ui5_manifest |
317533678.5000127 ns/iter |
324047117.50007206 ns/iter |
0.98 |
E2E_Compiler_unreal_engine_uproject |
4733993.148647642 ns/iter |
4667585.000000447 ns/iter |
1.01 |
E2E_Compiler_users_array |
811135.4245939341 ns/iter |
797530.0271865666 ns/iter |
1.02 |
E2E_Compiler_vercel |
12740529.27272516 ns/iter |
12538482.517856305 ns/iter |
1.02 |
E2E_Compiler_yamllint |
360603.56510552415 ns/iter |
351474.34571004496 ns/iter |
1.03 |
E2E_Evaluator_adaptivecard |
24800.069778992194 ns/iter |
24813.36443434194 ns/iter |
1.00 |
E2E_Evaluator_ansible_meta |
236107.93981945352 ns/iter |
231357.45211509953 ns/iter |
1.02 |
E2E_Evaluator_aws_cdk |
50401.934083354216 ns/iter |
50114.21697501582 ns/iter |
1.01 |
E2E_Evaluator_babelrc |
108416.9070586243 ns/iter |
108185.94338753956 ns/iter |
1.00 |
E2E_Evaluator_cerebrum_criminal_case |
981054.5539772746 ns/iter |
999641.1985714206 ns/iter |
0.98 |
E2E_Evaluator_clang_format |
116784.44862611905 ns/iter |
117472.36121798078 ns/iter |
0.99 |
E2E_Evaluator_cmake_presets |
4290357.018291849 ns/iter |
4399462.302469854 ns/iter |
0.98 |
E2E_Evaluator_code_climate |
178215.88647405035 ns/iter |
179412.79455253217 ns/iter |
0.99 |
E2E_Evaluator_cql2 |
212813.21356031427 ns/iter |
210048.01492095037 ns/iter |
1.01 |
E2E_Evaluator_cspell |
571595.9567699237 ns/iter |
581116.9780775423 ns/iter |
0.98 |
E2E_Evaluator_cypress |
190346.34707160012 ns/iter |
190918.2588943868 ns/iter |
1.00 |
E2E_Evaluator_deno |
318574.8887375052 ns/iter |
318685.7462414764 ns/iter |
1.00 |
E2E_Evaluator_dependabot |
328269.74304572406 ns/iter |
326520.71917488606 ns/iter |
1.01 |
E2E_Evaluator_draft_04 |
8671974.987655519 ns/iter |
9346495.438356288 ns/iter |
0.93 |
E2E_Evaluator_fabric_mod |
665811.9075308578 ns/iter |
674445.3734597486 ns/iter |
0.99 |
E2E_Evaluator_geojson |
19430444.257146258 ns/iter |
18625607.891887765 ns/iter |
1.04 |
E2E_Evaluator_gitpod_configuration |
239673.10335484604 ns/iter |
232812.36864830204 ns/iter |
1.03 |
E2E_Evaluator_helm_chart_lock |
314714.18533508707 ns/iter |
313877.25840709487 ns/iter |
1.00 |
E2E_Evaluator_importmap |
52935.8365120395 ns/iter |
47631.228705023066 ns/iter |
1.11 |
E2E_Evaluator_jasmine |
106155.44501354841 ns/iter |
108703.54949336626 ns/iter |
0.98 |
E2E_Evaluator_jshintrc |
1189550.1962458757 ns/iter |
1195238.1829060814 ns/iter |
1.00 |
E2E_Evaluator_jsconfig |
426691.79685604916 ns/iter |
424632.1020159432 ns/iter |
1.00 |
E2E_Evaluator_krakend |
213035.84432959923 ns/iter |
209301.76799046234 ns/iter |
1.02 |
E2E_Evaluator_lazygit |
148004.64237573606 ns/iter |
150397.4468624519 ns/iter |
0.98 |
E2E_Evaluator_lerna |
137396.05012481572 ns/iter |
136016.35202189325 ns/iter |
1.01 |
E2E_Evaluator_nest_cli |
185148.32237538238 ns/iter |
185285.95465267604 ns/iter |
1.00 |
E2E_Evaluator_omc |
19153.10078548645 ns/iter |
19236.762502376518 ns/iter |
1.00 |
E2E_Evaluator_omnisharp |
618850.394921187 ns/iter |
617625.80582524 ns/iter |
1.00 |
E2E_Evaluator_openapi |
9648210.375000114 ns/iter |
10387335.227271637 ns/iter |
0.93 |
E2E_Evaluator_pre_commit_hooks |
479946.50899023586 ns/iter |
480081.01379309664 ns/iter |
1.00 |
E2E_Evaluator_pulumi |
710853.9959553982 ns/iter |
713723.2028542102 ns/iter |
1.00 |
E2E_Evaluator_semantic_release |
98754.08118394164 ns/iter |
99351.15248680666 ns/iter |
0.99 |
E2E_Evaluator_stale |
157161.69083965733 ns/iter |
148162.21734499684 ns/iter |
1.06 |
E2E_Evaluator_stylecop |
289138.84035016 ns/iter |
291557.4759514595 ns/iter |
0.99 |
E2E_Evaluator_tmuxinator |
98351.37989779218 ns/iter |
98770.0304947964 ns/iter |
1.00 |
E2E_Evaluator_ui5 |
511827.4001461863 ns/iter |
511294.2106802936 ns/iter |
1.00 |
E2E_Evaluator_ui5_manifest |
2600826.456204477 ns/iter |
2531407.78623226 ns/iter |
1.03 |
E2E_Evaluator_unreal_engine_uproject |
433098.1298136399 ns/iter |
442593.40012607246 ns/iter |
0.98 |
E2E_Evaluator_users_array |
576681.8016460325 ns/iter |
576499.6382427362 ns/iter |
1.00 |
E2E_Evaluator_vercel |
315559.04450499744 ns/iter |
315446.4724977599 ns/iter |
1.00 |
E2E_Evaluator_yamllint |
8986.03081048325 ns/iter |
8769.279136618032 ns/iter |
1.02 |
Micro_Draft4_Meta_1_No_Callback |
198.32726748910179 ns/iter |
200.36951650213567 ns/iter |
0.99 |
Micro_Draft4_Required_Properties |
789.5521853530157 ns/iter |
795.4417110307533 ns/iter |
0.99 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
23.26920255689264 ns/iter |
24.39965665174677 ns/iter |
0.95 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
11.231357062437628 ns/iter |
11.24214763299193 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
279.18088196316256 ns/iter |
277.68537375156416 ns/iter |
1.01 |
Micro_Draft4_Nested_Object |
1.8064386226269635 ns/iter |
1.8180375151915036 ns/iter |
0.99 |
Micro_Draft4_Properties_Triad_Optional |
323.3033576732228 ns/iter |
333.9560999119249 ns/iter |
0.97 |
Micro_Draft4_Properties_Triad_Closed |
267.92275552408887 ns/iter |
275.5289000137087 ns/iter |
0.97 |
Micro_Draft4_Properties_Triad_Required |
339.9557708977503 ns/iter |
346.4754255918365 ns/iter |
0.98 |
Micro_Draft4_Properties_Closed |
57.50895026515204 ns/iter |
57.31356041722794 ns/iter |
1.00 |
Micro_Draft4_Non_Recursive_Ref |
11.917758726308945 ns/iter |
11.579947763016774 ns/iter |
1.03 |
Micro_Draft4_Pattern_Properties_True |
162.88713184288946 ns/iter |
162.88958488591967 ns/iter |
1.00 |
Micro_Draft4_Ref_To_Single_Property |
11.223914699686013 ns/iter |
11.243778807017693 ns/iter |
1.00 |
Micro_Draft4_Additional_Properties_Type |
21.710541767971055 ns/iter |
21.610470082511544 ns/iter |
1.00 |
Micro_Draft4_Nested_Oneof |
58.954426247804044 ns/iter |
59.01001137794425 ns/iter |
1.00 |
Micro_Draft4_Short_Enum |
9.96983380961296 ns/iter |
9.989663839469683 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
15.278404287530867 ns/iter |
15.298902078228334 ns/iter |
1.00 |
Micro_Draft4_Long_Enum_Short_Strings |
9.985589014631596 ns/iter |
9.99059104537379 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
3.737780794941991 ns/iter |
3.7436084280892796 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
2460846.6350879385 ns/iter |
2428678.996539429 ns/iter |
1.01 |
Micro_Draft4_Compile_Ref_Many_Nested |
1782488.2061067126 ns/iter |
1753450.9349997053 ns/iter |
1.02 |
Micro_Draft4_Compile_Wrap |
2427164.546713064 ns/iter |
2398593.438356298 ns/iter |
1.01 |
Micro_Draft6_Property_Names |
126.42580777956516 ns/iter |
131.4237601388401 ns/iter |
0.96 |
Micro_Draft6_Compile_FHIR |
14625475022.000046 ns/iter |
13657406110.000011 ns/iter |
1.07 |
Micro_Draft7_If_Then_Else |
24.282808577323888 ns/iter |
24.33039262656542 ns/iter |
1.00 |
Micro_2019_09_Unevaluated_Properties |
26.514604281334783 ns/iter |
26.58075485208296 ns/iter |
1.00 |
Micro_2019_09_Compile_Wrap |
299500431.4999505 ns/iter |
302739589.9999874 ns/iter |
0.99 |
Micro_2020_12_Dynamic_Ref |
232.5889681457184 ns/iter |
233.1414839391778 ns/iter |
1.00 |
Micro_2020_12_Dynamic_Ref_Single |
3.4266224061700625 ns/iter |
3.43471445611111 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
1090.2246418669624 ns/iter |
1089.7833067559277 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Annotations |
107432.19440666422 ns/iter |
102939.1234586589 ns/iter |
1.04 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1133372.5282716763 ns/iter |
1113770.8874800932 ns/iter |
1.02 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8079.273541770404 ns/iter |
8080.079225067616 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
178613.0260137441 ns/iter |
178525.3075215737 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
22432.01966615558 ns/iter |
22249.567211661062 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
142.35582800964897 ns/iter |
141.46934094710014 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4364.799299758829 ns/iter |
4265.401392893877 ns/iter |
1.02 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
372137445.49990225 ns/iter |
367259528.99996626 ns/iter |
1.01 |
Alterschema_Check_Readibility_OMC |
85716890.37498231 ns/iter |
84832692.74998406 ns/iter |
1.01 |
Alterschema_Check_Readibility_KrakenD |
1220457001.0001135 ns/iter |
1184636038.9999971 ns/iter |
1.03 |
Alterschema_Apply_Readibility_KrakenD |
118379264866.99985 ns/iter |
119716123171.00017 ns/iter |
0.99 |
Alterschema_Check_Invalid_External_Refs |
305329532.49996805 ns/iter |
311468155.50005156 ns/iter |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/llvm)
Details
| Benchmark suite | Current: d648028 | Previous: 77c1d98 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
120080 ns |
120071 ns |
1.00 |
E2E_Evaluator_ansible-meta |
534689 ns |
516356 ns |
1.04 |
E2E_Evaluator_aws-cdk |
143278 ns |
144391 ns |
0.99 |
E2E_Evaluator_babelrc |
331525 ns |
323343 ns |
1.03 |
E2E_Evaluator_cerebrum-criminal-case |
2493313 ns |
2493888 ns |
1.00 |
E2E_Evaluator_clang-format |
268424 ns |
258672 ns |
1.04 |
E2E_Evaluator_cmake-presets |
17477593 ns |
18100959 ns |
0.97 |
E2E_Evaluator_code-climate |
502401 ns |
504312 ns |
1.00 |
E2E_Evaluator_cql2 |
1229458 ns |
1204758 ns |
1.02 |
E2E_Evaluator_cspell |
1471012 ns |
1520374 ns |
0.97 |
E2E_Evaluator_cypress |
777185 ns |
764749 ns |
1.02 |
E2E_Evaluator_deno |
1050649 ns |
1040728 ns |
1.01 |
E2E_Evaluator_dependabot |
1075841 ns |
1081924 ns |
0.99 |
E2E_Evaluator_draft-04 |
20045428 ns |
22623914 ns |
0.89 |
E2E_Evaluator_fabric-mod |
2291038 ns |
2294966 ns |
1.00 |
E2E_Evaluator_geojson |
24457489 ns |
23865586 ns |
1.02 |
E2E_Evaluator_gitpod-configuration |
712829 ns |
720821 ns |
0.99 |
E2E_Evaluator_helm-chart-lock |
1005246 ns |
991314 ns |
1.01 |
E2E_Evaluator_importmap |
267885 ns |
266072 ns |
1.01 |
E2E_Evaluator_jasmine |
299223 ns |
295044 ns |
1.01 |
E2E_Evaluator_jsconfig |
1273528 ns |
1230055 ns |
1.04 |
E2E_Evaluator_jshintrc |
2770695 ns |
2749958 ns |
1.01 |
E2E_Evaluator_krakend |
683032 ns |
680898 ns |
1.00 |
E2E_Evaluator_lazygit |
516557 ns |
516494 ns |
1.00 |
E2E_Evaluator_lerna |
477227 ns |
466471 ns |
1.02 |
E2E_Evaluator_nest-cli |
588583 ns |
594294 ns |
0.99 |
E2E_Evaluator_omc |
94907 ns |
92865 ns |
1.02 |
E2E_Evaluator_omnisharp |
1421899 ns |
1422289 ns |
1.00 |
E2E_Evaluator_openapi |
23256466 ns |
25332236 ns |
0.92 |
E2E_Evaluator_pre-commit-hooks |
2011534 ns |
2026751 ns |
0.99 |
E2E_Evaluator_pulumi |
1871835 ns |
1896564 ns |
0.99 |
E2E_Evaluator_semantic-release |
248947 ns |
260510 ns |
0.96 |
E2E_Evaluator_stale |
393358 ns |
394455 ns |
1.00 |
E2E_Evaluator_stylecop |
1211444 ns |
1206925 ns |
1.00 |
E2E_Evaluator_tmuxinator |
231475 ns |
230556 ns |
1.00 |
E2E_Evaluator_ui5 |
2226289 ns |
2206826 ns |
1.01 |
E2E_Evaluator_ui5-manifest |
10629851 ns |
11648055 ns |
0.91 |
E2E_Evaluator_unreal-engine-uproject |
1507660 ns |
1485837 ns |
1.01 |
E2E_Evaluator_users-array |
2431838 ns |
2743978 ns |
0.89 |
E2E_Evaluator_vercel |
989884 ns |
1020263 ns |
0.97 |
E2E_Evaluator_yamllint |
26135 ns |
25660 ns |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: d648028 | Previous: 77c1d98 | Ratio |
|---|---|---|---|
Schema_Iterator_ISO_Language |
3437669.1693985956 ns/iter |
2931061.1625618185 ns/iter |
1.17 |
Schema_Tracker_ISO_Language |
8137584.528572006 ns/iter |
8708286.899997933 ns/iter |
0.93 |
Schema_Tracker_ISO_Language_To_JSON |
19366281.51351387 ns/iter |
19405047.794119876 ns/iter |
1.00 |
Schema_Frame_WoT_References |
6272410.4752467815 ns/iter |
7581398.806123894 ns/iter |
0.83 |
Schema_Frame_OMC_References |
36310456.24999843 ns/iter |
31632063.578938056 ns/iter |
1.15 |
Schema_Frame_OMC_Locations |
30661043.590912 ns/iter |
37504841.68000185 ns/iter |
0.82 |
Schema_Frame_ISO_Language_Locations |
98005904.71429262 ns/iter |
118823784.66665007 ns/iter |
0.82 |
Schema_Frame_KrakenD_References |
73423583.33332616 ns/iter |
80969250.00000966 ns/iter |
0.91 |
Schema_Frame_KrakenD_Reachable |
765748123.999856 ns/iter |
707363917.000066 ns/iter |
1.08 |
Schema_Frame_ISO_Language_Locations_To_JSON |
130492781.24998409 ns/iter |
135249465.33334514 ns/iter |
0.96 |
Schema_Frame_Many_Resources_References |
520936978.9999983 ns/iter |
467269895.99994797 ns/iter |
1.11 |
Schema_Bundle_Meta_2020_12 |
1836484.8985506115 ns/iter |
1972417.041891738 ns/iter |
0.93 |
Schema_Format_ISO_Language_To_JSON |
105219630.99992199 ns/iter |
111126611.33332343 ns/iter |
0.95 |
E2E_Compiler_adaptivecard |
81606579.54545058 ns/iter |
90868453.7777794 ns/iter |
0.90 |
E2E_Compiler_ansible_meta |
33212008.70833726 ns/iter |
40602383.3499944 ns/iter |
0.82 |
E2E_Compiler_aws_cdk |
385012.6839167495 ns/iter |
442108.35962139204 ns/iter |
0.87 |
E2E_Compiler_babelrc |
2932040.585185152 ns/iter |
3170314.315353321 ns/iter |
0.92 |
E2E_Compiler_clang_format |
20344117.647054564 ns/iter |
24791692.888895877 ns/iter |
0.82 |
E2E_Compiler_cmake_presets |
38353091.700003006 ns/iter |
43841778.846154526 ns/iter |
0.87 |
E2E_Compiler_code_climate |
3154804.764192518 ns/iter |
2889237.29596367 ns/iter |
1.09 |
E2E_Compiler_cql2 |
17268417.627905745 ns/iter |
20674457.555556998 ns/iter |
0.84 |
E2E_Compiler_cspell |
27589741.935483493 ns/iter |
32306212.736844633 ns/iter |
0.85 |
E2E_Compiler_cypress |
5742608.751772603 ns/iter |
5232876.503597129 ns/iter |
1.10 |
E2E_Compiler_deno |
8326761.986300843 ns/iter |
9255169.034089891 ns/iter |
0.90 |
E2E_Compiler_dependabot |
4892936.17021326 ns/iter |
5693526.465408737 ns/iter |
0.86 |
E2E_Compiler_draft_04 |
2723397.01626048 ns/iter |
3121362.167999905 ns/iter |
0.87 |
E2E_Compiler_fabric_mod |
4943492.499999896 ns/iter |
5418950.839998615 ns/iter |
0.91 |
E2E_Compiler_geojson |
29466218.750002325 ns/iter |
35767970.2380903 ns/iter |
0.82 |
E2E_Compiler_gitpod_configuration |
5955771.653544423 ns/iter |
6311903.329999495 ns/iter |
0.94 |
E2E_Compiler_helm_chart_lock |
796015.7937171428 ns/iter |
749010.0354190578 ns/iter |
1.06 |
E2E_Compiler_importmap |
263648.5951009077 ns/iter |
293101.9837954828 ns/iter |
0.90 |
E2E_Compiler_jasmine |
1395468.3650486579 ns/iter |
1794298.9977725984 ns/iter |
0.78 |
E2E_Compiler_jshintrc |
4264333.329479481 ns/iter |
4653168.931971944 ns/iter |
0.92 |
E2E_Compiler_jsconfig |
22790331.89655632 ns/iter |
28403818.92307365 ns/iter |
0.80 |
E2E_Compiler_krakend |
158240316.59999493 ns/iter |
190256008.19995815 ns/iter |
0.83 |
E2E_Compiler_lazygit |
46333609.63158625 ns/iter |
46185046.874995805 ns/iter |
1.00 |
E2E_Compiler_lerna |
1744760.0896859856 ns/iter |
1935674.0734598797 ns/iter |
0.90 |
E2E_Compiler_nest_cli |
8184376.899998824 ns/iter |
8369308.259259637 ns/iter |
0.98 |
E2E_Compiler_omc |
217217156.25000116 ns/iter |
214681972.33328584 ns/iter |
1.01 |
E2E_Compiler_omnisharp |
7659990.8596491385 ns/iter |
9035412.844036937 ns/iter |
0.85 |
E2E_Compiler_openapi |
32517061.680000555 ns/iter |
32961464.947376095 ns/iter |
0.99 |
E2E_Compiler_pre_commit_hooks |
5963739.473683841 ns/iter |
5938153.048077766 ns/iter |
1.00 |
E2E_Compiler_pulumi |
4373785.927535446 ns/iter |
4487648.628047815 ns/iter |
0.97 |
E2E_Compiler_semantic_release |
1629718.0572082882 ns/iter |
1938590.748623946 ns/iter |
0.84 |
E2E_Compiler_stale |
1669905.366525373 ns/iter |
1917042.7986423152 ns/iter |
0.87 |
E2E_Compiler_stylecop |
7269858.709090923 ns/iter |
7711617.743118891 ns/iter |
0.94 |
E2E_Compiler_tmuxinator |
2364786.4932889743 ns/iter |
1988214.272264613 ns/iter |
1.19 |
E2E_Compiler_ui5 |
87380120.33333892 ns/iter |
68789416.63636728 ns/iter |
1.27 |
E2E_Compiler_ui5_manifest |
524955062.49999833 ns/iter |
458217604.50007784 ns/iter |
1.15 |
E2E_Compiler_unreal_engine_uproject |
5812400.921261034 ns/iter |
5309350.4200001005 ns/iter |
1.09 |
E2E_Compiler_users_array |
1178174.4047618578 ns/iter |
1136490.4595017475 ns/iter |
1.04 |
E2E_Compiler_vercel |
20691699.79487621 ns/iter |
16246394.230766106 ns/iter |
1.27 |
E2E_Compiler_yamllint |
378831.53464811825 ns/iter |
338131.88659343607 ns/iter |
1.12 |
E2E_Evaluator_adaptivecard |
28025.02333399812 ns/iter |
25188.353016926383 ns/iter |
1.11 |
E2E_Evaluator_ansible_meta |
204109.0421940962 ns/iter |
252179.1729041914 ns/iter |
0.81 |
E2E_Evaluator_aws_cdk |
40719.07952871076 ns/iter |
47020.292670750685 ns/iter |
0.87 |
E2E_Evaluator_babelrc |
91428.67634963174 ns/iter |
112122.60200722558 ns/iter |
0.82 |
E2E_Evaluator_cerebrum_criminal_case |
791985.6450868103 ns/iter |
1050893.943583894 ns/iter |
0.75 |
E2E_Evaluator_clang_format |
120958.78717149953 ns/iter |
119668.7086296243 ns/iter |
1.01 |
E2E_Evaluator_cmake_presets |
5210787.903613519 ns/iter |
4904291.388157845 ns/iter |
1.06 |
E2E_Evaluator_code_climate |
226864.56363065488 ns/iter |
198662.10351201575 ns/iter |
1.14 |
E2E_Evaluator_cql2 |
207557.94457906496 ns/iter |
200423.51433435138 ns/iter |
1.04 |
E2E_Evaluator_cspell |
607478.3996316233 ns/iter |
480190.78094624216 ns/iter |
1.27 |
E2E_Evaluator_cypress |
212444.07792613044 ns/iter |
192314.93251205914 ns/iter |
1.10 |
E2E_Evaluator_deno |
311072.9061584226 ns/iter |
296459.9753140048 ns/iter |
1.05 |
E2E_Evaluator_dependabot |
328528.96171377687 ns/iter |
305099.3479916156 ns/iter |
1.08 |
E2E_Evaluator_draft_04 |
7942153.89333355 ns/iter |
6606312.318583343 ns/iter |
1.20 |
E2E_Evaluator_fabric_mod |
669066.6736672609 ns/iter |
646810.0787461948 ns/iter |
1.03 |
E2E_Evaluator_geojson |
13759489.576920293 ns/iter |
15265677.274511272 ns/iter |
0.90 |
E2E_Evaluator_gitpod_configuration |
207673.3096105299 ns/iter |
249708.6353944555 ns/iter |
0.83 |
E2E_Evaluator_helm_chart_lock |
293239.34588708787 ns/iter |
264661.3847396014 ns/iter |
1.11 |
E2E_Evaluator_importmap |
40514.01546533506 ns/iter |
39231.39596876489 ns/iter |
1.03 |
E2E_Evaluator_jasmine |
101563.34141174883 ns/iter |
113629.48086590812 ns/iter |
0.89 |
E2E_Evaluator_jshintrc |
1155853.8170389286 ns/iter |
1339382.131531697 ns/iter |
0.86 |
E2E_Evaluator_jsconfig |
429123.1488749008 ns/iter |
420808.5689858741 ns/iter |
1.02 |
E2E_Evaluator_krakend |
194097.22585590923 ns/iter |
231463.41401105872 ns/iter |
0.84 |
E2E_Evaluator_lazygit |
119770.84461793001 ns/iter |
167677.4020246041 ns/iter |
0.71 |
E2E_Evaluator_lerna |
161365.4645855744 ns/iter |
157258.42146091 ns/iter |
1.03 |
E2E_Evaluator_nest_cli |
187451.38578452254 ns/iter |
283892.85191683593 ns/iter |
0.66 |
E2E_Evaluator_omc |
18645.346653646026 ns/iter |
22934.76257735156 ns/iter |
0.81 |
E2E_Evaluator_omnisharp |
603056.2079999981 ns/iter |
839726.1045986771 ns/iter |
0.72 |
E2E_Evaluator_openapi |
9363302.941175574 ns/iter |
9240941.455696952 ns/iter |
1.01 |
E2E_Evaluator_pre_commit_hooks |
461235.8698078287 ns/iter |
522405.5113789001 ns/iter |
0.88 |
E2E_Evaluator_pulumi |
677400.2679938022 ns/iter |
722176.3768306961 ns/iter |
0.94 |
E2E_Evaluator_semantic_release |
93587.59769662815 ns/iter |
95140.39303966376 ns/iter |
0.98 |
E2E_Evaluator_stale |
143547.18276513612 ns/iter |
163792.04127505052 ns/iter |
0.88 |
E2E_Evaluator_stylecop |
262984.39516973135 ns/iter |
266617.9829258406 ns/iter |
0.99 |
E2E_Evaluator_tmuxinator |
92105.06514701033 ns/iter |
91986.7622608124 ns/iter |
1.00 |
E2E_Evaluator_ui5 |
504586.19528610434 ns/iter |
534314.8798219543 ns/iter |
0.94 |
E2E_Evaluator_ui5_manifest |
2569807.8909662515 ns/iter |
3385735.132159293 ns/iter |
0.76 |
E2E_Evaluator_unreal_engine_uproject |
400172.6332945129 ns/iter |
428734.6954629172 ns/iter |
0.93 |
E2E_Evaluator_users_array |
602662.9060772283 ns/iter |
681615.5764967441 ns/iter |
0.88 |
E2E_Evaluator_vercel |
290813.21508384513 ns/iter |
308851.6978923359 ns/iter |
0.94 |
E2E_Evaluator_yamllint |
7790.389572410733 ns/iter |
8676.529058230359 ns/iter |
0.90 |
Micro_Draft4_Meta_1_No_Callback |
175.4114460326315 ns/iter |
223.967338707485 ns/iter |
0.78 |
Micro_Draft4_Required_Properties |
792.4959904420332 ns/iter |
875.6216220936334 ns/iter |
0.91 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
24.256122599583076 ns/iter |
25.168829329973363 ns/iter |
0.96 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
9.460464528455311 ns/iter |
10.123101328467563 ns/iter |
0.93 |
Micro_Draft4_Items_Schema |
339.01122450757146 ns/iter |
323.84100247616465 ns/iter |
1.05 |
Micro_Draft4_Nested_Object |
0.8381751895519685 ns/iter |
0.8264091345341151 ns/iter |
1.01 |
Micro_Draft4_Properties_Triad_Optional |
273.11685068592453 ns/iter |
284.0729835540778 ns/iter |
0.96 |
Micro_Draft4_Properties_Triad_Closed |
214.588156643182 ns/iter |
257.2225192433861 ns/iter |
0.83 |
Micro_Draft4_Properties_Triad_Required |
272.2020024202861 ns/iter |
293.80800991437064 ns/iter |
0.93 |
Micro_Draft4_Properties_Closed |
51.58257358612174 ns/iter |
54.795992336415324 ns/iter |
0.94 |
Micro_Draft4_Non_Recursive_Ref |
12.54014527088764 ns/iter |
13.591921895587035 ns/iter |
0.92 |
Micro_Draft4_Pattern_Properties_True |
183.08191070215642 ns/iter |
199.1971715011637 ns/iter |
0.92 |
Micro_Draft4_Ref_To_Single_Property |
9.511621840886322 ns/iter |
9.80683075327466 ns/iter |
0.97 |
Micro_Draft4_Additional_Properties_Type |
24.319119989050694 ns/iter |
26.374465037524605 ns/iter |
0.92 |
Micro_Draft4_Nested_Oneof |
52.741386242180575 ns/iter |
54.42705862766402 ns/iter |
0.97 |
Micro_Draft4_Short_Enum |
6.372055971843358 ns/iter |
6.692448686993363 ns/iter |
0.95 |
Micro_Draft4_Long_Enum |
12.717888241129076 ns/iter |
13.876443501215244 ns/iter |
0.92 |
Micro_Draft4_Long_Enum_Short_Strings |
8.558513155604144 ns/iter |
9.083818262583476 ns/iter |
0.94 |
Micro_Draft4_Type_Object |
2.9840993648114322 ns/iter |
3.145953611216652 ns/iter |
0.95 |
Micro_Draft4_Ref_Single_100 |
2408244.776119888 ns/iter |
2291013.130303382 ns/iter |
1.05 |
Micro_Draft4_Compile_Ref_Many_Nested |
1713098.0941702533 ns/iter |
2081751.9239127182 ns/iter |
0.82 |
Micro_Draft4_Compile_Wrap |
2669990.0081300763 ns/iter |
3376199.9270385075 ns/iter |
0.79 |
Micro_Draft6_Property_Names |
127.2171334594045 ns/iter |
144.55065247994318 ns/iter |
0.88 |
Micro_Draft6_Compile_FHIR |
18026264875.000153 ns/iter |
20652250999.999977 ns/iter |
0.87 |
Micro_Draft7_If_Then_Else |
27.2848770115622 ns/iter |
26.746764726096217 ns/iter |
1.02 |
Micro_2019_09_Unevaluated_Properties |
41.98592151827653 ns/iter |
32.49987567331832 ns/iter |
1.29 |
Micro_2019_09_Compile_Wrap |
476366583.49995285 ns/iter |
441566250.0000508 ns/iter |
1.08 |
Micro_2020_12_Dynamic_Ref |
270.8623768901439 ns/iter |
264.71642623908247 ns/iter |
1.02 |
Micro_2020_12_Dynamic_Ref_Single |
3.1481830447779715 ns/iter |
3.113170846815465 ns/iter |
1.01 |
Micro_2020_12_Simple_Output_Mask |
1038.3498514870632 ns/iter |
1010.1171922996797 ns/iter |
1.03 |
Micro_2020_12_Simple_Output_Annotations |
114798.53234570342 ns/iter |
118595.51528247613 ns/iter |
0.97 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1159833.1634875115 ns/iter |
1262557.0455284328 ns/iter |
0.92 |
Micro_2020_12_Exhaustive_Deep_Numeric |
7225.4395231252 ns/iter |
6896.196234257672 ns/iter |
1.05 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
145684.27810984093 ns/iter |
158647.3332653751 ns/iter |
0.92 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
18153.28377913946 ns/iter |
19191.74511915519 ns/iter |
0.95 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
115.2756714173816 ns/iter |
123.65424922011294 ns/iter |
0.93 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
6260.869472788616 ns/iter |
7971.933256832619 ns/iter |
0.79 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
345597541.4999557 ns/iter |
367235832.9999952 ns/iter |
0.94 |
Alterschema_Check_Readibility_OMC |
86708906.25000994 ns/iter |
104833048.66666763 ns/iter |
0.83 |
Alterschema_Check_Readibility_KrakenD |
1039380040.9999585 ns/iter |
1253815167.0000844 ns/iter |
0.83 |
Alterschema_Apply_Readibility_KrakenD |
109215862374.99991 ns/iter |
119550958833.00009 ns/iter |
0.91 |
Alterschema_Check_Invalid_External_Refs |
251864333.3333633 ns/iter |
266304916.6666648 ns/iter |
0.95 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (macos/llvm)
Details
| Benchmark suite | Current: d648028 | Previous: 77c1d98 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
158122 ns |
158744 ns |
1.00 |
E2E_Evaluator_ansible-meta |
498400 ns |
536835 ns |
0.93 |
E2E_Evaluator_aws-cdk |
144037 ns |
139511 ns |
1.03 |
E2E_Evaluator_babelrc |
332574 ns |
351382 ns |
0.95 |
E2E_Evaluator_cerebrum-criminal-case |
2188652 ns |
2500393 ns |
0.88 |
E2E_Evaluator_clang-format |
283702 ns |
281274 ns |
1.01 |
E2E_Evaluator_cmake-presets |
16552781 ns |
18164336 ns |
0.91 |
E2E_Evaluator_code-climate |
497838 ns |
562258 ns |
0.89 |
E2E_Evaluator_cql2 |
1375863 ns |
1457780 ns |
0.94 |
E2E_Evaluator_cspell |
1756575 ns |
1654666 ns |
1.06 |
E2E_Evaluator_cypress |
943161 ns |
891530 ns |
1.06 |
E2E_Evaluator_deno |
1265333 ns |
1204987 ns |
1.05 |
E2E_Evaluator_dependabot |
1216916 ns |
1062927 ns |
1.14 |
E2E_Evaluator_draft-04 |
23652584 ns |
28781108 ns |
0.82 |
E2E_Evaluator_fabric-mod |
2178832 ns |
2586578 ns |
0.84 |
E2E_Evaluator_geojson |
26575980 ns |
27161770 ns |
0.98 |
E2E_Evaluator_gitpod-configuration |
1022052 ns |
790167 ns |
1.29 |
E2E_Evaluator_helm-chart-lock |
1296882 ns |
1171884 ns |
1.11 |
E2E_Evaluator_importmap |
471789 ns |
304264 ns |
1.55 |
E2E_Evaluator_jasmine |
378892 ns |
288982 ns |
1.31 |
E2E_Evaluator_jsconfig |
1589025 ns |
1546377 ns |
1.03 |
E2E_Evaluator_jshintrc |
3395292 ns |
2889412 ns |
1.18 |
E2E_Evaluator_krakend |
747971 ns |
784546 ns |
0.95 |
E2E_Evaluator_lazygit |
442410 ns |
598137 ns |
0.74 |
E2E_Evaluator_lerna |
539723 ns |
534863 ns |
1.01 |
E2E_Evaluator_nest-cli |
722019 ns |
651614 ns |
1.11 |
E2E_Evaluator_omc |
116285 ns |
114127 ns |
1.02 |
E2E_Evaluator_omnisharp |
1766812 ns |
1699146 ns |
1.04 |
E2E_Evaluator_openapi |
23988281 ns |
23311318 ns |
1.03 |
E2E_Evaluator_pre-commit-hooks |
2071090 ns |
2631946 ns |
0.79 |
E2E_Evaluator_pulumi |
2238814 ns |
2286265 ns |
0.98 |
E2E_Evaluator_semantic-release |
282567 ns |
263407 ns |
1.07 |
E2E_Evaluator_stale |
425422 ns |
429027 ns |
0.99 |
E2E_Evaluator_stylecop |
1141947 ns |
1662341 ns |
0.69 |
E2E_Evaluator_tmuxinator |
246205 ns |
267119 ns |
0.92 |
E2E_Evaluator_ui5 |
2594346 ns |
2851619 ns |
0.91 |
E2E_Evaluator_ui5-manifest |
13366438 ns |
18088449 ns |
0.74 |
E2E_Evaluator_unreal-engine-uproject |
2150921 ns |
2277089 ns |
0.94 |
E2E_Evaluator_users-array |
3794682 ns |
4281911 ns |
0.89 |
E2E_Evaluator_vercel |
1317641 ns |
1274237 ns |
1.03 |
E2E_Evaluator_yamllint |
35637 ns |
34856 ns |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: d648028 | Previous: 77c1d98 | Ratio |
|---|---|---|---|
Alterschema_Check_Readibility_ISO_Language_Set_3 |
376480235.00003093 ns/iter |
379953091.4999423 ns/iter |
0.99 |
Alterschema_Check_Readibility_OMC |
104279684.857147 ns/iter |
95358339.57141091 ns/iter |
1.09 |
Alterschema_Check_Readibility_KrakenD |
1479250264.0000293 ns/iter |
1320208308.0000193 ns/iter |
1.12 |
Alterschema_Apply_Readibility_KrakenD |
149644385306.00024 ns/iter |
124102594506.99982 ns/iter |
1.21 |
Alterschema_Check_Invalid_External_Refs |
306400443.50002426 ns/iter |
320652294.00006956 ns/iter |
0.96 |
Micro_2020_12_Dynamic_Ref |
260.6731453110963 ns/iter |
268.3603003169527 ns/iter |
0.97 |
Micro_2020_12_Dynamic_Ref_Single |
4.57483044746304 ns/iter |
4.377769694819844 ns/iter |
1.05 |
Micro_2020_12_Simple_Output_Mask |
1118.5781862917472 ns/iter |
1155.6062862387028 ns/iter |
0.97 |
Micro_2020_12_Simple_Output_Annotations |
104428.22956022197 ns/iter |
115403.87324872529 ns/iter |
0.90 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1260240.8971122135 ns/iter |
1261956.0647481228 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8635.351255930529 ns/iter |
9200.04328476255 ns/iter |
0.94 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
166164.72132698412 ns/iter |
166844.91097499718 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
26501.816240458786 ns/iter |
25178.892131839413 ns/iter |
1.05 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
153.6077597063327 ns/iter |
154.3837842920706 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4679.128320564119 ns/iter |
4806.330697113348 ns/iter |
0.97 |
Micro_2019_09_Unevaluated_Properties |
28.505502144748405 ns/iter |
28.418396381207767 ns/iter |
1.00 |
Micro_2019_09_Compile_Wrap |
361004478.00004077 ns/iter |
342378159.4999582 ns/iter |
1.05 |
Micro_Draft7_If_Then_Else |
25.00295453671544 ns/iter |
24.089152789919737 ns/iter |
1.04 |
Micro_Draft6_Property_Names |
146.651269550042 ns/iter |
149.95537696104205 ns/iter |
0.98 |
Micro_Draft6_Compile_FHIR |
15381279627.999903 ns/iter |
13358876319.000046 ns/iter |
1.15 |
Micro_Draft4_Meta_1_No_Callback |
175.97787855393432 ns/iter |
189.11393613710842 ns/iter |
0.93 |
Micro_Draft4_Required_Properties |
831.1163824950786 ns/iter |
822.8315173617484 ns/iter |
1.01 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
20.959762270678965 ns/iter |
21.2305577062694 ns/iter |
0.99 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
12.677183635881889 ns/iter |
13.423095539565374 ns/iter |
0.94 |
Micro_Draft4_Items_Schema |
293.6248891601728 ns/iter |
334.79280356667755 ns/iter |
0.88 |
Micro_Draft4_Nested_Object |
2.111486539537312 ns/iter |
2.1974275596296753 ns/iter |
0.96 |
Micro_Draft4_Properties_Triad_Optional |
408.447081438881 ns/iter |
449.37506957427115 ns/iter |
0.91 |
Micro_Draft4_Properties_Triad_Closed |
352.03410370992214 ns/iter |
365.38107849282403 ns/iter |
0.96 |
Micro_Draft4_Properties_Triad_Required |
451.47881318732755 ns/iter |
453.5603715724484 ns/iter |
1.00 |
Micro_Draft4_Properties_Closed |
62.07003152541154 ns/iter |
62.417389424250665 ns/iter |
0.99 |
Micro_Draft4_Non_Recursive_Ref |
9.154236377203457 ns/iter |
9.041573307082224 ns/iter |
1.01 |
Micro_Draft4_Pattern_Properties_True |
190.72318799712477 ns/iter |
196.07554748054184 ns/iter |
0.97 |
Micro_Draft4_Ref_To_Single_Property |
13.167203775245293 ns/iter |
13.415317029817432 ns/iter |
0.98 |
Micro_Draft4_Additional_Properties_Type |
13.778814700759364 ns/iter |
14.645291637931612 ns/iter |
0.94 |
Micro_Draft4_Nested_Oneof |
63.36386281956513 ns/iter |
66.07622008365117 ns/iter |
0.96 |
Micro_Draft4_Short_Enum |
14.529229025382474 ns/iter |
14.70402277204904 ns/iter |
0.99 |
Micro_Draft4_Long_Enum |
13.703492144305038 ns/iter |
14.689851249600508 ns/iter |
0.93 |
Micro_Draft4_Long_Enum_Short_Strings |
14.500996478993677 ns/iter |
14.740069140037605 ns/iter |
0.98 |
Micro_Draft4_Type_Object |
4.578884461932347 ns/iter |
4.671436490858719 ns/iter |
0.98 |
Micro_Draft4_Ref_Single_100 |
2580826.6088563455 ns/iter |
2604260.0149251604 ns/iter |
0.99 |
Micro_Draft4_Compile_Ref_Many_Nested |
1899271.4043710928 ns/iter |
1873938.354838516 ns/iter |
1.01 |
Micro_Draft4_Compile_Wrap |
2686317.908046302 ns/iter |
2686560.2022902374 ns/iter |
1.00 |
E2E_Compiler_adaptivecard |
68867443.50001663 ns/iter |
68066015.90001264 ns/iter |
1.01 |
E2E_Compiler_ansible_meta |
33268465.90476591 ns/iter |
32185731.727271225 ns/iter |
1.03 |
E2E_Compiler_aws_cdk |
430652.7973219494 ns/iter |
441219.0272325358 ns/iter |
0.98 |
E2E_Compiler_babelrc |
2932637.1508626253 ns/iter |
2885555.5679020267 ns/iter |
1.02 |
E2E_Compiler_clang_format |
20679606.558821756 ns/iter |
20306083.55882096 ns/iter |
1.02 |
E2E_Compiler_cmake_presets |
28625581.374996047 ns/iter |
28138893.440000176 ns/iter |
1.02 |
E2E_Compiler_code_climate |
2983836.656779905 ns/iter |
2912656.5958335963 ns/iter |
1.02 |
E2E_Compiler_cql2 |
14567707.958330326 ns/iter |
14799726.125000728 ns/iter |
0.98 |
E2E_Compiler_cspell |
25405117.321432564 ns/iter |
24586545.964284923 ns/iter |
1.03 |
E2E_Compiler_cypress |
4503170.031249226 ns/iter |
4325669.969135662 ns/iter |
1.04 |
E2E_Compiler_deno |
8972347.52563947 ns/iter |
8761901.46249769 ns/iter |
1.02 |
E2E_Compiler_dependabot |
4454989.660256358 ns/iter |
4413633.962025116 ns/iter |
1.01 |
E2E_Compiler_draft_04 |
3097433.615044366 ns/iter |
3081598.1858410924 ns/iter |
1.01 |
E2E_Compiler_fabric_mod |
5431115.125001421 ns/iter |
5321297.49242496 ns/iter |
1.02 |
E2E_Compiler_geojson |
25475839.53571575 ns/iter |
25125779.78571276 ns/iter |
1.01 |
E2E_Compiler_gitpod_configuration |
5590755.968255291 ns/iter |
5482074.8593762405 ns/iter |
1.02 |
E2E_Compiler_helm_chart_lock |
771441.3947368576 ns/iter |
784513.4831839382 ns/iter |
0.98 |
E2E_Compiler_importmap |
318277.010426133 ns/iter |
331474.96468924783 ns/iter |
0.96 |
E2E_Compiler_jasmine |
1542923.8810571355 ns/iter |
1543745.0619470128 ns/iter |
1.00 |
E2E_Compiler_jshintrc |
4877321.895105683 ns/iter |
4817299.883560648 ns/iter |
1.01 |
E2E_Compiler_jsconfig |
24370880.13793355 ns/iter |
23723315.899997033 ns/iter |
1.03 |
E2E_Compiler_krakend |
148607006.1999726 ns/iter |
153040597.39996773 ns/iter |
0.97 |
E2E_Compiler_lazygit |
37794854.42105637 ns/iter |
36512111.210521124 ns/iter |
1.04 |
E2E_Compiler_lerna |
1826791.40519496 ns/iter |
1820731.2467527483 ns/iter |
1.00 |
E2E_Compiler_nest_cli |
8803279.385541696 ns/iter |
8295450.178571801 ns/iter |
1.06 |
E2E_Compiler_omc |
195080162.66665134 ns/iter |
183403769.49998927 ns/iter |
1.06 |
E2E_Compiler_omnisharp |
7719318.538460316 ns/iter |
7540934.516127499 ns/iter |
1.02 |
E2E_Compiler_openapi |
29131904.458334174 ns/iter |
28596662.40000479 ns/iter |
1.02 |
E2E_Compiler_pre_commit_hooks |
6020598.94782621 ns/iter |
5859895.300000061 ns/iter |
1.03 |
E2E_Compiler_pulumi |
4639781.256578974 ns/iter |
4525626.701299141 ns/iter |
1.03 |
E2E_Compiler_semantic_release |
1796186.7994861694 ns/iter |
1784968.3883248523 ns/iter |
1.01 |
E2E_Compiler_stale |
1780519.5883838541 ns/iter |
1744350.542500115 ns/iter |
1.02 |
E2E_Compiler_stylecop |
7048053.909090753 ns/iter |
6817444.98039208 ns/iter |
1.03 |
E2E_Compiler_tmuxinator |
2208073.2767292676 ns/iter |
2199007.98432587 ns/iter |
1.00 |
E2E_Compiler_ui5 |
52554189.38461913 ns/iter |
51389964.538464904 ns/iter |
1.02 |
E2E_Compiler_ui5_manifest |
356275988.4999878 ns/iter |
351275998.00000554 ns/iter |
1.01 |
E2E_Compiler_unreal_engine_uproject |
5239789.466666615 ns/iter |
5121713.2408765815 ns/iter |
1.02 |
E2E_Compiler_users_array |
915481.8391699783 ns/iter |
916583.4023592754 ns/iter |
1.00 |
E2E_Compiler_vercel |
13732423.599999493 ns/iter |
13481124.865384467 ns/iter |
1.02 |
E2E_Compiler_yamllint |
392194.52987152734 ns/iter |
403655.03464212094 ns/iter |
0.97 |
E2E_Evaluator_adaptivecard |
23286.954786433205 ns/iter |
23172.211712014938 ns/iter |
1.00 |
E2E_Evaluator_ansible_meta |
240637.49587625838 ns/iter |
263151.1908885034 ns/iter |
0.91 |
E2E_Evaluator_aws_cdk |
47601.731907897294 ns/iter |
56026.57661163166 ns/iter |
0.85 |
E2E_Evaluator_babelrc |
87105.18009597351 ns/iter |
106899.91184993688 ns/iter |
0.81 |
E2E_Evaluator_cerebrum_criminal_case |
1149593.0800653214 ns/iter |
1101416.842923487 ns/iter |
1.04 |
E2E_Evaluator_clang_format |
99025.45912125795 ns/iter |
115149.9448119944 ns/iter |
0.86 |
E2E_Evaluator_cmake_presets |
5088932.283687821 ns/iter |
4944772.763778248 ns/iter |
1.03 |
E2E_Evaluator_code_climate |
167821.41561587295 ns/iter |
197664.02346371324 ns/iter |
0.85 |
E2E_Evaluator_cql2 |
207851.85292378813 ns/iter |
220093.99400063296 ns/iter |
0.94 |
E2E_Evaluator_cspell |
500456.3123612435 ns/iter |
564854.7588709936 ns/iter |
0.89 |
E2E_Evaluator_cypress |
145776.78909547982 ns/iter |
171616.7314609781 ns/iter |
0.85 |
E2E_Evaluator_deno |
294321.0559032327 ns/iter |
357026.938112387 ns/iter |
0.82 |
E2E_Evaluator_dependabot |
358578.86342709 ns/iter |
386745.6603260329 ns/iter |
0.93 |
E2E_Evaluator_draft_04 |
8527187.930556895 ns/iter |
10605172.014924284 ns/iter |
0.80 |
E2E_Evaluator_fabric_mod |
721633.6130388584 ns/iter |
797149.5556830111 ns/iter |
0.91 |
E2E_Evaluator_geojson |
21332093.63636056 ns/iter |
19633882.47221726 ns/iter |
1.09 |
E2E_Evaluator_gitpod_configuration |
238667.31328576934 ns/iter |
270703.69914595556 ns/iter |
0.88 |
E2E_Evaluator_helm_chart_lock |
218952.7767295258 ns/iter |
313941.3310687951 ns/iter |
0.70 |
E2E_Evaluator_importmap |
40839.13654453584 ns/iter |
51164.55722109621 ns/iter |
0.80 |
E2E_Evaluator_jasmine |
102969.43583643512 ns/iter |
118323.87401042398 ns/iter |
0.87 |
E2E_Evaluator_jshintrc |
1023219.1215227551 ns/iter |
1061966.2366414086 ns/iter |
0.96 |
E2E_Evaluator_jsconfig |
372798.8455414507 ns/iter |
412673.63047282456 ns/iter |
0.90 |
E2E_Evaluator_krakend |
188561.84006423916 ns/iter |
215712.73465651617 ns/iter |
0.87 |
E2E_Evaluator_lazygit |
126911.97076556555 ns/iter |
147558.1536965217 ns/iter |
0.86 |
E2E_Evaluator_lerna |
132995.11096207338 ns/iter |
170859.62094762563 ns/iter |
0.78 |
E2E_Evaluator_nest_cli |
184602.83593129355 ns/iter |
201306.15983842802 ns/iter |
0.92 |
E2E_Evaluator_omc |
18594.16763543187 ns/iter |
19025.77312209425 ns/iter |
0.98 |
E2E_Evaluator_omnisharp |
539226.6069801555 ns/iter |
575145.2777321087 ns/iter |
0.94 |
E2E_Evaluator_openapi |
9721749.8382366 ns/iter |
13027102.672727281 ns/iter |
0.75 |
E2E_Evaluator_pre_commit_hooks |
479129.4070733612 ns/iter |
544950.5655930255 ns/iter |
0.88 |
E2E_Evaluator_pulumi |
753075.2612904516 ns/iter |
751105.153846219 ns/iter |
1.00 |
E2E_Evaluator_semantic_release |
87552.94280374324 ns/iter |
103881.75049564705 ns/iter |
0.84 |
E2E_Evaluator_stale |
158451.1673743122 ns/iter |
167225.68426075613 ns/iter |
0.95 |
E2E_Evaluator_stylecop |
303206.6961325821 ns/iter |
325764.64939313196 ns/iter |
0.93 |
E2E_Evaluator_tmuxinator |
86821.88133914163 ns/iter |
101420.85257059611 ns/iter |
0.86 |
E2E_Evaluator_ui5 |
521400.7837226991 ns/iter |
557478.6911532533 ns/iter |
0.94 |
E2E_Evaluator_ui5_manifest |
2610874.289962255 ns/iter |
2961157.215516887 ns/iter |
0.88 |
E2E_Evaluator_unreal_engine_uproject |
437697.3281828478 ns/iter |
482987.2531120425 ns/iter |
0.91 |
E2E_Evaluator_users_array |
672961.0456707024 ns/iter |
672414.1795606602 ns/iter |
1.00 |
E2E_Evaluator_vercel |
278531.32481023343 ns/iter |
331070.9442079439 ns/iter |
0.84 |
E2E_Evaluator_yamllint |
9776.420679491423 ns/iter |
10538.49393448586 ns/iter |
0.93 |
Schema_Format_ISO_Language_To_JSON |
130394419.50002128 ns/iter |
120000832.99998702 ns/iter |
1.09 |
Schema_Bundle_Meta_2020_12 |
1997621.7657150691 ns/iter |
2001760.354286749 ns/iter |
1.00 |
Schema_Frame_WoT_References |
6107522.859649275 ns/iter |
5880578.655461334 ns/iter |
1.04 |
Schema_Frame_OMC_References |
25336035.62963233 ns/iter |
26056698.142862648 ns/iter |
0.97 |
Schema_Frame_OMC_Locations |
23667215.72414086 ns/iter |
23423190.7333348 ns/iter |
1.01 |
Schema_Frame_ISO_Language_Locations |
108416913.83332849 ns/iter |
109781352.16665427 ns/iter |
0.99 |
Schema_Frame_KrakenD_References |
44339658.87498914 ns/iter |
47976562.00000044 ns/iter |
0.92 |
Schema_Frame_KrakenD_Reachable |
574422534.9999397 ns/iter |
604502541.9998637 ns/iter |
0.95 |
Schema_Frame_ISO_Language_Locations_To_JSON |
197337572.7500297 ns/iter |
203930630.99997258 ns/iter |
0.97 |
Schema_Frame_Many_Resources_References |
400624930.00004905 ns/iter |
412736612.49999803 ns/iter |
0.97 |
Schema_Iterator_ISO_Language |
3744674.227514152 ns/iter |
3880324.000000166 ns/iter |
0.97 |
Schema_Tracker_ISO_Language |
5619179.556450974 ns/iter |
5693615.274193205 ns/iter |
0.99 |
Schema_Tracker_ISO_Language_To_JSON |
27707029.43999822 ns/iter |
30513248.0000042 ns/iter |
0.91 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/gcc)
Details
| Benchmark suite | Current: d648028 | Previous: 77c1d98 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
121420 ns |
121233 ns |
1.00 |
E2E_Evaluator_ansible-meta |
536909 ns |
519326 ns |
1.03 |
E2E_Evaluator_aws-cdk |
129133 ns |
143886 ns |
0.90 |
E2E_Evaluator_babelrc |
316698 ns |
334852 ns |
0.95 |
E2E_Evaluator_cerebrum-criminal-case |
2676258 ns |
2524803 ns |
1.06 |
E2E_Evaluator_clang-format |
261018 ns |
270930 ns |
0.96 |
E2E_Evaluator_cmake-presets |
18281242 ns |
19247162 ns |
0.95 |
E2E_Evaluator_code-climate |
488183 ns |
504679 ns |
0.97 |
E2E_Evaluator_cql2 |
1221984 ns |
1239193 ns |
0.99 |
E2E_Evaluator_cspell |
1605805 ns |
1493678 ns |
1.08 |
E2E_Evaluator_cypress |
835835 ns |
785635 ns |
1.06 |
E2E_Evaluator_deno |
1041514 ns |
1060018 ns |
0.98 |
E2E_Evaluator_dependabot |
1046232 ns |
1087309 ns |
0.96 |
E2E_Evaluator_draft-04 |
20556652 ns |
23441062 ns |
0.88 |
E2E_Evaluator_fabric-mod |
2384557 ns |
2329579 ns |
1.02 |
E2E_Evaluator_geojson |
23611522 ns |
24885913 ns |
0.95 |
E2E_Evaluator_gitpod-configuration |
725740 ns |
716964 ns |
1.01 |
E2E_Evaluator_helm-chart-lock |
1008760 ns |
982498 ns |
1.03 |
E2E_Evaluator_importmap |
265022 ns |
264284 ns |
1.00 |
E2E_Evaluator_jasmine |
276149 ns |
297606 ns |
0.93 |
E2E_Evaluator_jsconfig |
1412709 ns |
1268494 ns |
1.11 |
E2E_Evaluator_jshintrc |
2886247 ns |
2760899 ns |
1.05 |
E2E_Evaluator_krakend |
631510 ns |
678953 ns |
0.93 |
E2E_Evaluator_lazygit |
451828 ns |
499422 ns |
0.90 |
E2E_Evaluator_lerna |
443914 ns |
465158 ns |
0.95 |
E2E_Evaluator_nest-cli |
599595 ns |
583468 ns |
1.03 |
E2E_Evaluator_omc |
91472 ns |
92769 ns |
0.99 |
E2E_Evaluator_omnisharp |
1454223 ns |
1433868 ns |
1.01 |
E2E_Evaluator_openapi |
25261126 ns |
26785136 ns |
0.94 |
E2E_Evaluator_pre-commit-hooks |
2088992 ns |
2037380 ns |
1.03 |
E2E_Evaluator_pulumi |
2000604 ns |
1866778 ns |
1.07 |
E2E_Evaluator_semantic-release |
223415 ns |
248696 ns |
0.90 |
E2E_Evaluator_stale |
370276 ns |
397566 ns |
0.93 |
E2E_Evaluator_stylecop |
1216397 ns |
1206298 ns |
1.01 |
E2E_Evaluator_tmuxinator |
216604 ns |
234371 ns |
0.92 |
E2E_Evaluator_ui5 |
2160432 ns |
2249609 ns |
0.96 |
E2E_Evaluator_ui5-manifest |
10122848 ns |
12988813 ns |
0.78 |
E2E_Evaluator_unreal-engine-uproject |
1573481 ns |
1526588 ns |
1.03 |
E2E_Evaluator_users-array |
2472077 ns |
2744811 ns |
0.90 |
E2E_Evaluator_vercel |
1027210 ns |
981365 ns |
1.05 |
E2E_Evaluator_yamllint |
23837 ns |
25817 ns |
0.92 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com