Group related canonicalizer rules#731
Merged
Merged
Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
![cubic-dev-ai[bot]](https://avatars.githubusercontent.com/in/1082092?s=60&v=4){kind=small}
There was a problem hiding this comment.
2 issues found across 7 files
Prompt for AI agents (unresolved issues)
Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.
<file name="src/alterschema/canonicalizer/implicit_object_keywords.h">
<violation number="1" location="src/alterschema/canonicalizer/implicit_object_keywords.h:48">
P2: `properties` implicit insertion is over-constrained for modern vocabularies by requiring validation + applicator together.</violation>
<violation number="2" location="src/alterschema/canonicalizer/implicit_object_keywords.h:99">
P1: Guard `required` uniqueness before deriving `minProperties`; duplicates can make the generated bound too strict.</violation>
</file>
Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.
| } | ||
|
|
||
| if (this->add_min_properties_) { | ||
| if (schema.defines("required") && schema.at("required").is_array()) { |
There was a problem hiding this comment.
P1: Guard required uniqueness before deriving minProperties; duplicates can make the generated bound too strict.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/alterschema/canonicalizer/implicit_object_keywords.h, line 99:
<comment>Guard `required` uniqueness before deriving `minProperties`; duplicates can make the generated bound too strict.</comment>
<file context>
@@ -14,22 +14,113 @@ class ImplicitObjectKeywords final : public SchemaTransformRule {
+ }
+
+ if (this->add_min_properties_) {
+ if (schema.defines("required") && schema.at("required").is_array()) {
+ schema.assign("minProperties",
+ sourcemeta::core::JSON{schema.at("required").size()});
</file context>
Comment on lines
+48
to
+63
| this->add_properties_ = | ||
| !schema.defines("properties") && | ||
| ((vocabularies.contains( | ||
| Vocabularies::Known::JSON_Schema_2020_12_Validation) && | ||
| vocabularies.contains( | ||
| Vocabularies::Known::JSON_Schema_2020_12_Applicator)) || | ||
| (vocabularies.contains( | ||
| Vocabularies::Known::JSON_Schema_2019_09_Validation) && | ||
| vocabularies.contains( | ||
| Vocabularies::Known::JSON_Schema_2019_09_Applicator)) || | ||
| vocabularies.contains_any({Vocabularies::Known::JSON_Schema_Draft_7, | ||
| Vocabularies::Known::JSON_Schema_Draft_6, | ||
| Vocabularies::Known::JSON_Schema_Draft_4, | ||
| Vocabularies::Known::JSON_Schema_Draft_3, | ||
| Vocabularies::Known::JSON_Schema_Draft_2, | ||
| Vocabularies::Known::JSON_Schema_Draft_1, |
There was a problem hiding this comment.
P2: properties implicit insertion is over-constrained for modern vocabularies by requiring validation + applicator together.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/alterschema/canonicalizer/implicit_object_keywords.h, line 48:
<comment>`properties` implicit insertion is over-constrained for modern vocabularies by requiring validation + applicator together.</comment>
<file context>
@@ -14,22 +14,113 @@ class ImplicitObjectKeywords final : public SchemaTransformRule {
+ Vocabularies::Known::JSON_Schema_Draft_6,
+ Vocabularies::Known::JSON_Schema_Draft_4});
+
+ this->add_properties_ =
+ !schema.defines("properties") &&
+ ((vocabularies.contains(
</file context>
Suggested change
| this->add_properties_ = | |
| !schema.defines("properties") && | |
| ((vocabularies.contains( | |
| Vocabularies::Known::JSON_Schema_2020_12_Validation) && | |
| vocabularies.contains( | |
| Vocabularies::Known::JSON_Schema_2020_12_Applicator)) || | |
| (vocabularies.contains( | |
| Vocabularies::Known::JSON_Schema_2019_09_Validation) && | |
| vocabularies.contains( | |
| Vocabularies::Known::JSON_Schema_2019_09_Applicator)) || | |
| vocabularies.contains_any({Vocabularies::Known::JSON_Schema_Draft_7, | |
| Vocabularies::Known::JSON_Schema_Draft_6, | |
| Vocabularies::Known::JSON_Schema_Draft_4, | |
| Vocabularies::Known::JSON_Schema_Draft_3, | |
| Vocabularies::Known::JSON_Schema_Draft_2, | |
| Vocabularies::Known::JSON_Schema_Draft_1, | |
| this->add_properties_ = | |
| !schema.defines("properties") && | |
| vocabularies.contains_any( | |
| {Vocabularies::Known::JSON_Schema_2020_12_Applicator, | |
| Vocabularies::Known::JSON_Schema_2019_09_Applicator, | |
| Vocabularies::Known::JSON_Schema_Draft_7, | |
| Vocabularies::Known::JSON_Schema_Draft_6, | |
| Vocabularies::Known::JSON_Schema_Draft_4, | |
| Vocabularies::Known::JSON_Schema_Draft_3, | |
| Vocabularies::Known::JSON_Schema_Draft_2, | |
| Vocabularies::Known::JSON_Schema_Draft_1, | |
| Vocabularies::Known::JSON_Schema_Draft_0}); |
There was a problem hiding this comment.
2 issues found across 8 files (changes from recent commits).
Prompt for AI agents (unresolved issues)
Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.
<file name="src/alterschema/canonicalizer/implicit_object_keywords.h">
<violation number="1" location="src/alterschema/canonicalizer/implicit_object_keywords.h:215">
P2: `uniqueItems` is added without requiring modern Validation vocabulary, which can produce non-declared keywords in custom 2019-09/2020-12 vocab sets.</violation>
<violation number="2" location="src/alterschema/canonicalizer/implicit_object_keywords.h:223">
P2: `minItems` is added without checking modern Validation vocabulary, which can canonicalize to a schema that declares incompatible vocabularies.</violation>
</file>
Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.
| this->add_items_ = !is_modern && !schema.defines("items"); | ||
| this->items_as_object_ = is_pre_draft4; | ||
|
|
||
| this->add_min_items_ = !schema.defines("minItems"); |
There was a problem hiding this comment.
P2: minItems is added without checking modern Validation vocabulary, which can canonicalize to a schema that declares incompatible vocabularies.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/alterschema/canonicalizer/implicit_object_keywords.h, line 223:
<comment>`minItems` is added without checking modern Validation vocabulary, which can canonicalize to a schema that declares incompatible vocabularies.</comment>
<file context>
@@ -80,47 +182,111 @@ class ImplicitObjectKeywords final : public SchemaTransformRule {
- ? sourcemeta::core::JSON::make_object()
- : sourcemeta::core::JSON{true});
- }
+ this->add_min_items_ = !schema.defines("minItems");
+
+ this->has_work_ =
</file context>
Suggested change
| this->add_min_items_ = !schema.defines("minItems"); | |
| this->add_min_items_ = | |
| !schema.defines("minItems") && | |
| (!is_modern || | |
| vocabularies.contains_any( | |
| {Vocabularies::Known::JSON_Schema_2019_09_Validation, | |
| Vocabularies::Known::JSON_Schema_2020_12_Validation})); |
Comment on lines
+215
to
+217
| this->add_unique_items_ = | ||
| !schema.defines("uniqueItems") && | ||
| !vocabularies.contains_any({Vocabularies::Known::JSON_Schema_Draft_0, |
There was a problem hiding this comment.
P2: uniqueItems is added without requiring modern Validation vocabulary, which can produce non-declared keywords in custom 2019-09/2020-12 vocab sets.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/alterschema/canonicalizer/implicit_object_keywords.h, line 215:
<comment>`uniqueItems` is added without requiring modern Validation vocabulary, which can produce non-declared keywords in custom 2019-09/2020-12 vocab sets.</comment>
<file context>
@@ -80,47 +182,111 @@ class ImplicitObjectKeywords final : public SchemaTransformRule {
- schema.assign("minProperties", sourcemeta::core::JSON{0});
- }
- }
+ this->add_unique_items_ =
+ !schema.defines("uniqueItems") &&
+ !vocabularies.contains_any({Vocabularies::Known::JSON_Schema_Draft_0,
</file context>
Suggested change
| this->add_unique_items_ = | |
| !schema.defines("uniqueItems") && | |
| !vocabularies.contains_any({Vocabularies::Known::JSON_Schema_Draft_0, | |
| this->add_unique_items_ = | |
| !schema.defines("uniqueItems") && | |
| (!is_modern || | |
| vocabularies.contains_any( | |
| {Vocabularies::Known::JSON_Schema_2019_09_Validation, | |
| Vocabularies::Known::JSON_Schema_2020_12_Validation})) && | |
| !vocabularies.contains_any({Vocabularies::Known::JSON_Schema_Draft_0, | |
| Vocabularies::Known::JSON_Schema_Draft_1}); |
🤖 Augment PR SummarySummary: This PR consolidates several object-related canonicalizer rules into a single rule, reducing the number of separate transformation classes. Changes:
Technical Notes: The new grouped logic computes per-keyword applicability from the active vocabularies and only mutates the schema when at least one object keyword needs to be made explicit. 🤖 Was this summary useful? React with 👍 or 👎 |
![augmentcode[bot]](https://avatars.githubusercontent.com/in/1027498?s=60&v=4){kind=small}
| bundle.add<EmptyDependenciesDrop>(); | ||
| bundle.add<EmptyDependentSchemasDrop>(); | ||
| bundle.add<EmptyDependentRequiredDrop>(); | ||
| bundle.add<AdditionalPropertiesImplicit>(); |
There was a problem hiding this comment.
Removing AdditionalPropertiesImplicit here effectively moves the additionalProperties defaulting earlier (now via ImplicitObjectKeywords), which means RequiredPropertiesInProperties (it requires !schema.defines("additionalProperties")) may no longer run for Draft 3–7 object schemas. That can change the canonicalized shape (e.g., required entries no longer being materialized under properties) and potentially break downstream assumptions/tests.
Severity: high
Other Locations
src/alterschema/canonicalizer/implicit_object_keywords.h:60src/alterschema/common/required_properties_in_properties.h:36
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
| bundle.add<UnevaluatedPropertiesToAdditionalProperties>(); | ||
| bundle.add<IfThenElseImplicit>(); | ||
| bundle.add<ImplicitObjectKeywords>(); | ||
| bundle.add<PropertyNamesImplicit>(); |
There was a problem hiding this comment.
By folding PropertyNamesImplicit (and related rules) into ImplicitObjectKeywords, the standalone rule names disappear from traces and can’t be individually excluded/removed via SchemaTransformer::remove / x-exclude. If external users rely on those granular rule names, this becomes a user-visible behavior change.
Severity: medium
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: fdd63e2 | Previous: d462d56 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
64508900.77777811 ns/iter |
62177548.88888926 ns/iter |
1.04 |
E2E_Compiler_ansible_meta |
30077223.173913866 ns/iter |
28670560.87499975 ns/iter |
1.05 |
E2E_Compiler_aws_cdk |
366503.71054010105 ns/iter |
374722.89001602883 ns/iter |
0.98 |
E2E_Compiler_babelrc |
2623020.2792452523 ns/iter |
2538241.252707501 ns/iter |
1.03 |
E2E_Compiler_clang_format |
18951463.72972962 ns/iter |
18086188.153845865 ns/iter |
1.05 |
E2E_Compiler_cmake_presets |
26090271.66666751 ns/iter |
25298719.392858565 ns/iter |
1.03 |
E2E_Compiler_code_climate |
2662850.417624593 ns/iter |
2559789.740875922 ns/iter |
1.04 |
E2E_Compiler_cql2 |
13026083.000000797 ns/iter |
12790569.27272677 ns/iter |
1.02 |
E2E_Compiler_cspell |
22886440.25806493 ns/iter |
22544827.87096703 ns/iter |
1.02 |
E2E_Compiler_cypress |
3964060.5875704126 ns/iter |
3897069.089385548 ns/iter |
1.02 |
E2E_Compiler_deno |
7883916.056179964 ns/iter |
7683671.5494505875 ns/iter |
1.03 |
E2E_Compiler_dependabot |
4030595.9017341384 ns/iter |
3879204.283333593 ns/iter |
1.04 |
E2E_Compiler_draft_04 |
2704146.4594593835 ns/iter |
2640326.2819545297 ns/iter |
1.02 |
E2E_Compiler_fabric_mod |
4841626.99305557 ns/iter |
4718049.865771828 ns/iter |
1.03 |
E2E_Compiler_geojson |
22763412.580643706 ns/iter |
21599542.12499926 ns/iter |
1.05 |
E2E_Compiler_gitpod_configuration |
4960404.071428571 ns/iter |
4826261.565516814 ns/iter |
1.03 |
E2E_Compiler_helm_chart_lock |
686486.6966731932 ns/iter |
703279.5660378035 ns/iter |
0.98 |
E2E_Compiler_importmap |
276464.56702253246 ns/iter |
282262.02653799404 ns/iter |
0.98 |
E2E_Compiler_jasmine |
1359748.098393648 ns/iter |
1346889.5758156027 ns/iter |
1.01 |
E2E_Compiler_jshintrc |
4346407.812499819 ns/iter |
4276858.554878412 ns/iter |
1.02 |
E2E_Compiler_jsconfig |
22175313.87096796 ns/iter |
21640963.87500081 ns/iter |
1.02 |
E2E_Compiler_krakend |
136035950.99999666 ns/iter |
138577016.59999293 ns/iter |
0.98 |
E2E_Compiler_lazygit |
34305172.20000126 ns/iter |
32909530.761901896 ns/iter |
1.04 |
E2E_Compiler_lerna |
1593350.3636364061 ns/iter |
1581731.0839002298 ns/iter |
1.01 |
E2E_Compiler_nest_cli |
7581578.924731564 ns/iter |
7345279.389473466 ns/iter |
1.03 |
E2E_Compiler_omc |
155256978.75000334 ns/iter |
152629477.00000495 ns/iter |
1.02 |
E2E_Compiler_omnisharp |
6871738.068627127 ns/iter |
6646614.566037905 ns/iter |
1.03 |
E2E_Compiler_openapi |
25205426.892857272 ns/iter |
24542156.275864385 ns/iter |
1.03 |
E2E_Compiler_pre_commit_hooks |
5486064.070312491 ns/iter |
5248190.843283385 ns/iter |
1.05 |
E2E_Compiler_pulumi |
4078802.444444575 ns/iter |
3981578.158192146 ns/iter |
1.02 |
E2E_Compiler_semantic_release |
1575168.8018017039 ns/iter |
1543557.9140968996 ns/iter |
1.02 |
E2E_Compiler_stale |
1559824.3786191035 ns/iter |
1537420.2538291793 ns/iter |
1.01 |
E2E_Compiler_stylecop |
6308832.630630556 ns/iter |
6108885.429825294 ns/iter |
1.03 |
E2E_Compiler_tmuxinator |
1938376.7839333906 ns/iter |
1900512.4162160084 ns/iter |
1.02 |
E2E_Compiler_ui5 |
48466438.214286916 ns/iter |
47029440.99999513 ns/iter |
1.03 |
E2E_Compiler_ui5_manifest |
304688351.00001 ns/iter |
312475573.4999667 ns/iter |
0.98 |
E2E_Compiler_unreal_engine_uproject |
4658204.81333329 ns/iter |
4515635.0129035115 ns/iter |
1.03 |
E2E_Compiler_users_array |
767106.1005464521 ns/iter |
780817.5178571272 ns/iter |
0.98 |
E2E_Compiler_vercel |
12449983.160714898 ns/iter |
12357297.087718459 ns/iter |
1.01 |
E2E_Compiler_yamllint |
336840.8049952114 ns/iter |
344322.8701426172 ns/iter |
0.98 |
E2E_Evaluator_adaptivecard |
24279.781948688727 ns/iter |
24071.982087688462 ns/iter |
1.01 |
E2E_Evaluator_ansible_meta |
207649.9200940066 ns/iter |
229232.88672391817 ns/iter |
0.91 |
E2E_Evaluator_aws_cdk |
43210.79133374254 ns/iter |
50600.03280697579 ns/iter |
0.85 |
E2E_Evaluator_babelrc |
84685.0724673128 ns/iter |
106780.38773946297 ns/iter |
0.79 |
E2E_Evaluator_cerebrum_criminal_case |
990240.6920863208 ns/iter |
946042.1625682496 ns/iter |
1.05 |
E2E_Evaluator_clang_format |
116424.3486495397 ns/iter |
122097.9090909149 ns/iter |
0.95 |
E2E_Evaluator_cmake_presets |
4104799.117646962 ns/iter |
4180427.3053895063 ns/iter |
0.98 |
E2E_Evaluator_code_climate |
150336.38279569751 ns/iter |
173234.57617866018 ns/iter |
0.87 |
E2E_Evaluator_cql2 |
184263.63268982622 ns/iter |
216772.01034376223 ns/iter |
0.85 |
E2E_Evaluator_cspell |
540991.7737909417 ns/iter |
554609.8112449453 ns/iter |
0.98 |
E2E_Evaluator_cypress |
166920.77673860858 ns/iter |
189851.5404012965 ns/iter |
0.88 |
E2E_Evaluator_deno |
245353.69027483644 ns/iter |
318682.9815315316 ns/iter |
0.77 |
E2E_Evaluator_dependabot |
300278.3709884513 ns/iter |
317168.12730546616 ns/iter |
0.95 |
E2E_Evaluator_draft_04 |
6985872.30526336 ns/iter |
7437908.098900203 ns/iter |
0.94 |
E2E_Evaluator_fabric_mod |
642988.0405529989 ns/iter |
692508.0009832947 ns/iter |
0.93 |
E2E_Evaluator_geojson |
16097050.97674382 ns/iter |
15734175.066667276 ns/iter |
1.02 |
E2E_Evaluator_gitpod_configuration |
200383.3391131296 ns/iter |
228354.09019607367 ns/iter |
0.88 |
E2E_Evaluator_helm_chart_lock |
252315.12079348468 ns/iter |
348488.2852867679 ns/iter |
0.72 |
E2E_Evaluator_importmap |
42970.28489412623 ns/iter |
48402.72493785794 ns/iter |
0.89 |
E2E_Evaluator_jasmine |
97080.78566562105 ns/iter |
105540.06887135898 ns/iter |
0.92 |
E2E_Evaluator_jshintrc |
1165657.9784412044 ns/iter |
1206573.4802065229 ns/iter |
0.97 |
E2E_Evaluator_jsconfig |
401965.24727487174 ns/iter |
418847.74355902645 ns/iter |
0.96 |
E2E_Evaluator_krakend |
174349.50162215988 ns/iter |
204410.7638929804 ns/iter |
0.85 |
E2E_Evaluator_lazygit |
121012.65949758893 ns/iter |
148807.17644520785 ns/iter |
0.81 |
E2E_Evaluator_lerna |
108457.33060404772 ns/iter |
148395.19061343098 ns/iter |
0.73 |
E2E_Evaluator_nest_cli |
166932.60818572156 ns/iter |
176491.81381910414 ns/iter |
0.95 |
E2E_Evaluator_omc |
17776.099912794973 ns/iter |
17402.520084617874 ns/iter |
1.02 |
E2E_Evaluator_omnisharp |
563190.8358809275 ns/iter |
609215.9330395717 ns/iter |
0.92 |
E2E_Evaluator_openapi |
9104586.680000465 ns/iter |
9014649.77922039 ns/iter |
1.01 |
E2E_Evaluator_pre_commit_hooks |
462303.06308099045 ns/iter |
471126.70536321064 ns/iter |
0.98 |
E2E_Evaluator_pulumi |
682924.7018756402 ns/iter |
689267.5792031438 ns/iter |
0.99 |
E2E_Evaluator_semantic_release |
79017.74587010524 ns/iter |
94897.14886118444 ns/iter |
0.83 |
E2E_Evaluator_stale |
142988.16152413038 ns/iter |
148838.11563759905 ns/iter |
0.96 |
E2E_Evaluator_stylecop |
258709.3068473248 ns/iter |
287410.42804575624 ns/iter |
0.90 |
E2E_Evaluator_tmuxinator |
80480.09566829944 ns/iter |
100969.55552378396 ns/iter |
0.80 |
E2E_Evaluator_ui5 |
463155.0301837109 ns/iter |
502894.42519687465 ns/iter |
0.92 |
E2E_Evaluator_ui5_manifest |
2246580.3472669492 ns/iter |
2446260.1013983754 ns/iter |
0.92 |
E2E_Evaluator_unreal_engine_uproject |
406364.9452852187 ns/iter |
430831.61655506474 ns/iter |
0.94 |
E2E_Evaluator_users_array |
547922.0063040932 ns/iter |
535486.1250000008 ns/iter |
1.02 |
E2E_Evaluator_vercel |
246081.6595446443 ns/iter |
324690.83729600004 ns/iter |
0.76 |
E2E_Evaluator_yamllint |
8106.73650499995 ns/iter |
8265.507834187349 ns/iter |
0.98 |
Micro_Draft4_Meta_1_No_Callback |
194.31867592515178 ns/iter |
188.87195778703088 ns/iter |
1.03 |
Micro_Draft4_Required_Properties |
856.5616575808268 ns/iter |
791.3755827194524 ns/iter |
1.08 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
23.81583142745121 ns/iter |
21.129442443244134 ns/iter |
1.13 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
10.640298200788687 ns/iter |
10.900391798999323 ns/iter |
0.98 |
Micro_Draft4_Items_Schema |
297.3797500748102 ns/iter |
297.2553824131663 ns/iter |
1.00 |
Micro_Draft4_Nested_Object |
1.4078410297919761 ns/iter |
1.774378576852235 ns/iter |
0.79 |
Micro_Draft4_Properties_Triad_Optional |
319.1602538079374 ns/iter |
317.59274657615094 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Closed |
274.0134207939842 ns/iter |
264.34279145129744 ns/iter |
1.04 |
Micro_Draft4_Properties_Triad_Required |
332.9375073904905 ns/iter |
333.5935122479112 ns/iter |
1.00 |
Micro_Draft4_Properties_Closed |
61.70313021846058 ns/iter |
54.833515101137266 ns/iter |
1.13 |
Micro_Draft4_Non_Recursive_Ref |
12.576483511827288 ns/iter |
12.42617186526649 ns/iter |
1.01 |
Micro_Draft4_Pattern_Properties_True |
143.62107429879538 ns/iter |
149.7755066619557 ns/iter |
0.96 |
Micro_Draft4_Ref_To_Single_Property |
10.893220034196359 ns/iter |
10.909866072110367 ns/iter |
1.00 |
Micro_Draft4_Additional_Properties_Type |
30.62151168634964 ns/iter |
22.229847197120037 ns/iter |
1.38 |
Micro_Draft4_Nested_Oneof |
54.33985410557829 ns/iter |
57.9239830733444 ns/iter |
0.94 |
Micro_Draft4_Short_Enum |
14.070138407617987 ns/iter |
14.045522611958454 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
13.734254495301657 ns/iter |
14.234957899565357 ns/iter |
0.96 |
Micro_Draft4_Long_Enum_Short_Strings |
14.065644137503309 ns/iter |
14.070338014418601 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
3.520939573393968 ns/iter |
3.4234375539628186 ns/iter |
1.03 |
Micro_Draft4_Ref_Single_100 |
2360401.074324312 ns/iter |
2364543.1088434816 ns/iter |
1.00 |
Micro_Draft4_Compile_Ref_Many_Nested |
1715157.666666579 ns/iter |
1715177.6601467712 ns/iter |
1.00 |
Micro_Draft4_Compile_Wrap |
2389049.150170376 ns/iter |
2361050.1114864894 ns/iter |
1.01 |
Micro_Draft6_Property_Names |
517.5437994709276 ns/iter |
516.5320786503095 ns/iter |
1.00 |
Micro_Draft6_Compile_FHIR |
15686259493.999956 ns/iter |
13444941939.000046 ns/iter |
1.17 |
Micro_Draft7_If_Then_Else |
23.7270680322486 ns/iter |
23.34011988895354 ns/iter |
1.02 |
Micro_2019_09_Unevaluated_Properties |
27.122358153061885 ns/iter |
28.97237848439534 ns/iter |
0.94 |
Micro_2019_09_Compile_Wrap |
312812314.499979 ns/iter |
289298866.5000189 ns/iter |
1.08 |
Micro_2020_12_Dynamic_Ref |
225.40101760310142 ns/iter |
226.32190848554094 ns/iter |
1.00 |
Micro_2020_12_Dynamic_Ref_Single |
3.520939281902435 ns/iter |
3.4253413112415565 ns/iter |
1.03 |
Micro_2020_12_Simple_Output_Mask |
1016.8156725233421 ns/iter |
1070.1535271297867 ns/iter |
0.95 |
Micro_2020_12_Simple_Output_Annotations |
95168.83303922942 ns/iter |
102182.7907212039 ns/iter |
0.93 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1104627.0927672323 ns/iter |
1086591.0851393454 ns/iter |
1.02 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8410.830484485721 ns/iter |
8055.757672963377 ns/iter |
1.04 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
172116.79197082133 ns/iter |
171261.30850542503 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
23453.412194281456 ns/iter |
22199.459643270777 ns/iter |
1.06 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
146.26184553555015 ns/iter |
140.91596228627654 ns/iter |
1.04 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4161.34702419518 ns/iter |
4217.564042996092 ns/iter |
0.99 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
325369813.99999833 ns/iter |
349765685.9999552 ns/iter |
0.93 |
Alterschema_Check_Readibility_OMC |
89337767.99999294 ns/iter |
83819452.87500514 ns/iter |
1.07 |
Alterschema_Check_Readibility_KrakenD |
1295547689.0000455 ns/iter |
1167020181.9999874 ns/iter |
1.11 |
Alterschema_Apply_Readibility_KrakenD |
129767538375.00008 ns/iter |
118113574648.99992 ns/iter |
1.10 |
Alterschema_Check_Invalid_External_Refs |
282288612.0000021 ns/iter |
303500822.0000464 ns/iter |
0.93 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/llvm)
Details
| Benchmark suite | Current: fdd63e2 | Previous: d462d56 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
115582 ns |
113767 ns |
1.02 |
E2E_Evaluator_ansible-meta |
525094 ns |
509709 ns |
1.03 |
E2E_Evaluator_aws-cdk |
129075 ns |
138159 ns |
0.93 |
E2E_Evaluator_babelrc |
301340 ns |
307711 ns |
0.98 |
E2E_Evaluator_cerebrum-criminal-case |
2583818 ns |
2368521 ns |
1.09 |
E2E_Evaluator_clang-format |
251459 ns |
248221 ns |
1.01 |
E2E_Evaluator_cmake-presets |
17357798 ns |
17606515 ns |
0.99 |
E2E_Evaluator_code-climate |
491056 ns |
483853 ns |
1.01 |
E2E_Evaluator_cql2 |
1205149 ns |
1136374 ns |
1.06 |
E2E_Evaluator_cspell |
1566342 ns |
1424353 ns |
1.10 |
E2E_Evaluator_cypress |
817957 ns |
773331 ns |
1.06 |
E2E_Evaluator_deno |
1046202 ns |
1006374 ns |
1.04 |
E2E_Evaluator_dependabot |
1025478 ns |
1036855 ns |
0.99 |
E2E_Evaluator_draft-04 |
19964138 ns |
19818376 ns |
1.01 |
E2E_Evaluator_fabric-mod |
2428825 ns |
2272349 ns |
1.07 |
E2E_Evaluator_geojson |
26117188 ns |
25161900 ns |
1.04 |
E2E_Evaluator_gitpod-configuration |
702129 ns |
687860 ns |
1.02 |
E2E_Evaluator_helm-chart-lock |
995514 ns |
1010453 ns |
0.99 |
E2E_Evaluator_importmap |
267767 ns |
274664 ns |
0.97 |
E2E_Evaluator_jasmine |
293455 ns |
309268 ns |
0.95 |
E2E_Evaluator_jsconfig |
1376868 ns |
1191351 ns |
1.16 |
E2E_Evaluator_jshintrc |
2965849 ns |
2820404 ns |
1.05 |
E2E_Evaluator_krakend |
668453 ns |
687459 ns |
0.97 |
E2E_Evaluator_lazygit |
442050 ns |
489103 ns |
0.90 |
E2E_Evaluator_lerna |
427310 ns |
455293 ns |
0.94 |
E2E_Evaluator_nest-cli |
578362 ns |
567191 ns |
1.02 |
E2E_Evaluator_omc |
90279 ns |
87234 ns |
1.03 |
E2E_Evaluator_omnisharp |
1466571 ns |
1370025 ns |
1.07 |
E2E_Evaluator_openapi |
22554511 ns |
22338379 ns |
1.01 |
E2E_Evaluator_pre-commit-hooks |
1917037 ns |
1836929 ns |
1.04 |
E2E_Evaluator_pulumi |
1862922 ns |
1811785 ns |
1.03 |
E2E_Evaluator_semantic-release |
230494 ns |
252218 ns |
0.91 |
E2E_Evaluator_stale |
363099 ns |
389713 ns |
0.93 |
E2E_Evaluator_stylecop |
1173257 ns |
1133359 ns |
1.04 |
E2E_Evaluator_tmuxinator |
216535 ns |
222672 ns |
0.97 |
E2E_Evaluator_ui5 |
2026210 ns |
2060280 ns |
0.98 |
E2E_Evaluator_ui5-manifest |
9682377 ns |
10297306 ns |
0.94 |
E2E_Evaluator_unreal-engine-uproject |
1531598 ns |
1432275 ns |
1.07 |
E2E_Evaluator_users-array |
2345770 ns |
2258146 ns |
1.04 |
E2E_Evaluator_vercel |
953652 ns |
927918 ns |
1.03 |
E2E_Evaluator_yamllint |
26472 ns |
27905 ns |
0.95 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: fdd63e2 | Previous: d462d56 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
65562443.18182342 ns/iter |
73529554.20000172 ns/iter |
0.89 |
E2E_Compiler_ansible_meta |
26704616.961537268 ns/iter |
29306715.00000244 ns/iter |
0.91 |
E2E_Compiler_aws_cdk |
304877.71091702796 ns/iter |
337121.70528542437 ns/iter |
0.90 |
E2E_Compiler_babelrc |
2280858.4106583525 ns/iter |
2514926.730650122 ns/iter |
0.91 |
E2E_Compiler_clang_format |
17281104.68292659 ns/iter |
17367076.395833198 ns/iter |
1.00 |
E2E_Compiler_cmake_presets |
29127735.52174278 ns/iter |
29837123.249999803 ns/iter |
0.98 |
E2E_Compiler_code_climate |
2348590.5737702446 ns/iter |
2413624.3628048976 ns/iter |
0.97 |
E2E_Compiler_cql2 |
12432480.220339177 ns/iter |
14334518.181817656 ns/iter |
0.87 |
E2E_Compiler_cspell |
21844161.8846135 ns/iter |
21110938.78125203 ns/iter |
1.03 |
E2E_Compiler_cypress |
4443518.048128437 ns/iter |
4116730.7554343077 ns/iter |
1.08 |
E2E_Compiler_deno |
7528024.57692234 ns/iter |
7510262.826923071 ns/iter |
1.00 |
E2E_Compiler_dependabot |
4551143.543956237 ns/iter |
3789757.7500000033 ns/iter |
1.20 |
E2E_Compiler_draft_04 |
2297119.5482864245 ns/iter |
2182674.2702705506 ns/iter |
1.05 |
E2E_Compiler_fabric_mod |
4250718.922651921 ns/iter |
4548790.362500199 ns/iter |
0.93 |
E2E_Compiler_geojson |
26485731.31034482 ns/iter |
24461186.21875115 ns/iter |
1.08 |
E2E_Compiler_gitpod_configuration |
4444499.087591037 ns/iter |
4522552.018181958 ns/iter |
0.98 |
E2E_Compiler_helm_chart_lock |
557775.5205882126 ns/iter |
560456.9580000315 ns/iter |
1.00 |
E2E_Compiler_importmap |
255285.16823103253 ns/iter |
210730.21335698487 ns/iter |
1.21 |
E2E_Compiler_jasmine |
1202037.2242646548 ns/iter |
1228902.2675842135 ns/iter |
0.98 |
E2E_Compiler_jshintrc |
3556832.474227047 ns/iter |
3361481.45549763 ns/iter |
1.06 |
E2E_Compiler_jsconfig |
21565785.8888897 ns/iter |
22197327.371431388 ns/iter |
0.97 |
E2E_Compiler_krakend |
189149458.25000018 ns/iter |
150921341.5999966 ns/iter |
1.25 |
E2E_Compiler_lazygit |
41510469.944442876 ns/iter |
33195976.190481383 ns/iter |
1.25 |
E2E_Compiler_lerna |
1594299.3864541675 ns/iter |
1436056.4775582654 ns/iter |
1.11 |
E2E_Compiler_nest_cli |
7050237.243242714 ns/iter |
6907704.83193208 ns/iter |
1.02 |
E2E_Compiler_omc |
182256312.49998742 ns/iter |
201092281.24999845 ns/iter |
0.91 |
E2E_Compiler_omnisharp |
6200766.798387701 ns/iter |
6407720.727272759 ns/iter |
0.97 |
E2E_Compiler_openapi |
22976449.21875275 ns/iter |
23834698.935483936 ns/iter |
0.96 |
E2E_Compiler_pre_commit_hooks |
4412586.981249688 ns/iter |
4580850.364780121 ns/iter |
0.96 |
E2E_Compiler_pulumi |
3467816.124378404 ns/iter |
4170646.0343135074 ns/iter |
0.83 |
E2E_Compiler_semantic_release |
1310007.7561779085 ns/iter |
1592223.4927235618 ns/iter |
0.82 |
E2E_Compiler_stale |
1538971.9050736483 ns/iter |
1938476.1777779076 ns/iter |
0.79 |
E2E_Compiler_stylecop |
9196838.174419068 ns/iter |
7104091.473684606 ns/iter |
1.29 |
E2E_Compiler_tmuxinator |
1878478.5333333744 ns/iter |
1826539.701570738 ns/iter |
1.03 |
E2E_Compiler_ui5 |
63241975.75000312 ns/iter |
67410606.09091288 ns/iter |
0.94 |
E2E_Compiler_ui5_manifest |
400994958.5000072 ns/iter |
402714249.9999741 ns/iter |
1.00 |
E2E_Compiler_unreal_engine_uproject |
4721476.088757326 ns/iter |
4916700.645390582 ns/iter |
0.96 |
E2E_Compiler_users_array |
950640.0436105514 ns/iter |
906144.0436681156 ns/iter |
1.05 |
E2E_Compiler_vercel |
18767299.804877196 ns/iter |
14305395.833332568 ns/iter |
1.31 |
E2E_Compiler_yamllint |
379437.79247843893 ns/iter |
343191.09405311354 ns/iter |
1.11 |
E2E_Evaluator_adaptivecard |
25279.017386722542 ns/iter |
23754.448135236114 ns/iter |
1.06 |
E2E_Evaluator_ansible_meta |
243864.92660274231 ns/iter |
223855.26490946696 ns/iter |
1.09 |
E2E_Evaluator_aws_cdk |
38426.01860574624 ns/iter |
57876.419992127536 ns/iter |
0.66 |
E2E_Evaluator_babelrc |
84376.32879637311 ns/iter |
94173.32116362642 ns/iter |
0.90 |
E2E_Evaluator_cerebrum_criminal_case |
879142.8449366444 ns/iter |
952126.3133004548 ns/iter |
0.92 |
E2E_Evaluator_clang_format |
124623.58083443096 ns/iter |
122915.71901656248 ns/iter |
1.01 |
E2E_Evaluator_cmake_presets |
3467926.2135413797 ns/iter |
3444339.1454543057 ns/iter |
1.01 |
E2E_Evaluator_code_climate |
145623.42801388964 ns/iter |
176860.03728413666 ns/iter |
0.82 |
E2E_Evaluator_cql2 |
158011.15651575522 ns/iter |
175937.52294090102 ns/iter |
0.90 |
E2E_Evaluator_cspell |
439283.72434017126 ns/iter |
567228.198948385 ns/iter |
0.77 |
E2E_Evaluator_cypress |
194773.3578004502 ns/iter |
228945.86466162922 ns/iter |
0.85 |
E2E_Evaluator_deno |
307225.5997177511 ns/iter |
352314.7503875532 ns/iter |
0.87 |
E2E_Evaluator_dependabot |
305510.72407231113 ns/iter |
314714.61821027566 ns/iter |
0.97 |
E2E_Evaluator_draft_04 |
7122292.857143076 ns/iter |
5989081.2499998 ns/iter |
1.19 |
E2E_Evaluator_fabric_mod |
554306.9635826341 ns/iter |
564807.0921659986 ns/iter |
0.98 |
E2E_Evaluator_geojson |
12741474.29787379 ns/iter |
16394514.70588278 ns/iter |
0.78 |
E2E_Evaluator_gitpod_configuration |
160964.47862844222 ns/iter |
187924.89662146292 ns/iter |
0.86 |
E2E_Evaluator_helm_chart_lock |
233709.92089113852 ns/iter |
196451.92307691832 ns/iter |
1.19 |
E2E_Evaluator_importmap |
30078.10784177432 ns/iter |
28703.098454689836 ns/iter |
1.05 |
E2E_Evaluator_jasmine |
76564.2311337347 ns/iter |
75960.96671379679 ns/iter |
1.01 |
E2E_Evaluator_jshintrc |
919169.6496165367 ns/iter |
886668.4280052559 ns/iter |
1.04 |
E2E_Evaluator_jsconfig |
300589.59950957185 ns/iter |
299308.58793543716 ns/iter |
1.00 |
E2E_Evaluator_krakend |
127123.63344810905 ns/iter |
141503.73944662802 ns/iter |
0.90 |
E2E_Evaluator_lazygit |
97413.16473745799 ns/iter |
108008.95241088129 ns/iter |
0.90 |
E2E_Evaluator_lerna |
106354.24741601189 ns/iter |
117466.50069649173 ns/iter |
0.91 |
E2E_Evaluator_nest_cli |
127593.41948139294 ns/iter |
129232.30286617039 ns/iter |
0.99 |
E2E_Evaluator_omc |
16238.114155252226 ns/iter |
14233.981071874947 ns/iter |
1.14 |
E2E_Evaluator_omnisharp |
436607.10937501787 ns/iter |
442759.6319581779 ns/iter |
0.99 |
E2E_Evaluator_openapi |
5185192.251968426 ns/iter |
6274930.657143938 ns/iter |
0.83 |
E2E_Evaluator_pre_commit_hooks |
310219.73092370306 ns/iter |
376686.93207731185 ns/iter |
0.82 |
E2E_Evaluator_pulumi |
469803.9252835612 ns/iter |
492775.8404864718 ns/iter |
0.95 |
E2E_Evaluator_semantic_release |
64900.20842981151 ns/iter |
69364.60181350412 ns/iter |
0.94 |
E2E_Evaluator_stale |
110812.56697711666 ns/iter |
120671.16899822971 ns/iter |
0.92 |
E2E_Evaluator_stylecop |
176853.74915428468 ns/iter |
176496.4916334817 ns/iter |
1.00 |
E2E_Evaluator_tmuxinator |
69404.76075294154 ns/iter |
66470.96199524676 ns/iter |
1.04 |
E2E_Evaluator_ui5 |
314009.77967626514 ns/iter |
324001.2551020191 ns/iter |
0.97 |
E2E_Evaluator_ui5_manifest |
1633411.8324738783 ns/iter |
1511586.6861166614 ns/iter |
1.08 |
E2E_Evaluator_unreal_engine_uproject |
290864.2064144604 ns/iter |
298473.3074280449 ns/iter |
0.97 |
E2E_Evaluator_users_array |
376418.1646378004 ns/iter |
393346.439824912 ns/iter |
0.96 |
E2E_Evaluator_vercel |
206448.3186624665 ns/iter |
217115.31590215222 ns/iter |
0.95 |
E2E_Evaluator_yamllint |
5744.008573969067 ns/iter |
6344.782857786638 ns/iter |
0.91 |
Micro_Draft4_Meta_1_No_Callback |
122.41916050677612 ns/iter |
138.3246855313618 ns/iter |
0.89 |
Micro_Draft4_Required_Properties |
601.1495722090559 ns/iter |
651.7217351276762 ns/iter |
0.92 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
14.813396962453696 ns/iter |
16.94549255132739 ns/iter |
0.87 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
6.866342482923289 ns/iter |
7.85221160008268 ns/iter |
0.87 |
Micro_Draft4_Items_Schema |
249.46338783572392 ns/iter |
292.2488839862747 ns/iter |
0.85 |
Micro_Draft4_Nested_Object |
0.6539860174619839 ns/iter |
0.7518803794041637 ns/iter |
0.87 |
Micro_Draft4_Properties_Triad_Optional |
197.35469728319336 ns/iter |
238.37194975802845 ns/iter |
0.83 |
Micro_Draft4_Properties_Triad_Closed |
161.0929408992423 ns/iter |
187.01328822992883 ns/iter |
0.86 |
Micro_Draft4_Properties_Triad_Required |
197.8319089968608 ns/iter |
267.52779085271584 ns/iter |
0.74 |
Micro_Draft4_Properties_Closed |
35.617356625233626 ns/iter |
42.26031921547778 ns/iter |
0.84 |
Micro_Draft4_Non_Recursive_Ref |
11.839927041514292 ns/iter |
14.261492164392235 ns/iter |
0.83 |
Micro_Draft4_Pattern_Properties_True |
131.25126050419942 ns/iter |
159.62976470940595 ns/iter |
0.82 |
Micro_Draft4_Ref_To_Single_Property |
7.074130695798429 ns/iter |
7.300293494143557 ns/iter |
0.97 |
Micro_Draft4_Additional_Properties_Type |
23.87937341796011 ns/iter |
26.19833528536138 ns/iter |
0.91 |
Micro_Draft4_Nested_Oneof |
39.483391384771096 ns/iter |
42.92497732275796 ns/iter |
0.92 |
Micro_Draft4_Short_Enum |
4.603721513427144 ns/iter |
5.172817499999383 ns/iter |
0.89 |
Micro_Draft4_Long_Enum |
9.593699834314005 ns/iter |
11.404957772117315 ns/iter |
0.84 |
Micro_Draft4_Long_Enum_Short_Strings |
6.050680985689842 ns/iter |
6.933735475918746 ns/iter |
0.87 |
Micro_Draft4_Type_Object |
2.036865169207702 ns/iter |
2.311133868358877 ns/iter |
0.88 |
Micro_Draft4_Ref_Single_100 |
1602114.0202703897 ns/iter |
1949920.635854182 ns/iter |
0.82 |
Micro_Draft4_Compile_Ref_Many_Nested |
1139731.410256721 ns/iter |
1346404.3411975997 ns/iter |
0.85 |
Micro_Draft4_Compile_Wrap |
1965384.3123210743 ns/iter |
2045899.5664743574 ns/iter |
0.96 |
Micro_Draft6_Property_Names |
92.83471058378807 ns/iter |
91.36728551618302 ns/iter |
1.02 |
Micro_Draft6_Compile_FHIR |
7781988582.999929 ns/iter |
9630718707.999905 ns/iter |
0.81 |
Micro_Draft7_If_Then_Else |
16.48907645039195 ns/iter |
18.11813019489295 ns/iter |
0.91 |
Micro_2019_09_Unevaluated_Properties |
24.85405303373792 ns/iter |
26.503251492178073 ns/iter |
0.94 |
Micro_2019_09_Compile_Wrap |
272476937.5000733 ns/iter |
314955770.4999779 ns/iter |
0.87 |
Micro_2020_12_Dynamic_Ref |
176.1939924087 ns/iter |
205.02504349207894 ns/iter |
0.86 |
Micro_2020_12_Dynamic_Ref_Single |
2.2455863579225994 ns/iter |
2.205911383823462 ns/iter |
1.02 |
Micro_2020_12_Simple_Output_Mask |
730.8806026369433 ns/iter |
746.7739962745358 ns/iter |
0.98 |
Micro_2020_12_Simple_Output_Annotations |
79701.86958014421 ns/iter |
79655.39053253442 ns/iter |
1.00 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
758021.8239740995 ns/iter |
736990.8868335785 ns/iter |
1.03 |
Micro_2020_12_Exhaustive_Deep_Numeric |
4950.930834669926 ns/iter |
5007.719183921791 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
107280.07964603424 ns/iter |
105931.68872961472 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
13706.278598280225 ns/iter |
14057.741567921401 ns/iter |
0.97 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
86.83141175409094 ns/iter |
91.67090415184688 ns/iter |
0.95 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4505.0132491862205 ns/iter |
4732.2509503820165 ns/iter |
0.95 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
210061250.0000049 ns/iter |
246993208.3333788 ns/iter |
0.85 |
Alterschema_Check_Readibility_OMC |
53382083.35714561 ns/iter |
53496144.23076113 ns/iter |
1.00 |
Alterschema_Check_Readibility_KrakenD |
581863415.9998056 ns/iter |
555944332.999843 ns/iter |
1.05 |
Alterschema_Apply_Readibility_KrakenD |
62690321499.999985 ns/iter |
63034059375.99996 ns/iter |
0.99 |
Alterschema_Check_Invalid_External_Refs |
156560218.7499735 ns/iter |
153760093.75000876 ns/iter |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (macos/llvm)
Details
| Benchmark suite | Current: fdd63e2 | Previous: d462d56 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
128511 ns |
122329 ns |
1.05 |
E2E_Evaluator_ansible-meta |
520853 ns |
395467 ns |
1.32 |
E2E_Evaluator_aws-cdk |
140183 ns |
132876 ns |
1.05 |
E2E_Evaluator_babelrc |
315105 ns |
279984 ns |
1.13 |
E2E_Evaluator_cerebrum-criminal-case |
2135354 ns |
1810674 ns |
1.18 |
E2E_Evaluator_clang-format |
217254 ns |
191341 ns |
1.14 |
E2E_Evaluator_cmake-presets |
16489915 ns |
12767879 ns |
1.29 |
E2E_Evaluator_code-climate |
474658 ns |
411404 ns |
1.15 |
E2E_Evaluator_cql2 |
1328207 ns |
1134334 ns |
1.17 |
E2E_Evaluator_cspell |
1528970 ns |
1146891 ns |
1.33 |
E2E_Evaluator_cypress |
745231 ns |
520859 ns |
1.43 |
E2E_Evaluator_deno |
858576 ns |
619986 ns |
1.38 |
E2E_Evaluator_dependabot |
815191 ns |
745919 ns |
1.09 |
E2E_Evaluator_draft-04 |
16235657 ns |
14518351 ns |
1.12 |
E2E_Evaluator_fabric-mod |
1676842 ns |
1572002 ns |
1.07 |
E2E_Evaluator_geojson |
18700110 ns |
17459387 ns |
1.07 |
E2E_Evaluator_gitpod-configuration |
484858 ns |
480489 ns |
1.01 |
E2E_Evaluator_helm-chart-lock |
871357 ns |
857466 ns |
1.02 |
E2E_Evaluator_importmap |
222090 ns |
217677 ns |
1.02 |
E2E_Evaluator_jasmine |
239686 ns |
223729 ns |
1.07 |
E2E_Evaluator_jsconfig |
930748 ns |
885971 ns |
1.05 |
E2E_Evaluator_jshintrc |
2091368 ns |
2128690 ns |
0.98 |
E2E_Evaluator_krakend |
459720 ns |
439271 ns |
1.05 |
E2E_Evaluator_lazygit |
292809 ns |
267596 ns |
1.09 |
E2E_Evaluator_lerna |
317724 ns |
319390 ns |
0.99 |
E2E_Evaluator_nest-cli |
405497 ns |
420254 ns |
0.96 |
E2E_Evaluator_omc |
69625 ns |
78317 ns |
0.89 |
E2E_Evaluator_omnisharp |
1044832 ns |
1002980 ns |
1.04 |
E2E_Evaluator_openapi |
19187584 ns |
18036833 ns |
1.06 |
E2E_Evaluator_pre-commit-hooks |
1554053 ns |
1356921 ns |
1.15 |
E2E_Evaluator_pulumi |
1726596 ns |
1366618 ns |
1.26 |
E2E_Evaluator_semantic-release |
198949 ns |
212617 ns |
0.94 |
E2E_Evaluator_stale |
305752 ns |
311266 ns |
0.98 |
E2E_Evaluator_stylecop |
766476 ns |
716967 ns |
1.07 |
E2E_Evaluator_tmuxinator |
168440 ns |
164242 ns |
1.03 |
E2E_Evaluator_ui5 |
1658528 ns |
1556156 ns |
1.07 |
E2E_Evaluator_ui5-manifest |
9403574 ns |
7679124 ns |
1.22 |
E2E_Evaluator_unreal-engine-uproject |
1238178 ns |
1161037 ns |
1.07 |
E2E_Evaluator_users-array |
2026635 ns |
2022382 ns |
1.00 |
E2E_Evaluator_vercel |
796542 ns |
741711 ns |
1.07 |
E2E_Evaluator_yamllint |
28645 ns |
26578 ns |
1.08 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: fdd63e2 | Previous: d462d56 | Ratio |
|---|---|---|---|
Alterschema_Check_Readibility_ISO_Language_Set_3 |
349954794.49992216 ns/iter |
348646992.9999885 ns/iter |
1.00 |
Alterschema_Check_Readibility_OMC |
96357762.8571589 ns/iter |
92849480.25000972 ns/iter |
1.04 |
Alterschema_Check_Readibility_KrakenD |
1329183671.0000098 ns/iter |
1261590709.9998367 ns/iter |
1.05 |
Alterschema_Apply_Readibility_KrakenD |
134958199589.00006 ns/iter |
125493890159.0001 ns/iter |
1.08 |
Alterschema_Check_Invalid_External_Refs |
340467690.999958 ns/iter |
347044482.9999906 ns/iter |
0.98 |
Micro_2020_12_Dynamic_Ref |
261.0319680085997 ns/iter |
253.0471893106029 ns/iter |
1.03 |
Micro_2020_12_Dynamic_Ref_Single |
4.66743946358103 ns/iter |
4.921982926921191 ns/iter |
0.95 |
Micro_2020_12_Simple_Output_Mask |
1153.237592565498 ns/iter |
1190.0752295629359 ns/iter |
0.97 |
Micro_2020_12_Simple_Output_Annotations |
116592.53847444682 ns/iter |
116073.02235667639 ns/iter |
1.00 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1205288.7624786105 ns/iter |
1230798.8963093138 ns/iter |
0.98 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8664.766827162943 ns/iter |
8451.599818790088 ns/iter |
1.03 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
164403.1477809476 ns/iter |
165491.24196140713 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
25279.222068515395 ns/iter |
25268.698243348284 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
131.61415837698064 ns/iter |
144.34387344855966 ns/iter |
0.91 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4793.452963720355 ns/iter |
4867.066620229348 ns/iter |
0.98 |
Micro_2019_09_Unevaluated_Properties |
29.471552886228817 ns/iter |
29.538187425638647 ns/iter |
1.00 |
Micro_2019_09_Compile_Wrap |
316911261.99996233 ns/iter |
339188815.50005156 ns/iter |
0.93 |
Micro_Draft7_If_Then_Else |
24.006599772281245 ns/iter |
24.01820796032266 ns/iter |
1.00 |
Micro_Draft6_Property_Names |
157.08628467314063 ns/iter |
157.20617568646801 ns/iter |
1.00 |
Micro_Draft6_Compile_FHIR |
13795984856.000132 ns/iter |
14898511236.000105 ns/iter |
0.93 |
Micro_Draft4_Meta_1_No_Callback |
165.6511740191431 ns/iter |
165.20538567931357 ns/iter |
1.00 |
Micro_Draft4_Required_Properties |
824.5937666536977 ns/iter |
818.9861848999062 ns/iter |
1.01 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
20.62330624997928 ns/iter |
30.723330176580202 ns/iter |
0.67 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
13.143146146694786 ns/iter |
13.093493914333576 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
353.6817452477748 ns/iter |
334.8442629730457 ns/iter |
1.06 |
Micro_Draft4_Nested_Object |
2.180418382351604 ns/iter |
2.1876091033610217 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Optional |
382.88318772450776 ns/iter |
442.2703524218688 ns/iter |
0.87 |
Micro_Draft4_Properties_Triad_Closed |
308.0299002449314 ns/iter |
344.2762032861917 ns/iter |
0.89 |
Micro_Draft4_Properties_Triad_Required |
413.7090714466947 ns/iter |
455.02079360379656 ns/iter |
0.91 |
Micro_Draft4_Properties_Closed |
64.59814798879809 ns/iter |
63.33815016637073 ns/iter |
1.02 |
Micro_Draft4_Non_Recursive_Ref |
9.967515378429614 ns/iter |
9.9630415368386 ns/iter |
1.00 |
Micro_Draft4_Pattern_Properties_True |
208.36934951300066 ns/iter |
208.41640909799148 ns/iter |
1.00 |
Micro_Draft4_Ref_To_Single_Property |
13.73160887383796 ns/iter |
13.707006053268762 ns/iter |
1.00 |
Micro_Draft4_Additional_Properties_Type |
14.659077226814219 ns/iter |
14.63582342104547 ns/iter |
1.00 |
Micro_Draft4_Nested_Oneof |
65.026987156289 ns/iter |
64.79687526051072 ns/iter |
1.00 |
Micro_Draft4_Short_Enum |
14.937033940637297 ns/iter |
14.702948944355166 ns/iter |
1.02 |
Micro_Draft4_Long_Enum |
14.962483807279794 ns/iter |
14.337985884315769 ns/iter |
1.04 |
Micro_Draft4_Long_Enum_Short_Strings |
14.651526556615725 ns/iter |
14.689964709478753 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
4.672033221809193 ns/iter |
4.669550204471004 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
2480434.521276651 ns/iter |
2512661.877256502 ns/iter |
0.99 |
Micro_Draft4_Compile_Ref_Many_Nested |
1797964.5360822256 ns/iter |
1829028.3749996899 ns/iter |
0.98 |
Micro_Draft4_Compile_Wrap |
2549355.9345448543 ns/iter |
2620304.728624125 ns/iter |
0.97 |
E2E_Compiler_adaptivecard |
66045592.72727783 ns/iter |
70895413.90000704 ns/iter |
0.93 |
E2E_Compiler_ansible_meta |
30197225.478263058 ns/iter |
31036295.130434155 ns/iter |
0.97 |
E2E_Compiler_aws_cdk |
414915.14667458023 ns/iter |
419019.9620939066 ns/iter |
0.99 |
E2E_Compiler_babelrc |
2747738.38039294 ns/iter |
2784280.793651392 ns/iter |
0.99 |
E2E_Compiler_clang_format |
19495055.44444542 ns/iter |
19873715.171427518 ns/iter |
0.98 |
E2E_Compiler_cmake_presets |
27004805.499997858 ns/iter |
28127427.39999521 ns/iter |
0.96 |
E2E_Compiler_code_climate |
2817763.027888828 ns/iter |
2833347.9068831676 ns/iter |
0.99 |
E2E_Compiler_cql2 |
13964935.320000222 ns/iter |
14222575.428573467 ns/iter |
0.98 |
E2E_Compiler_cspell |
23644895.60000038 ns/iter |
24523491.142856203 ns/iter |
0.96 |
E2E_Compiler_cypress |
4119320.0650888267 ns/iter |
4177824.6407179204 ns/iter |
0.99 |
E2E_Compiler_deno |
8213747.176470111 ns/iter |
8539718.72289187 ns/iter |
0.96 |
E2E_Compiler_dependabot |
4217511.898204322 ns/iter |
4257424.656249498 ns/iter |
0.99 |
E2E_Compiler_draft_04 |
2938813.100418811 ns/iter |
3023631.56355996 ns/iter |
0.97 |
E2E_Compiler_fabric_mod |
5132387.109489525 ns/iter |
5206654.992647105 ns/iter |
0.99 |
E2E_Compiler_geojson |
23692548.068961985 ns/iter |
24508703.413795076 ns/iter |
0.97 |
E2E_Compiler_gitpod_configuration |
5292116.4736843845 ns/iter |
5340340.825758479 ns/iter |
0.99 |
E2E_Compiler_helm_chart_lock |
754780.5671321867 ns/iter |
760503.0984848572 ns/iter |
0.99 |
E2E_Compiler_importmap |
310690.5909694117 ns/iter |
312260.7941175921 ns/iter |
0.99 |
E2E_Compiler_jasmine |
1463987.1192468042 ns/iter |
1479981.2168420383 ns/iter |
0.99 |
E2E_Compiler_jshintrc |
4677732.033334602 ns/iter |
4706293.182432485 ns/iter |
0.99 |
E2E_Compiler_jsconfig |
23049125.433332544 ns/iter |
23778851.44827313 ns/iter |
0.97 |
E2E_Compiler_krakend |
141359968.00000614 ns/iter |
156999462.4999822 ns/iter |
0.90 |
E2E_Compiler_lazygit |
35224350.099997535 ns/iter |
36378526.7368377 ns/iter |
0.97 |
E2E_Compiler_lerna |
1758750.0398997888 ns/iter |
1762966.0453398547 ns/iter |
1.00 |
E2E_Compiler_nest_cli |
7962596.624999854 ns/iter |
8633011.563217914 ns/iter |
0.92 |
E2E_Compiler_omc |
161897755.75003296 ns/iter |
177956756.25001195 ns/iter |
0.91 |
E2E_Compiler_omnisharp |
7201500.360824678 ns/iter |
7241594.567010007 ns/iter |
0.99 |
E2E_Compiler_openapi |
26741253.076929405 ns/iter |
27321094.80769815 ns/iter |
0.98 |
E2E_Compiler_pre_commit_hooks |
5676401.918700003 ns/iter |
5737248.557376587 ns/iter |
0.99 |
E2E_Compiler_pulumi |
4346147.223602502 ns/iter |
4396299.318750607 ns/iter |
0.99 |
E2E_Compiler_semantic_release |
1699013.8276695493 ns/iter |
1727892.9755502092 ns/iter |
0.98 |
E2E_Compiler_stale |
1661215.142180093 ns/iter |
1682702.074519354 ns/iter |
0.99 |
E2E_Compiler_stylecop |
6328544.818180407 ns/iter |
6376434.4727257015 ns/iter |
0.99 |
E2E_Compiler_tmuxinator |
2105424.285284992 ns/iter |
2210007.4573164955 ns/iter |
0.95 |
E2E_Compiler_ui5 |
49022391.999999724 ns/iter |
50827602.571432956 ns/iter |
0.96 |
E2E_Compiler_ui5_manifest |
324500575.49999654 ns/iter |
346786642.99997306 ns/iter |
0.94 |
E2E_Compiler_unreal_engine_uproject |
4897290.608391336 ns/iter |
4950655.435714322 ns/iter |
0.99 |
E2E_Compiler_users_array |
872985.4152118622 ns/iter |
886519.5797467049 ns/iter |
0.98 |
E2E_Compiler_vercel |
13041203.66037596 ns/iter |
13354671.788463818 ns/iter |
0.98 |
E2E_Compiler_yamllint |
381365.9073569345 ns/iter |
380877.0834242078 ns/iter |
1.00 |
E2E_Evaluator_adaptivecard |
23102.721034305436 ns/iter |
23346.69519484895 ns/iter |
0.99 |
E2E_Evaluator_ansible_meta |
247842.1812455714 ns/iter |
244588.64747437584 ns/iter |
1.01 |
E2E_Evaluator_aws_cdk |
52449.319391925805 ns/iter |
52669.66276803321 ns/iter |
1.00 |
E2E_Evaluator_babelrc |
107770.05886770104 ns/iter |
103968.41989853812 ns/iter |
1.04 |
E2E_Evaluator_cerebrum_criminal_case |
1000386.4279603455 ns/iter |
994210.0315183935 ns/iter |
1.01 |
E2E_Evaluator_clang_format |
102967.86756916021 ns/iter |
104439.86846367047 ns/iter |
0.99 |
E2E_Evaluator_cmake_presets |
4389484.17532428 ns/iter |
5340796.43307092 ns/iter |
0.82 |
E2E_Evaluator_code_climate |
191958.35663957382 ns/iter |
193652.1396877551 ns/iter |
0.99 |
E2E_Evaluator_cql2 |
214259.32101407927 ns/iter |
213050.76608727963 ns/iter |
1.01 |
E2E_Evaluator_cspell |
535078.226544514 ns/iter |
538774.4553030244 ns/iter |
0.99 |
E2E_Evaluator_cypress |
176302.208682417 ns/iter |
174575.4610599679 ns/iter |
1.01 |
E2E_Evaluator_deno |
331830.7127409704 ns/iter |
323675.4455445116 ns/iter |
1.03 |
E2E_Evaluator_dependabot |
362906.7487205544 ns/iter |
358256.0257836065 ns/iter |
1.01 |
E2E_Evaluator_draft_04 |
7563409.8586958675 ns/iter |
7405044.723404996 ns/iter |
1.02 |
E2E_Evaluator_fabric_mod |
727937.1251324953 ns/iter |
722353.2739582576 ns/iter |
1.01 |
E2E_Evaluator_geojson |
16041956.795452898 ns/iter |
16952907.619048305 ns/iter |
0.95 |
E2E_Evaluator_gitpod_configuration |
253289.07490910005 ns/iter |
252276.47078044043 ns/iter |
1.00 |
E2E_Evaluator_helm_chart_lock |
326050.8413792592 ns/iter |
324741.7543940984 ns/iter |
1.00 |
E2E_Evaluator_importmap |
49022.69280523268 ns/iter |
49853.71379719597 ns/iter |
0.98 |
E2E_Evaluator_jasmine |
117084.83322259037 ns/iter |
117947.70341250928 ns/iter |
0.99 |
E2E_Evaluator_jshintrc |
1054909.1581325058 ns/iter |
1049190.117117194 ns/iter |
1.01 |
E2E_Evaluator_jsconfig |
403166.58864022035 ns/iter |
399236.78559074644 ns/iter |
1.01 |
E2E_Evaluator_krakend |
207706.71373247425 ns/iter |
207887.7621158881 ns/iter |
1.00 |
E2E_Evaluator_lazygit |
132485.93827401288 ns/iter |
132497.8159278625 ns/iter |
1.00 |
E2E_Evaluator_lerna |
151936.8901884194 ns/iter |
149539.45132173487 ns/iter |
1.02 |
E2E_Evaluator_nest_cli |
197499.32051287615 ns/iter |
198811.42749580537 ns/iter |
0.99 |
E2E_Evaluator_omc |
18493.162088058285 ns/iter |
18699.049069372468 ns/iter |
0.99 |
E2E_Evaluator_omnisharp |
562035.7630521605 ns/iter |
558650.7630943697 ns/iter |
1.01 |
E2E_Evaluator_openapi |
9921716.56337914 ns/iter |
11500052.07812299 ns/iter |
0.86 |
E2E_Evaluator_pre_commit_hooks |
514745.26894502016 ns/iter |
522288.42136506253 ns/iter |
0.99 |
E2E_Evaluator_pulumi |
703573.9282053281 ns/iter |
719153.6221106063 ns/iter |
0.98 |
E2E_Evaluator_semantic_release |
105513.74784387872 ns/iter |
101623.60433409296 ns/iter |
1.04 |
E2E_Evaluator_stale |
153054.62645316665 ns/iter |
154845.53424660958 ns/iter |
0.99 |
E2E_Evaluator_stylecop |
301597.57765315473 ns/iter |
302489.4246514851 ns/iter |
1.00 |
E2E_Evaluator_tmuxinator |
99617.71307422334 ns/iter |
98129.57814254212 ns/iter |
1.02 |
E2E_Evaluator_ui5 |
521940.104695985 ns/iter |
533602.885736206 ns/iter |
0.98 |
E2E_Evaluator_ui5_manifest |
2679276.0526324385 ns/iter |
2767484.753905869 ns/iter |
0.97 |
E2E_Evaluator_unreal_engine_uproject |
455329.7508153291 ns/iter |
462062.39425585436 ns/iter |
0.99 |
E2E_Evaluator_users_array |
634564.4231806209 ns/iter |
640311.1449274553 ns/iter |
0.99 |
E2E_Evaluator_vercel |
309373.2776066588 ns/iter |
303809.93877554755 ns/iter |
1.02 |
E2E_Evaluator_yamllint |
10537.090722153129 ns/iter |
10906.238217787924 ns/iter |
0.97 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/gcc)
Details
| Benchmark suite | Current: fdd63e2 | Previous: d462d56 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
114008 ns |
114470 ns |
1.00 |
E2E_Evaluator_ansible-meta |
505731 ns |
502795 ns |
1.01 |
E2E_Evaluator_aws-cdk |
141628 ns |
141970 ns |
1.00 |
E2E_Evaluator_babelrc |
313903 ns |
312042 ns |
1.01 |
E2E_Evaluator_cerebrum-criminal-case |
2450164 ns |
2367370 ns |
1.03 |
E2E_Evaluator_clang-format |
269559 ns |
253106 ns |
1.07 |
E2E_Evaluator_cmake-presets |
18023804 ns |
17396103 ns |
1.04 |
E2E_Evaluator_code-climate |
490163 ns |
493454 ns |
0.99 |
E2E_Evaluator_cql2 |
1146209 ns |
1166864 ns |
0.98 |
E2E_Evaluator_cspell |
1424589 ns |
1503343 ns |
0.95 |
E2E_Evaluator_cypress |
767108 ns |
761177 ns |
1.01 |
E2E_Evaluator_deno |
1002495 ns |
994318 ns |
1.01 |
E2E_Evaluator_dependabot |
1028039 ns |
1052653 ns |
0.98 |
E2E_Evaluator_draft-04 |
21433649 ns |
23519085 ns |
0.91 |
E2E_Evaluator_fabric-mod |
2288946 ns |
2313147 ns |
0.99 |
E2E_Evaluator_geojson |
25163381 ns |
26372154 ns |
0.95 |
E2E_Evaluator_gitpod-configuration |
678833 ns |
689377 ns |
0.98 |
E2E_Evaluator_helm-chart-lock |
986389 ns |
983325 ns |
1.00 |
E2E_Evaluator_importmap |
270047 ns |
266102 ns |
1.01 |
E2E_Evaluator_jasmine |
304617 ns |
296181 ns |
1.03 |
E2E_Evaluator_jsconfig |
1228250 ns |
1191576 ns |
1.03 |
E2E_Evaluator_jshintrc |
2774895 ns |
2762439 ns |
1.00 |
E2E_Evaluator_krakend |
705987 ns |
691408 ns |
1.02 |
E2E_Evaluator_lazygit |
514304 ns |
484899 ns |
1.06 |
E2E_Evaluator_lerna |
452363 ns |
442089 ns |
1.02 |
E2E_Evaluator_nest-cli |
565224 ns |
565338 ns |
1.00 |
E2E_Evaluator_omc |
87460 ns |
87447 ns |
1.00 |
E2E_Evaluator_omnisharp |
1403119 ns |
1407405 ns |
1.00 |
E2E_Evaluator_openapi |
24184316 ns |
22713452 ns |
1.06 |
E2E_Evaluator_pre-commit-hooks |
1873224 ns |
1878747 ns |
1.00 |
E2E_Evaluator_pulumi |
1794211 ns |
1764260 ns |
1.02 |
E2E_Evaluator_semantic-release |
259754 ns |
250703 ns |
1.04 |
E2E_Evaluator_stale |
382934 ns |
374901 ns |
1.02 |
E2E_Evaluator_stylecop |
1119221 ns |
1098233 ns |
1.02 |
E2E_Evaluator_tmuxinator |
225772 ns |
227605 ns |
0.99 |
E2E_Evaluator_ui5 |
2006063 ns |
2000693 ns |
1.00 |
E2E_Evaluator_ui5-manifest |
10042115 ns |
9953349 ns |
1.01 |
E2E_Evaluator_unreal-engine-uproject |
1452250 ns |
1436176 ns |
1.01 |
E2E_Evaluator_users-array |
2291333 ns |
2257551 ns |
1.01 |
E2E_Evaluator_vercel |
936805 ns |
930272 ns |
1.01 |
E2E_Evaluator_yamllint |
28143 ns |
27860 ns |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com