Turn SimpleOutput annotations into a vector#916
Merged
Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
🤖 Augment PR SummarySummary: This PR changes how Changes:
Technical Notes: Downstream consumers that still need grouped annotations now explicitly build that index from the log, while 🤖 Was this summary useful? React with 👍 or 👎 |
![augmentcode[bot]](https://avatars.githubusercontent.com/in/1027498?s=60&v=4){kind=small}
![cubic-dev-ai[bot]](https://avatars.githubusercontent.com/in/1082092?s=60&v=4){kind=small}
There was a problem hiding this comment.
2 issues found across 6 files
Prompt for AI agents (unresolved issues)
Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.
<file name="src/output/output_standard.cc">
<violation number="1" location="src/output/output_standard.cc:19">
P3: Annotation grouping now has two copied implementations in `output_standard.cc` and `output_jsonld.cc`, so future grouping changes can drift between Standard and JSON-LD outputs. Consider sharing one internal helper instead of maintaining duplicate struct/map logic.</violation>
<violation number="2" location="src/output/output_standard.cc:39">
P2: Basic output can lose repeated annotations from distinct successful evaluations when they have the same location and value. Since `annotation` is now serialized from a vector, preserving every `SimpleOutput::annotations()` entry would avoid silently changing annotation multiplicity.</violation>
</file>
Reply with feedback, questions, or to request a fix.
Re-trigger cubic
Comment on lines
+39
to
+41
| if (values.empty() || values.back() != entry.value) { | ||
| values.push_back(entry.value); | ||
| } |
There was a problem hiding this comment.
P2: Basic output can lose repeated annotations from distinct successful evaluations when they have the same location and value. Since annotation is now serialized from a vector, preserving every SimpleOutput::annotations() entry would avoid silently changing annotation multiplicity.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/output/output_standard.cc, line 39:
<comment>Basic output can lose repeated annotations from distinct successful evaluations when they have the same location and value. Since `annotation` is now serialized from a vector, preserving every `SimpleOutput::annotations()` entry would avoid silently changing annotation multiplicity.</comment>
<file context>
@@ -1,15 +1,49 @@
+ auto &values{result[{.instance_location = entry.instance_location,
+ .evaluate_path = entry.evaluate_path,
+ .schema_location = entry.schema_location}]};
+ if (values.empty() || values.back() != entry.value) {
+ values.push_back(entry.value);
+ }
</file context>
Suggested change
| if (values.empty() || values.back() != entry.value) { | |
| values.push_back(entry.value); | |
| } | |
| values.push_back(entry.value); |
| namespace { | ||
|
|
||
| // NOLINTNEXTLINE(bugprone-exception-escape) | ||
| struct AnnotationLocation { |
There was a problem hiding this comment.
P3: Annotation grouping now has two copied implementations in output_standard.cc and output_jsonld.cc, so future grouping changes can drift between Standard and JSON-LD outputs. Consider sharing one internal helper instead of maintaining duplicate struct/map logic.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/output/output_standard.cc, line 19:
<comment>Annotation grouping now has two copied implementations in `output_standard.cc` and `output_jsonld.cc`, so future grouping changes can drift between Standard and JSON-LD outputs. Consider sharing one internal helper instead of maintaining duplicate struct/map logic.</comment>
<file context>
@@ -1,15 +1,49 @@
namespace {
+// NOLINTNEXTLINE(bugprone-exception-escape)
+struct AnnotationLocation {
+ auto operator<(const AnnotationLocation &other) const noexcept -> bool {
+ return std::tie(this->instance_location, this->evaluate_path,
</file context>
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: 3c17eb9 | Previous: 4abcf44 | Ratio |
|---|---|---|---|
Schema_Iterator_ISO_Language |
2226368.8866670844 ns/iter |
2125742.681003375 ns/iter |
1.05 |
Schema_Tracker_ISO_Language |
5236585.714286385 ns/iter |
5903345.435483735 ns/iter |
0.89 |
Schema_Tracker_ISO_Language_To_JSON |
15169147.630435083 ns/iter |
17775585.08333262 ns/iter |
0.85 |
Schema_Frame_WoT_References |
4355557.592357602 ns/iter |
6844354.166667854 ns/iter |
0.64 |
Schema_Frame_OMC_References |
24171293.103445977 ns/iter |
28156965.909095727 ns/iter |
0.86 |
Schema_Frame_OMC_Locations |
23572091.66667265 ns/iter |
24772291.65384205 ns/iter |
0.95 |
Schema_Frame_ISO_Language_Locations |
68959439.77777582 ns/iter |
74289906.24998732 ns/iter |
0.93 |
Schema_Frame_KrakenD_References |
43656010.43748768 ns/iter |
50848753.23076141 ns/iter |
0.86 |
Schema_Frame_KrakenD_Reachable |
334567708.00012237 ns/iter |
418731875.50004333 ns/iter |
0.80 |
Schema_Frame_ISO_Language_Locations_To_JSON |
76058546.87497526 ns/iter |
92083101.14286177 ns/iter |
0.83 |
Schema_Frame_Many_Resources_References |
294774270.9999375 ns/iter |
346075750.0000682 ns/iter |
0.85 |
Schema_Bundle_Meta_2020_12 |
1240465.5847370708 ns/iter |
1373202.9682884822 ns/iter |
0.90 |
Schema_Format_ISO_Language_To_JSON |
73587854.09996927 ns/iter |
78544729.00001496 ns/iter |
0.94 |
E2E_Compiler_adaptivecard |
54574740.38462351 ns/iter |
57996937.49997914 ns/iter |
0.94 |
E2E_Compiler_ansible_meta |
23026811.793105762 ns/iter |
25966265.300000183 ns/iter |
0.89 |
E2E_Compiler_aws_cdk |
279639.8907533449 ns/iter |
280098.98237517267 ns/iter |
1.00 |
E2E_Compiler_babelrc |
2170829.027355359 ns/iter |
2070561.6234942998 ns/iter |
1.05 |
E2E_Compiler_clang_format |
13878403.382980824 ns/iter |
14453060.000000732 ns/iter |
0.96 |
E2E_Compiler_cmake_presets |
24791994.43333376 ns/iter |
26773908.962965194 ns/iter |
0.93 |
E2E_Compiler_code_climate |
2127915.01524396 ns/iter |
2053796.7645259553 ns/iter |
1.04 |
E2E_Compiler_cql2 |
10859100.129033733 ns/iter |
11257682.692310201 ns/iter |
0.96 |
E2E_Compiler_cspell |
20100517.85714495 ns/iter |
18710577.37142629 ns/iter |
1.07 |
E2E_Compiler_cypress |
3685952.4393939218 ns/iter |
3383854.4688998596 ns/iter |
1.09 |
E2E_Compiler_deno |
6114132.0088508455 ns/iter |
6645594.798163809 ns/iter |
0.92 |
E2E_Compiler_dependabot |
3569962.586735129 ns/iter |
3431839.0243908386 ns/iter |
1.04 |
E2E_Compiler_draft_04 |
1907596.9101123428 ns/iter |
1871275.959893393 ns/iter |
1.02 |
E2E_Compiler_fabric_mod |
3538458.3349280604 ns/iter |
4753435.233161265 ns/iter |
0.74 |
E2E_Compiler_geojson |
22438866.1818218 ns/iter |
24116673.82758925 ns/iter |
0.93 |
E2E_Compiler_gitpod_configuration |
3715316.1764700124 ns/iter |
4489717.443750863 ns/iter |
0.83 |
E2E_Compiler_helm_chart_lock |
500052.4164243913 ns/iter |
478137.413194525 ns/iter |
1.05 |
E2E_Compiler_importmap |
197988.50198527935 ns/iter |
227692.5164877597 ns/iter |
0.87 |
E2E_Compiler_jasmine |
1112363.7815934806 ns/iter |
990795.584045743 ns/iter |
1.12 |
E2E_Compiler_jshintrc |
3637512.5201791096 ns/iter |
3178566.3900412135 ns/iter |
1.14 |
E2E_Compiler_jsconfig |
26852493.066667195 ns/iter |
19215731.820511978 ns/iter |
1.40 |
E2E_Compiler_krakend |
154301947.74995697 ns/iter |
131428275.00000748 ns/iter |
1.17 |
E2E_Compiler_lazygit |
31768446.954546645 ns/iter |
39139387.23529582 ns/iter |
0.81 |
E2E_Compiler_lerna |
1352581.9288389266 ns/iter |
1594063.9440714729 ns/iter |
0.85 |
E2E_Compiler_nest_cli |
6222988.738739799 ns/iter |
9623782.686273944 ns/iter |
0.65 |
E2E_Compiler_omc |
204740926.9999889 ns/iter |
203233166.6666778 ns/iter |
1.01 |
E2E_Compiler_omnisharp |
6757802.80172454 ns/iter |
6567936.3170728 ns/iter |
1.03 |
E2E_Compiler_openapi |
22692048.187501255 ns/iter |
23290043.10344913 ns/iter |
0.97 |
E2E_Compiler_pre_commit_hooks |
4199913.476470422 ns/iter |
4132475.1461990927 ns/iter |
1.02 |
E2E_Compiler_pulumi |
2997770.363227847 ns/iter |
2947508.158333297 ns/iter |
1.02 |
E2E_Compiler_semantic_release |
1167539.7598040428 ns/iter |
1101489.4374034402 ns/iter |
1.06 |
E2E_Compiler_stale |
1211349.9420783718 ns/iter |
1155943.1352202266 ns/iter |
1.05 |
E2E_Compiler_stylecop |
5434795.581196441 ns/iter |
5437788.934307181 ns/iter |
1.00 |
E2E_Compiler_tmuxinator |
1432859.0909091798 ns/iter |
1784932.5447572428 ns/iter |
0.80 |
E2E_Compiler_ui5 |
50854794.64285722 ns/iter |
49432562.500003636 ns/iter |
1.03 |
E2E_Compiler_ui5_manifest |
283180562.5000925 ns/iter |
325968749.9999775 ns/iter |
0.87 |
E2E_Compiler_unreal_engine_uproject |
3554707.92718407 ns/iter |
5610377.07999958 ns/iter |
0.63 |
E2E_Compiler_users_array |
830382.8002282574 ns/iter |
1259451.0649089457 ns/iter |
0.66 |
E2E_Compiler_vercel |
12887242.086204143 ns/iter |
13885295.518518971 ns/iter |
0.93 |
E2E_Compiler_yamllint |
267290.40817032143 ns/iter |
247386.13659696598 ns/iter |
1.08 |
E2E_Evaluator_adaptivecard |
21647.452182547047 ns/iter |
24521.02173303368 ns/iter |
0.88 |
E2E_Evaluator_ansible_meta |
168816.99974528112 ns/iter |
193258.36085880906 ns/iter |
0.87 |
E2E_Evaluator_aws_cdk |
39287.33558464205 ns/iter |
43891.32317037767 ns/iter |
0.90 |
E2E_Evaluator_babelrc |
86361.68004863552 ns/iter |
105836.892386323 ns/iter |
0.82 |
E2E_Evaluator_cerebrum_criminal_case |
706308.6206895165 ns/iter |
970384.0634441874 ns/iter |
0.73 |
E2E_Evaluator_clang_format |
104123.47100301078 ns/iter |
134368.14982786888 ns/iter |
0.77 |
E2E_Evaluator_cmake_presets |
3187879.588516738 ns/iter |
5088814.511110387 ns/iter |
0.63 |
E2E_Evaluator_code_climate |
131754.53590526446 ns/iter |
193246.51178537044 ns/iter |
0.68 |
E2E_Evaluator_cql2 |
153687.7100877239 ns/iter |
238397.19512195402 ns/iter |
0.64 |
E2E_Evaluator_cspell |
425982.83007687953 ns/iter |
645522.7118786623 ns/iter |
0.66 |
E2E_Evaluator_cypress |
150777.7417261153 ns/iter |
166165.17637794357 ns/iter |
0.91 |
E2E_Evaluator_deno |
225495.50873067777 ns/iter |
233482.0802761325 ns/iter |
0.97 |
E2E_Evaluator_dependabot |
247460.50664850054 ns/iter |
251479.72436565164 ns/iter |
0.98 |
E2E_Evaluator_draft_04 |
5942900.390625283 ns/iter |
5488982.235292764 ns/iter |
1.08 |
E2E_Evaluator_fabric_mod |
491271.67235491885 ns/iter |
481951.0180635327 ns/iter |
1.02 |
E2E_Evaluator_geojson |
8272548.437500404 ns/iter |
11340227.526315367 ns/iter |
0.73 |
E2E_Evaluator_gitpod_configuration |
179404.8442047151 ns/iter |
192780.58516412362 ns/iter |
0.93 |
E2E_Evaluator_helm_chart_lock |
212358.6387434713 ns/iter |
266251.16744496743 ns/iter |
0.80 |
E2E_Evaluator_importmap |
32214.62919533071 ns/iter |
37914.95299598009 ns/iter |
0.85 |
E2E_Evaluator_jasmine |
86837.21362230534 ns/iter |
133067.334236029 ns/iter |
0.65 |
E2E_Evaluator_jshintrc |
940978.7664835776 ns/iter |
1149852.5684211405 ns/iter |
0.82 |
E2E_Evaluator_jsconfig |
308798.2594339777 ns/iter |
315839.3398567777 ns/iter |
0.98 |
E2E_Evaluator_krakend |
145290.57543145173 ns/iter |
152958.00649930077 ns/iter |
0.95 |
E2E_Evaluator_lazygit |
102665.21814703124 ns/iter |
92318.04805369771 ns/iter |
1.11 |
E2E_Evaluator_lerna |
119061.17030792203 ns/iter |
128656.15166907103 ns/iter |
0.93 |
E2E_Evaluator_nest_cli |
138241.2731006113 ns/iter |
136430.00927602584 ns/iter |
1.01 |
E2E_Evaluator_omc |
14048.527851836077 ns/iter |
13928.28426644389 ns/iter |
1.01 |
E2E_Evaluator_omnisharp |
473563.7856668049 ns/iter |
476832.7878787642 ns/iter |
0.99 |
E2E_Evaluator_openapi |
5994174.0847453745 ns/iter |
5817236.461539363 ns/iter |
1.03 |
E2E_Evaluator_pre_commit_hooks |
389683.7157592336 ns/iter |
412531.4859763108 ns/iter |
0.94 |
E2E_Evaluator_pulumi |
516004.3771729726 ns/iter |
588967.3599670758 ns/iter |
0.88 |
E2E_Evaluator_semantic_release |
73393.6261731164 ns/iter |
78045.78654706995 ns/iter |
0.94 |
E2E_Evaluator_stale |
119813.30069548072 ns/iter |
126831.34266885086 ns/iter |
0.94 |
E2E_Evaluator_stylecop |
198155.72816866208 ns/iter |
222158.975843953 ns/iter |
0.89 |
E2E_Evaluator_tmuxinator |
71936.32728391238 ns/iter |
80533.52765867332 ns/iter |
0.89 |
E2E_Evaluator_ui5 |
364634.67906263773 ns/iter |
435178.8161616073 ns/iter |
0.84 |
E2E_Evaluator_ui5_manifest |
1940850.1605837273 ns/iter |
3216494.4456142844 ns/iter |
0.60 |
E2E_Evaluator_unreal_engine_uproject |
347602.0691016525 ns/iter |
458236.8352638189 ns/iter |
0.76 |
E2E_Evaluator_users_array |
442919.1120331732 ns/iter |
518544.6556961976 ns/iter |
0.85 |
E2E_Evaluator_vercel |
232392.0474063969 ns/iter |
285833.36828854884 ns/iter |
0.81 |
E2E_Evaluator_yamllint |
6797.286575518397 ns/iter |
7456.31225859062 ns/iter |
0.91 |
JSONLD_Catalog |
52248602.53845411 ns/iter |
66667685.54545011 ns/iter |
0.78 |
Micro_Draft4_Meta_1_No_Callback |
144.35021069009247 ns/iter |
177.50078064216697 ns/iter |
0.81 |
Micro_Draft4_Required_Properties |
862.8412029098725 ns/iter |
792.8633942208046 ns/iter |
1.09 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
20.19643235814057 ns/iter |
20.801885106122498 ns/iter |
0.97 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
9.503551275638648 ns/iter |
8.599294636632452 ns/iter |
1.11 |
Micro_Draft4_Items_Schema |
218.13800277224604 ns/iter |
276.7493753665942 ns/iter |
0.79 |
Micro_Draft4_Nested_Object |
0.6960905729101583 ns/iter |
0.9411616176217207 ns/iter |
0.74 |
Micro_Draft4_Properties_Triad_Optional |
221.30007541493873 ns/iter |
243.54767921583368 ns/iter |
0.91 |
Micro_Draft4_Properties_Triad_Closed |
176.9700415578006 ns/iter |
196.45636315288706 ns/iter |
0.90 |
Micro_Draft4_Properties_Triad_Required |
230.86924825505585 ns/iter |
243.14985422735919 ns/iter |
0.95 |
Micro_Draft4_Properties_Closed |
51.85119486386633 ns/iter |
60.62438330000077 ns/iter |
0.86 |
Micro_Draft4_Non_Recursive_Ref |
13.088436476265372 ns/iter |
17.963326144292292 ns/iter |
0.73 |
Micro_Draft4_Pattern_Properties_True |
153.4345588278699 ns/iter |
178.6867337485305 ns/iter |
0.86 |
Micro_Draft4_Ref_To_Single_Property |
8.363850815604147 ns/iter |
9.297128712018 ns/iter |
0.90 |
Micro_Draft4_Additional_Properties_Type |
26.69798702397537 ns/iter |
28.222662397287625 ns/iter |
0.95 |
Micro_Draft4_Nested_Oneof |
40.29574626344133 ns/iter |
43.87820084526237 ns/iter |
0.92 |
Micro_Draft4_Short_Enum |
5.0387270800001716 ns/iter |
4.937985126786221 ns/iter |
1.02 |
Micro_Draft4_Long_Enum |
9.874028980727559 ns/iter |
12.852891237279547 ns/iter |
0.77 |
Micro_Draft4_Long_Enum_Short_Strings |
6.318907112767094 ns/iter |
7.275626017452115 ns/iter |
0.87 |
Micro_Draft4_Type_Object |
2.510239876615458 ns/iter |
2.6654192424706826 ns/iter |
0.94 |
Micro_Draft4_Ref_Single_100 |
1617680.72616101 ns/iter |
1732538.0586590255 ns/iter |
0.93 |
Micro_Draft4_Compile_Ref_Many_Nested |
1216900.9573773243 ns/iter |
1304933.8531185589 ns/iter |
0.93 |
Micro_Draft4_Compile_Wrap |
2115267.523529115 ns/iter |
2106503.7899689544 ns/iter |
1.00 |
Micro_Draft6_Property_Names |
99.35183607649057 ns/iter |
103.67459539321608 ns/iter |
0.96 |
Micro_Draft6_Compile_FHIR |
8316019500.000038 ns/iter |
9459886459.000017 ns/iter |
0.88 |
Micro_Draft7_If_Then_Else |
18.34844195967983 ns/iter |
16.93967910492856 ns/iter |
1.08 |
Micro_2019_09_Unevaluated_Properties |
26.87206541792418 ns/iter |
24.68361718484458 ns/iter |
1.09 |
Micro_2019_09_Compile_Wrap |
292138937.499999 ns/iter |
276137395.99996734 ns/iter |
1.06 |
Micro_2020_12_Dynamic_Ref |
616.5052598819469 ns/iter |
581.1775497893971 ns/iter |
1.06 |
Micro_2020_12_Dynamic_Ref_Single |
2.455748211001169 ns/iter |
2.335959491845665 ns/iter |
1.05 |
Micro_2020_12_Simple_Output_Mask |
755.6091680573666 ns/iter |
734.8096832875467 ns/iter |
1.03 |
Micro_2020_12_Simple_Output_Annotations |
85728.41061796203 ns/iter |
84550.02438476786 ns/iter |
1.01 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
8711789.587499652 ns/iter |
13063572.72727093 ns/iter |
0.67 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
748822.1232582511 ns/iter |
759626.3325714451 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric |
5453.688138784872 ns/iter |
4926.923284127535 ns/iter |
1.11 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
54305.597221129 ns/iter |
111007.04960286902 ns/iter |
0.49 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
13569.376021970178 ns/iter |
14558.05781033537 ns/iter |
0.93 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
92.64114653353164 ns/iter |
91.85767819118078 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4803.785064248926 ns/iter |
4477.71912112123 ns/iter |
1.07 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
221415319.3333459 ns/iter |
221695041.666635 ns/iter |
1.00 |
Alterschema_Check_Readibility_OMC |
57649704.83333325 ns/iter |
50986858.92308962 ns/iter |
1.13 |
Alterschema_Check_Readibility_KrakenD |
612738291.9999036 ns/iter |
562485333.0000405 ns/iter |
1.09 |
Alterschema_Apply_Readibility_KrakenD |
66210857042.9998 ns/iter |
68845714332.99994 ns/iter |
0.96 |
Alterschema_Check_Invalid_External_Refs |
180349583.25000617 ns/iter |
163598187.49998567 ns/iter |
1.10 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (macos/llvm)
Details
| Benchmark suite | Current: 3c17eb9 | Previous: 4abcf44 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
93719 ns |
133674 ns |
0.70 |
E2E_Evaluator_ansible-meta |
368883 ns |
437870 ns |
0.84 |
E2E_Evaluator_aws-cdk |
109429 ns |
135560 ns |
0.81 |
E2E_Evaluator_babelrc |
259963 ns |
337006 ns |
0.77 |
E2E_Evaluator_cerebrum-criminal-case |
1628892 ns |
2432959 ns |
0.67 |
E2E_Evaluator_clang-format |
173917 ns |
294464 ns |
0.59 |
E2E_Evaluator_cmake-presets |
12780203 ns |
20880372 ns |
0.61 |
E2E_Evaluator_code-climate |
360777 ns |
496399 ns |
0.73 |
E2E_Evaluator_cql2 |
1150314 ns |
1344933 ns |
0.86 |
E2E_Evaluator_cspell |
1594002 ns |
1866596 ns |
0.85 |
E2E_Evaluator_cypress |
623747 ns |
1029938 ns |
0.61 |
E2E_Evaluator_deno |
829121 ns |
1465116 ns |
0.57 |
E2E_Evaluator_dependabot |
908685 ns |
1121349 ns |
0.81 |
E2E_Evaluator_draft-04 |
15246903 ns |
19519419 ns |
0.78 |
E2E_Evaluator_fabric-mod |
1442078 ns |
2357816 ns |
0.61 |
E2E_Evaluator_geojson |
18045977 ns |
24682744 ns |
0.73 |
E2E_Evaluator_gitpod-configuration |
482406 ns |
685557 ns |
0.70 |
E2E_Evaluator_helm-chart-lock |
866943 ns |
1026466 ns |
0.84 |
E2E_Evaluator_importmap |
204406 ns |
298995 ns |
0.68 |
E2E_Evaluator_jasmine |
218740 ns |
240254 ns |
0.91 |
E2E_Evaluator_jsconfig |
832680 ns |
1217185 ns |
0.68 |
E2E_Evaluator_jshintrc |
2052624 ns |
2628744 ns |
0.78 |
E2E_Evaluator_krakend |
436902 ns |
566516 ns |
0.77 |
E2E_Evaluator_lazygit |
284864 ns |
524451 ns |
0.54 |
E2E_Evaluator_lerna |
321110 ns |
430366 ns |
0.75 |
E2E_Evaluator_nest-cli |
418378 ns |
545571 ns |
0.77 |
E2E_Evaluator_omc |
74308 ns |
87782 ns |
0.85 |
E2E_Evaluator_omnisharp |
957997 ns |
1230182 ns |
0.78 |
E2E_Evaluator_openapi |
16456582 ns |
19504744 ns |
0.84 |
E2E_Evaluator_pre-commit-hooks |
1326792 ns |
2612677 ns |
0.51 |
E2E_Evaluator_pulumi |
1476062 ns |
2488450 ns |
0.59 |
E2E_Evaluator_semantic-release |
192367 ns |
218514 ns |
0.88 |
E2E_Evaluator_stale |
286277 ns |
337296 ns |
0.85 |
E2E_Evaluator_stylecop |
762148 ns |
938018 ns |
0.81 |
E2E_Evaluator_tmuxinator |
194245 ns |
195284 ns |
0.99 |
E2E_Evaluator_ui5 |
1512771 ns |
2691081 ns |
0.56 |
E2E_Evaluator_ui5-manifest |
8036239 ns |
13534073 ns |
0.59 |
E2E_Evaluator_unreal-engine-uproject |
1174488 ns |
1712795 ns |
0.69 |
E2E_Evaluator_users-array |
2071148 ns |
3038811 ns |
0.68 |
E2E_Evaluator_vercel |
733342 ns |
865090 ns |
0.85 |
E2E_Evaluator_yamllint |
23589 ns |
24203 ns |
0.97 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: 3c17eb9 | Previous: 326c94d | Ratio |
|---|---|---|---|
Schema_Iterator_ISO_Language |
3044148.2900431217 ns/iter |
3054448.1484716074 ns/iter |
1.00 |
Schema_Tracker_ISO_Language |
4609281.0268462 ns/iter |
4667805.6133335605 ns/iter |
0.99 |
Schema_Tracker_ISO_Language_To_JSON |
22811398.548392683 ns/iter |
20830524.48484991 ns/iter |
1.10 |
Schema_Frame_WoT_References |
4522985.277419373 ns/iter |
4509813.435897186 ns/iter |
1.00 |
Schema_Frame_OMC_References |
19577877.555554498 ns/iter |
20387377.50000136 ns/iter |
0.96 |
Schema_Frame_OMC_Locations |
18112595.8974334 ns/iter |
19715476.944444135 ns/iter |
0.92 |
Schema_Frame_ISO_Language_Locations |
101432765.16669177 ns/iter |
102180757.99999344 ns/iter |
0.99 |
Schema_Frame_KrakenD_References |
37572610.611113705 ns/iter |
40297824.12499827 ns/iter |
0.93 |
Schema_Frame_KrakenD_Reachable |
594838433.9999393 ns/iter |
599016317.0000641 ns/iter |
0.99 |
Schema_Frame_ISO_Language_Locations_To_JSON |
122140209.20000622 ns/iter |
119252802.80001971 ns/iter |
1.02 |
Schema_Frame_Many_Resources_References |
357004196.9999238 ns/iter |
362034324.9999678 ns/iter |
0.99 |
Schema_Bundle_Meta_2020_12 |
1445394.7334682988 ns/iter |
1445844.583853365 ns/iter |
1.00 |
Schema_Format_ISO_Language_To_JSON |
104800084.28573586 ns/iter |
109979277.66663907 ns/iter |
0.95 |
E2E_Compiler_adaptivecard |
57975707.00000658 ns/iter |
61833021.250000305 ns/iter |
0.94 |
E2E_Compiler_ansible_meta |
25106584.857147545 ns/iter |
25143189.64286336 ns/iter |
1.00 |
E2E_Compiler_aws_cdk |
326020.2666667065 ns/iter |
325002.7196261123 ns/iter |
1.00 |
E2E_Compiler_babelrc |
2317862.5496692327 ns/iter |
2299171.756578894 ns/iter |
1.01 |
E2E_Compiler_clang_format |
16308079.744185517 ns/iter |
16417794.720932445 ns/iter |
0.99 |
E2E_Compiler_cmake_presets |
25630882.703698833 ns/iter |
26219687.851852104 ns/iter |
0.98 |
E2E_Compiler_code_climate |
2321543.784767871 ns/iter |
2310375.5544549497 ns/iter |
1.00 |
E2E_Compiler_cql2 |
12941978.407407414 ns/iter |
12953479.222224578 ns/iter |
1.00 |
E2E_Compiler_cspell |
22889929.22581201 ns/iter |
23217431.033337258 ns/iter |
0.99 |
E2E_Compiler_cypress |
3952138.8361578626 ns/iter |
3901186.338888844 ns/iter |
1.01 |
E2E_Compiler_deno |
7020701.290000489 ns/iter |
6998155.320000024 ns/iter |
1.00 |
E2E_Compiler_dependabot |
3528051.7020193217 ns/iter |
3502910.353535244 ns/iter |
1.01 |
E2E_Compiler_draft_04 |
2452476.787455941 ns/iter |
2429063.858131756 ns/iter |
1.01 |
E2E_Compiler_fabric_mod |
4266734.323170856 ns/iter |
4229594.61445908 ns/iter |
1.01 |
E2E_Compiler_geojson |
20243668.22857441 ns/iter |
20047115.514288247 ns/iter |
1.01 |
E2E_Compiler_gitpod_configuration |
4504727.219353944 ns/iter |
4485339.487180576 ns/iter |
1.00 |
E2E_Compiler_helm_chart_lock |
619297.5346359282 ns/iter |
615499.2222222595 ns/iter |
1.01 |
E2E_Compiler_importmap |
245712.78151256277 ns/iter |
243049.34639835433 ns/iter |
1.01 |
E2E_Compiler_jasmine |
1224167.0472030342 ns/iter |
1221733.5656742442 ns/iter |
1.00 |
E2E_Compiler_jshintrc |
3863989.0499995193 ns/iter |
3867209.373626023 ns/iter |
1.00 |
E2E_Compiler_jsconfig |
20136980.94285376 ns/iter |
20182960.628569294 ns/iter |
1.00 |
E2E_Compiler_krakend |
138805486.59999475 ns/iter |
146851171.39997602 ns/iter |
0.95 |
E2E_Compiler_lazygit |
30252406.391305752 ns/iter |
30838697.565217365 ns/iter |
0.98 |
E2E_Compiler_lerna |
1443704.0871366493 ns/iter |
1431520.9693876922 ns/iter |
1.01 |
E2E_Compiler_nest_cli |
6720516.586538085 ns/iter |
6656873.682693196 ns/iter |
1.01 |
E2E_Compiler_omc |
154769335.39998752 ns/iter |
162258919.9999993 ns/iter |
0.95 |
E2E_Compiler_omnisharp |
6012908.189655593 ns/iter |
5982395.1623931285 ns/iter |
1.01 |
E2E_Compiler_openapi |
23000589.548385713 ns/iter |
22722983.903225128 ns/iter |
1.01 |
E2E_Compiler_pre_commit_hooks |
4662550.57333304 ns/iter |
4614681.276315854 ns/iter |
1.01 |
E2E_Compiler_pulumi |
3627993.124351925 ns/iter |
3591370.556700754 ns/iter |
1.01 |
E2E_Compiler_semantic_release |
1378573.648915163 ns/iter |
1364049.5048539643 ns/iter |
1.01 |
E2E_Compiler_stale |
1411150.3279681029 ns/iter |
1390804.3090506373 ns/iter |
1.01 |
E2E_Compiler_stylecop |
5169633.867646271 ns/iter |
5129670.654412166 ns/iter |
1.01 |
E2E_Compiler_tmuxinator |
1701945.8804880497 ns/iter |
1677886.095923494 ns/iter |
1.01 |
E2E_Compiler_ui5 |
48582941.73333585 ns/iter |
47533223.73333807 ns/iter |
1.02 |
E2E_Compiler_ui5_manifest |
316480178.5000009 ns/iter |
335532136.4999781 ns/iter |
0.94 |
E2E_Compiler_unreal_engine_uproject |
4128888.0705879442 ns/iter |
4101074.619883181 ns/iter |
1.01 |
E2E_Compiler_users_array |
785670.843714512 ns/iter |
782116.6849162335 ns/iter |
1.00 |
E2E_Compiler_vercel |
12226207.696426984 ns/iter |
12343235.839283904 ns/iter |
0.99 |
E2E_Compiler_yamllint |
305660.23194082465 ns/iter |
303129.08732642856 ns/iter |
1.01 |
E2E_Evaluator_adaptivecard |
27656.706986398145 ns/iter |
26278.292475684317 ns/iter |
1.05 |
E2E_Evaluator_ansible_meta |
254527.34071425963 ns/iter |
244183.9871750604 ns/iter |
1.04 |
E2E_Evaluator_aws_cdk |
55828.19236783676 ns/iter |
55375.79753493889 ns/iter |
1.01 |
E2E_Evaluator_babelrc |
121406.82707910532 ns/iter |
119976.27549825971 ns/iter |
1.01 |
E2E_Evaluator_cerebrum_criminal_case |
1082032.27769124 ns/iter |
1078363.3843750807 ns/iter |
1.00 |
E2E_Evaluator_clang_format |
122073.33713888787 ns/iter |
120011.59503423948 ns/iter |
1.02 |
E2E_Evaluator_cmake_presets |
4681141.8175676605 ns/iter |
6293561.729999056 ns/iter |
0.74 |
E2E_Evaluator_code_climate |
193544.1167540827 ns/iter |
191717.6086956623 ns/iter |
1.01 |
E2E_Evaluator_cql2 |
230879.6687520444 ns/iter |
213526.03150338467 ns/iter |
1.08 |
E2E_Evaluator_cspell |
652472.7595526458 ns/iter |
635453.2126489808 ns/iter |
1.03 |
E2E_Evaluator_cypress |
202516.5017380907 ns/iter |
203211.17049086612 ns/iter |
1.00 |
E2E_Evaluator_deno |
336823.7317658459 ns/iter |
332653.40619046974 ns/iter |
1.01 |
E2E_Evaluator_dependabot |
344793.04583952035 ns/iter |
345711.54191032203 ns/iter |
1.00 |
E2E_Evaluator_draft_04 |
10292903.44444422 ns/iter |
9324174.820893683 ns/iter |
1.10 |
E2E_Evaluator_fabric_mod |
718299.2127657671 ns/iter |
712116.6056623124 ns/iter |
1.01 |
E2E_Evaluator_geojson |
17805344.12820345 ns/iter |
16925972.000005156 ns/iter |
1.05 |
E2E_Evaluator_gitpod_configuration |
247666.12247069707 ns/iter |
246167.32627558598 ns/iter |
1.01 |
E2E_Evaluator_helm_chart_lock |
324531.68474741746 ns/iter |
313606.1969026355 ns/iter |
1.03 |
E2E_Evaluator_importmap |
53583.07239082208 ns/iter |
50852.63753717413 ns/iter |
1.05 |
E2E_Evaluator_jasmine |
115282.81582403627 ns/iter |
114370.37465386048 ns/iter |
1.01 |
E2E_Evaluator_jshintrc |
1232538.933333129 ns/iter |
1228797.1239091295 ns/iter |
1.00 |
E2E_Evaluator_jsconfig |
449393.0614091507 ns/iter |
458221.6797175458 ns/iter |
0.98 |
E2E_Evaluator_krakend |
226729.97406803956 ns/iter |
224075.9072231487 ns/iter |
1.01 |
E2E_Evaluator_lazygit |
157726.66151089227 ns/iter |
152085.94725321932 ns/iter |
1.04 |
E2E_Evaluator_lerna |
153900.05673603754 ns/iter |
152214.93117055608 ns/iter |
1.01 |
E2E_Evaluator_nest_cli |
200019.48625675362 ns/iter |
200693.79696884664 ns/iter |
1.00 |
E2E_Evaluator_omc |
20438.81833910069 ns/iter |
19021.82038195923 ns/iter |
1.07 |
E2E_Evaluator_omnisharp |
627096.2800717122 ns/iter |
623797.2853285413 ns/iter |
1.01 |
E2E_Evaluator_openapi |
10269125.428568793 ns/iter |
11787367.879307944 ns/iter |
0.87 |
E2E_Evaluator_pre_commit_hooks |
500518.944687002 ns/iter |
501658.6619999543 ns/iter |
1.00 |
E2E_Evaluator_pulumi |
722937.350462322 ns/iter |
727998.6979166135 ns/iter |
0.99 |
E2E_Evaluator_semantic_release |
106439.29725677846 ns/iter |
105234.0596815048 ns/iter |
1.01 |
E2E_Evaluator_stale |
161115.65312718085 ns/iter |
159622.5742232847 ns/iter |
1.01 |
E2E_Evaluator_stylecop |
307387.93964389886 ns/iter |
299277.4476149814 ns/iter |
1.03 |
E2E_Evaluator_tmuxinator |
102457.18430629346 ns/iter |
104427.99400409148 ns/iter |
0.98 |
E2E_Evaluator_ui5 |
560360.4016128414 ns/iter |
542687.4024961959 ns/iter |
1.03 |
E2E_Evaluator_ui5_manifest |
2745756.2111559883 ns/iter |
2746760.4741041465 ns/iter |
1.00 |
E2E_Evaluator_unreal_engine_uproject |
457785.3892530272 ns/iter |
453457.48289221514 ns/iter |
1.01 |
E2E_Evaluator_users_array |
580949.5082372252 ns/iter |
577471.2642618162 ns/iter |
1.01 |
E2E_Evaluator_vercel |
332720.2245094008 ns/iter |
327732.1980244406 ns/iter |
1.02 |
E2E_Evaluator_yamllint |
9527.56286661863 ns/iter |
9385.616599647887 ns/iter |
1.02 |
JSONLD_Catalog |
60755049.454552464 ns/iter |
59089617.818182714 ns/iter |
1.03 |
Micro_Draft4_Meta_1_No_Callback |
194.19208890131785 ns/iter |
193.87433935655574 ns/iter |
1.00 |
Micro_Draft4_Required_Properties |
860.4168234883123 ns/iter |
863.9097099951255 ns/iter |
1.00 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
23.17074090263544 ns/iter |
23.25511433728479 ns/iter |
1.00 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
11.863782214031254 ns/iter |
11.875675959914949 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
280.4677098268912 ns/iter |
279.7229437488764 ns/iter |
1.00 |
Micro_Draft4_Nested_Object |
1.8138109597128322 ns/iter |
1.8262995834323879 ns/iter |
0.99 |
Micro_Draft4_Properties_Triad_Optional |
332.06701751532233 ns/iter |
333.49379189285304 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Closed |
272.2308719934895 ns/iter |
272.4198821417256 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Required |
352.2091884946547 ns/iter |
351.36206963169644 ns/iter |
1.00 |
Micro_Draft4_Properties_Closed |
60.278989970384025 ns/iter |
60.25651419688051 ns/iter |
1.00 |
Micro_Draft4_Non_Recursive_Ref |
14.471044045685234 ns/iter |
14.377632768864446 ns/iter |
1.01 |
Micro_Draft4_Pattern_Properties_True |
146.3590342934915 ns/iter |
146.39947985030958 ns/iter |
1.00 |
Micro_Draft4_Ref_To_Single_Property |
11.864869900572213 ns/iter |
11.86260080224745 ns/iter |
1.00 |
Micro_Draft4_Additional_Properties_Type |
33.595740904894974 ns/iter |
33.12720200271675 ns/iter |
1.01 |
Micro_Draft4_Nested_Oneof |
58.094811892875775 ns/iter |
57.92492638025203 ns/iter |
1.00 |
Micro_Draft4_Short_Enum |
9.979330568677693 ns/iter |
9.973872977174096 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
15.26254625759398 ns/iter |
16.551259424215647 ns/iter |
0.92 |
Micro_Draft4_Long_Enum_Short_Strings |
9.965462820579578 ns/iter |
9.978325295125405 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
3.6425398739586172 ns/iter |
3.432683492910305 ns/iter |
1.06 |
Micro_Draft4_Ref_Single_100 |
2386518.629251583 ns/iter |
2355736.4324323917 ns/iter |
1.01 |
Micro_Draft4_Compile_Ref_Many_Nested |
1739094.925373459 ns/iter |
1716415.161764956 ns/iter |
1.01 |
Micro_Draft4_Compile_Wrap |
2366170.417808275 ns/iter |
2325701.814569078 ns/iter |
1.02 |
Micro_Draft6_Property_Names |
126.96577099071398 ns/iter |
140.37929873662694 ns/iter |
0.90 |
Micro_Draft6_Compile_FHIR |
14740376241.99991 ns/iter |
14608172076.000074 ns/iter |
1.01 |
Micro_Draft7_If_Then_Else |
25.271965591727817 ns/iter |
25.01529511159226 ns/iter |
1.01 |
Micro_2019_09_Unevaluated_Properties |
25.99225589905459 ns/iter |
25.962720927405954 ns/iter |
1.00 |
Micro_2019_09_Compile_Wrap |
283426946.333293 ns/iter |
329923227.4999895 ns/iter |
0.86 |
Micro_2020_12_Dynamic_Ref |
709.0777640543665 ns/iter |
710.1103666779571 ns/iter |
1.00 |
Micro_2020_12_Dynamic_Ref_Single |
3.4242275655792844 ns/iter |
3.434022439259079 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
1069.1871144369927 ns/iter |
1072.7785430070385 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Annotations |
105357.98633461866 ns/iter |
105742.49058022727 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
11632609.450001989 ns/iter |
11732322.186439965 ns/iter |
0.99 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
986726.8934081811 ns/iter |
978526.0305556499 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8301.121001143427 ns/iter |
8343.98668640918 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
70476.14983077766 ns/iter |
70930.85226602812 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
22651.097593236944 ns/iter |
23705.062504262052 ns/iter |
0.96 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
144.09659804839515 ns/iter |
145.8438491648808 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4305.248368380563 ns/iter |
4289.89990330032 ns/iter |
1.00 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
367617710.5000988 ns/iter |
413074787.0000278 ns/iter |
0.89 |
Alterschema_Check_Readibility_OMC |
85941414.12501699 ns/iter |
88916390.00000851 ns/iter |
0.97 |
Alterschema_Check_Readibility_KrakenD |
1253984714.0001256 ns/iter |
1212479491.0000675 ns/iter |
1.03 |
Alterschema_Apply_Readibility_KrakenD |
116807027843.00002 ns/iter |
119237534393.00026 ns/iter |
0.98 |
Alterschema_Check_Invalid_External_Refs |
287073434.5000301 ns/iter |
288199617.00003207 ns/iter |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/llvm)
Details
| Benchmark suite | Current: 3c17eb9 | Previous: 326c94d | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
122120 ns |
119551 ns |
1.02 |
E2E_Evaluator_ansible-meta |
556317 ns |
532791 ns |
1.04 |
E2E_Evaluator_aws-cdk |
149621 ns |
150901 ns |
0.99 |
E2E_Evaluator_babelrc |
347179 ns |
365907 ns |
0.95 |
E2E_Evaluator_cerebrum-criminal-case |
2581554 ns |
2490662 ns |
1.04 |
E2E_Evaluator_clang-format |
266874 ns |
255502 ns |
1.04 |
E2E_Evaluator_cmake-presets |
19123569 ns |
19013133 ns |
1.01 |
E2E_Evaluator_code-climate |
551070 ns |
520235 ns |
1.06 |
E2E_Evaluator_cql2 |
1284658 ns |
1264084 ns |
1.02 |
E2E_Evaluator_cspell |
1546325 ns |
1503336 ns |
1.03 |
E2E_Evaluator_cypress |
786846 ns |
781807 ns |
1.01 |
E2E_Evaluator_deno |
1076919 ns |
1110892 ns |
0.97 |
E2E_Evaluator_dependabot |
1116165 ns |
1137287 ns |
0.98 |
E2E_Evaluator_draft-04 |
24168099 ns |
23590168 ns |
1.02 |
E2E_Evaluator_fabric-mod |
2355187 ns |
2457123 ns |
0.96 |
E2E_Evaluator_geojson |
24188691 ns |
24631494 ns |
0.98 |
E2E_Evaluator_gitpod-configuration |
720478 ns |
723356 ns |
1.00 |
E2E_Evaluator_helm-chart-lock |
1049395 ns |
994696 ns |
1.05 |
E2E_Evaluator_importmap |
269744 ns |
267705 ns |
1.01 |
E2E_Evaluator_jasmine |
304726 ns |
294144 ns |
1.04 |
E2E_Evaluator_jsconfig |
1270482 ns |
1281294 ns |
0.99 |
E2E_Evaluator_jshintrc |
2916580 ns |
2909006 ns |
1.00 |
E2E_Evaluator_krakend |
691794 ns |
682850 ns |
1.01 |
E2E_Evaluator_lazygit |
523780 ns |
500774 ns |
1.05 |
E2E_Evaluator_lerna |
479932 ns |
491624 ns |
0.98 |
E2E_Evaluator_nest-cli |
604160 ns |
620003 ns |
0.97 |
E2E_Evaluator_omc |
102469 ns |
99464 ns |
1.03 |
E2E_Evaluator_omnisharp |
1449296 ns |
1451611 ns |
1.00 |
E2E_Evaluator_openapi |
26608033 ns |
27410816 ns |
0.97 |
E2E_Evaluator_pre-commit-hooks |
1991782 ns |
2100743 ns |
0.95 |
E2E_Evaluator_pulumi |
1891805 ns |
1901706 ns |
0.99 |
E2E_Evaluator_semantic-release |
253176 ns |
256742 ns |
0.99 |
E2E_Evaluator_stale |
396384 ns |
396777 ns |
1.00 |
E2E_Evaluator_stylecop |
1268736 ns |
1257041 ns |
1.01 |
E2E_Evaluator_tmuxinator |
234706 ns |
233400 ns |
1.01 |
E2E_Evaluator_ui5 |
2275252 ns |
2208183 ns |
1.03 |
E2E_Evaluator_ui5-manifest |
12543083 ns |
11795541 ns |
1.06 |
E2E_Evaluator_unreal-engine-uproject |
1535619 ns |
1519789 ns |
1.01 |
E2E_Evaluator_users-array |
2866738 ns |
3190002 ns |
0.90 |
E2E_Evaluator_vercel |
978269 ns |
994738 ns |
0.98 |
E2E_Evaluator_yamllint |
25892 ns |
25868 ns |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: 3c17eb9 | Previous: 4abcf44 | Ratio |
|---|---|---|---|
Alterschema_Check_Readibility_ISO_Language_Set_3 |
407944318.4999718 ns/iter |
361982115.5000409 ns/iter |
1.13 |
Alterschema_Check_Readibility_OMC |
98415306.42857574 ns/iter |
99091928.14286272 ns/iter |
0.99 |
Alterschema_Check_Readibility_KrakenD |
1422063239.999943 ns/iter |
1411719825.000091 ns/iter |
1.01 |
Alterschema_Apply_Readibility_KrakenD |
127449882264.00005 ns/iter |
136635688453.00006 ns/iter |
0.93 |
Alterschema_Check_Invalid_External_Refs |
319224345.50006074 ns/iter |
284678896.0000595 ns/iter |
1.12 |
Micro_2020_12_Dynamic_Ref |
837.1403536382588 ns/iter |
825.3197522178807 ns/iter |
1.01 |
Micro_2020_12_Dynamic_Ref_Single |
4.3604490947931005 ns/iter |
4.589971460807352 ns/iter |
0.95 |
Micro_2020_12_Simple_Output_Mask |
1160.5020942277727 ns/iter |
1103.300507606202 ns/iter |
1.05 |
Micro_2020_12_Simple_Output_Annotations |
114706.28585444568 ns/iter |
102156.51929569997 ns/iter |
1.12 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
9885959.499999238 ns/iter |
15538911.266665107 ns/iter |
0.64 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1098098.0740158863 ns/iter |
1078893.9120372399 ns/iter |
1.02 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8999.65069655052 ns/iter |
8843.426458960608 ns/iter |
1.02 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
84951.39189189233 ns/iter |
164742.63754122434 ns/iter |
0.52 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
25849.62093794127 ns/iter |
26801.13686735424 ns/iter |
0.96 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
151.133081834514 ns/iter |
161.95350084958108 ns/iter |
0.93 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4761.693753555941 ns/iter |
4603.008658812874 ns/iter |
1.03 |
Micro_2019_09_Unevaluated_Properties |
29.976033631874632 ns/iter |
30.659594642162855 ns/iter |
0.98 |
Micro_2019_09_Compile_Wrap |
329077910.50001836 ns/iter |
308445110.49997437 ns/iter |
1.07 |
Micro_Draft7_If_Then_Else |
23.70170047484799 ns/iter |
25.255064461756845 ns/iter |
0.94 |
Micro_Draft6_Property_Names |
150.10892733243764 ns/iter |
159.8137130185512 ns/iter |
0.94 |
Micro_Draft6_Compile_FHIR |
16145288579.00018 ns/iter |
14239188093.999928 ns/iter |
1.13 |
Micro_Draft4_Meta_1_No_Callback |
176.33171269759924 ns/iter |
184.20159742037725 ns/iter |
0.96 |
Micro_Draft4_Required_Properties |
902.404748348629 ns/iter |
905.6999028704915 ns/iter |
1.00 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
21.943676285747255 ns/iter |
22.175480177325213 ns/iter |
0.99 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
15.581947012532043 ns/iter |
16.202676871200172 ns/iter |
0.96 |
Micro_Draft4_Items_Schema |
341.2575413342728 ns/iter |
296.61563141191056 ns/iter |
1.15 |
Micro_Draft4_Nested_Object |
1.5593318768754456 ns/iter |
2.4618341321696695 ns/iter |
0.63 |
Micro_Draft4_Properties_Triad_Optional |
375.42274649541486 ns/iter |
502.297168000041 ns/iter |
0.75 |
Micro_Draft4_Properties_Triad_Closed |
309.7607037387774 ns/iter |
431.92023184495196 ns/iter |
0.72 |
Micro_Draft4_Properties_Triad_Required |
399.9912785252204 ns/iter |
495.2453000079094 ns/iter |
0.81 |
Micro_Draft4_Properties_Closed |
63.60522846522833 ns/iter |
65.01751253930946 ns/iter |
0.98 |
Micro_Draft4_Non_Recursive_Ref |
9.025642762709973 ns/iter |
9.152069218725789 ns/iter |
0.99 |
Micro_Draft4_Pattern_Properties_True |
206.87720935556746 ns/iter |
196.01496961699192 ns/iter |
1.06 |
Micro_Draft4_Ref_To_Single_Property |
15.60263598005366 ns/iter |
16.198479884182962 ns/iter |
0.96 |
Micro_Draft4_Additional_Properties_Type |
14.321240758894414 ns/iter |
15.142125177533963 ns/iter |
0.95 |
Micro_Draft4_Nested_Oneof |
63.51326881385304 ns/iter |
65.08293145732472 ns/iter |
0.98 |
Micro_Draft4_Short_Enum |
14.641947047416723 ns/iter |
14.558408155757313 ns/iter |
1.01 |
Micro_Draft4_Long_Enum |
13.397728276383644 ns/iter |
13.018578010769465 ns/iter |
1.03 |
Micro_Draft4_Long_Enum_Short_Strings |
14.642905763194781 ns/iter |
14.500889294582883 ns/iter |
1.01 |
Micro_Draft4_Type_Object |
4.359066280418608 ns/iter |
4.9234812421459635 ns/iter |
0.89 |
Micro_Draft4_Ref_Single_100 |
2468831.865724323 ns/iter |
2433289.097222118 ns/iter |
1.01 |
Micro_Draft4_Compile_Ref_Many_Nested |
1799214.5629818586 ns/iter |
1803921.5386596008 ns/iter |
1.00 |
Micro_Draft4_Compile_Wrap |
2584251.2610293007 ns/iter |
2563985.6131390072 ns/iter |
1.01 |
JSONLD_Catalog |
67397676.69998856 ns/iter |
60132861.50000568 ns/iter |
1.12 |
E2E_Compiler_adaptivecard |
66447553.45452971 ns/iter |
62622903.24999261 ns/iter |
1.06 |
E2E_Compiler_ansible_meta |
27938415.200005695 ns/iter |
27782801.920002386 ns/iter |
1.01 |
E2E_Compiler_aws_cdk |
374526.3768737011 ns/iter |
351824.50622824416 ns/iter |
1.06 |
E2E_Compiler_babelrc |
2558812.4891300327 ns/iter |
2529589.714801564 ns/iter |
1.01 |
E2E_Compiler_clang_format |
17846228.53846229 ns/iter |
17584152.25000363 ns/iter |
1.01 |
E2E_Compiler_cmake_presets |
28250511.319993168 ns/iter |
27230208.269228432 ns/iter |
1.04 |
E2E_Compiler_code_climate |
2544336.7472529802 ns/iter |
2544255.4036362707 ns/iter |
1.00 |
E2E_Compiler_cql2 |
14427713.87755041 ns/iter |
14035799.539997242 ns/iter |
1.03 |
E2E_Compiler_cspell |
24454379.999998968 ns/iter |
24141045.689655833 ns/iter |
1.01 |
E2E_Compiler_cypress |
4092746.563953877 ns/iter |
4112518.1529410193 ns/iter |
1.00 |
E2E_Compiler_deno |
7794177.211111572 ns/iter |
7785573.833333123 ns/iter |
1.00 |
E2E_Compiler_dependabot |
3825925.7472533477 ns/iter |
3847344.428571298 ns/iter |
0.99 |
E2E_Compiler_draft_04 |
2733472.2829458094 ns/iter |
2706501.7635656004 ns/iter |
1.01 |
E2E_Compiler_fabric_mod |
4641460.271522198 ns/iter |
4725188.18000026 ns/iter |
0.98 |
E2E_Compiler_geojson |
22565096.75000018 ns/iter |
22479438.54838248 ns/iter |
1.00 |
E2E_Compiler_gitpod_configuration |
4951395.035210277 ns/iter |
4919308.104894349 ns/iter |
1.01 |
E2E_Compiler_helm_chart_lock |
672326.9496612373 ns/iter |
639369.7186932412 ns/iter |
1.05 |
E2E_Compiler_importmap |
277677.8010347086 ns/iter |
257265.5983156508 ns/iter |
1.08 |
E2E_Compiler_jasmine |
1349069.104247461 ns/iter |
1329734.1650854186 ns/iter |
1.01 |
E2E_Compiler_jshintrc |
4206048.37724519 ns/iter |
4107200.600000236 ns/iter |
1.02 |
E2E_Compiler_jsconfig |
21431557.121214803 ns/iter |
21426075.66667142 ns/iter |
1.00 |
E2E_Compiler_krakend |
155745425.50001526 ns/iter |
139797852.80002943 ns/iter |
1.11 |
E2E_Compiler_lazygit |
33374993.238090783 ns/iter |
33366740.571431194 ns/iter |
1.00 |
E2E_Compiler_lerna |
1584525.864559848 ns/iter |
1559291.3513514432 ns/iter |
1.02 |
E2E_Compiler_nest_cli |
7306480.4791656 ns/iter |
7262089.873685048 ns/iter |
1.01 |
E2E_Compiler_omc |
177273836.24998084 ns/iter |
166685809.99998996 ns/iter |
1.06 |
E2E_Compiler_omnisharp |
6462692.256881291 ns/iter |
6472870.750001305 ns/iter |
1.00 |
E2E_Compiler_openapi |
25847504.33333351 ns/iter |
25244294.750003908 ns/iter |
1.02 |
E2E_Compiler_pre_commit_hooks |
5095469.664233628 ns/iter |
5091441.956203836 ns/iter |
1.00 |
E2E_Compiler_pulumi |
4008762.8514291802 ns/iter |
3956111.039772478 ns/iter |
1.01 |
E2E_Compiler_semantic_release |
1546453.1106193988 ns/iter |
1509333.0799139729 ns/iter |
1.02 |
E2E_Compiler_stale |
1541596.7704196395 ns/iter |
1515990.069414124 ns/iter |
1.02 |
E2E_Compiler_stylecop |
5621904.77600052 ns/iter |
5673621.2276430195 ns/iter |
0.99 |
E2E_Compiler_tmuxinator |
1895541.3972975833 ns/iter |
1864890.696808477 ns/iter |
1.02 |
E2E_Compiler_ui5 |
51389916.78571918 ns/iter |
49672353.500000104 ns/iter |
1.03 |
E2E_Compiler_ui5_manifest |
346102873.5000582 ns/iter |
324270645.5000644 ns/iter |
1.07 |
E2E_Compiler_unreal_engine_uproject |
4476158.133758154 ns/iter |
4467190.617834562 ns/iter |
1.00 |
E2E_Compiler_users_array |
883137.8519447836 ns/iter |
861889.7097170174 ns/iter |
1.02 |
E2E_Compiler_vercel |
12948446.499998916 ns/iter |
12835496.870370325 ns/iter |
1.01 |
E2E_Compiler_yamllint |
347672.226368233 ns/iter |
325677.9976776745 ns/iter |
1.07 |
E2E_Evaluator_adaptivecard |
25765.137713173168 ns/iter |
25489.25989235333 ns/iter |
1.01 |
E2E_Evaluator_ansible_meta |
282475.4943042796 ns/iter |
261946.14339199377 ns/iter |
1.08 |
E2E_Evaluator_aws_cdk |
63366.32756776554 ns/iter |
59531.0279858382 ns/iter |
1.06 |
E2E_Evaluator_babelrc |
121251.62384222091 ns/iter |
99307.46177715893 ns/iter |
1.22 |
E2E_Evaluator_cerebrum_criminal_case |
1194717.101522722 ns/iter |
1184610.2338984688 ns/iter |
1.01 |
E2E_Evaluator_clang_format |
113168.18581191616 ns/iter |
97195.36398999124 ns/iter |
1.16 |
E2E_Evaluator_cmake_presets |
6150238.391303546 ns/iter |
5101807.413043587 ns/iter |
1.21 |
E2E_Evaluator_code_climate |
230704.56088802754 ns/iter |
199713.56457245207 ns/iter |
1.16 |
E2E_Evaluator_cql2 |
224295.94839123634 ns/iter |
208835.56276147586 ns/iter |
1.07 |
E2E_Evaluator_cspell |
633545.9487871347 ns/iter |
578974.6677796931 ns/iter |
1.09 |
E2E_Evaluator_cypress |
189898.3891625528 ns/iter |
156451.6617977614 ns/iter |
1.21 |
E2E_Evaluator_deno |
361984.4968420694 ns/iter |
296099.30180567416 ns/iter |
1.22 |
E2E_Evaluator_dependabot |
388728.25123967946 ns/iter |
365957.0939809135 ns/iter |
1.06 |
E2E_Evaluator_draft_04 |
10622376.200000454 ns/iter |
10575207.377050007 ns/iter |
1.00 |
E2E_Evaluator_fabric_mod |
800338.1179136971 ns/iter |
755404.9405941998 ns/iter |
1.06 |
E2E_Evaluator_geojson |
17954981.675001137 ns/iter |
20206661.888892084 ns/iter |
0.89 |
E2E_Evaluator_gitpod_configuration |
276823.22473665647 ns/iter |
239504.84769121447 ns/iter |
1.16 |
E2E_Evaluator_helm_chart_lock |
335533.1836448352 ns/iter |
222120.02578983374 ns/iter |
1.51 |
E2E_Evaluator_importmap |
48832.484957635854 ns/iter |
41162.543987752855 ns/iter |
1.19 |
E2E_Evaluator_jasmine |
128133.20812088688 ns/iter |
119039.40319428839 ns/iter |
1.08 |
E2E_Evaluator_jshintrc |
1108721.453396655 ns/iter |
1049516.400000054 ns/iter |
1.06 |
E2E_Evaluator_jsconfig |
444581.38240912516 ns/iter |
405427.47004067036 ns/iter |
1.10 |
E2E_Evaluator_krakend |
222281.8297067221 ns/iter |
197312.1472222298 ns/iter |
1.13 |
E2E_Evaluator_lazygit |
150973.79540981667 ns/iter |
130698.47449740293 ns/iter |
1.16 |
E2E_Evaluator_lerna |
172274.76217412582 ns/iter |
137081.1583432567 ns/iter |
1.26 |
E2E_Evaluator_nest_cli |
212628.30582960407 ns/iter |
194639.47539615797 ns/iter |
1.09 |
E2E_Evaluator_omc |
19449.289413211405 ns/iter |
18463.703883369453 ns/iter |
1.05 |
E2E_Evaluator_omnisharp |
575937.4645215236 ns/iter |
550459.5712000082 ns/iter |
1.05 |
E2E_Evaluator_openapi |
13716429.117645627 ns/iter |
13379489.939998167 ns/iter |
1.03 |
E2E_Evaluator_pre_commit_hooks |
559211.1278976479 ns/iter |
498220.6929191512 ns/iter |
1.12 |
E2E_Evaluator_pulumi |
804797.9191344299 ns/iter |
781361.6534091042 ns/iter |
1.03 |
E2E_Evaluator_semantic_release |
109075.13381382919 ns/iter |
90746.03998430069 ns/iter |
1.20 |
E2E_Evaluator_stale |
173371.37354473284 ns/iter |
172141.53594928922 ns/iter |
1.01 |
E2E_Evaluator_stylecop |
328260.88382897706 ns/iter |
299246.8736431168 ns/iter |
1.10 |
E2E_Evaluator_tmuxinator |
113692.63141698421 ns/iter |
98177.19465123561 ns/iter |
1.16 |
E2E_Evaluator_ui5 |
605699.3651488377 ns/iter |
559388.699278249 ns/iter |
1.08 |
E2E_Evaluator_ui5_manifest |
4536838.478787269 ns/iter |
2905679.117154695 ns/iter |
1.56 |
E2E_Evaluator_unreal_engine_uproject |
501350.62662809016 ns/iter |
459736.6228956303 ns/iter |
1.09 |
E2E_Evaluator_users_array |
846870.6103403599 ns/iter |
689427.0480480209 ns/iter |
1.23 |
E2E_Evaluator_vercel |
372938.0966542783 ns/iter |
283827.7866176874 ns/iter |
1.31 |
E2E_Evaluator_yamllint |
12761.611028480687 ns/iter |
12343.150604430908 ns/iter |
1.03 |
Schema_Format_ISO_Language_To_JSON |
120166064.8332563 ns/iter |
114855738.16662508 ns/iter |
1.05 |
Schema_Bundle_Meta_2020_12 |
1768341.4436029799 ns/iter |
1720137.6658503131 ns/iter |
1.03 |
Schema_Frame_WoT_References |
5252431.865671239 ns/iter |
5203782.507463196 ns/iter |
1.01 |
Schema_Frame_OMC_References |
24591949.67856807 ns/iter |
23603075.45161284 ns/iter |
1.04 |
Schema_Frame_OMC_Locations |
22436533.54838487 ns/iter |
21577734.999993935 ns/iter |
1.04 |
Schema_Frame_ISO_Language_Locations |
108704742.00002414 ns/iter |
106365193.00000405 ns/iter |
1.02 |
Schema_Frame_KrakenD_References |
44993203.62499759 ns/iter |
42529810.29411358 ns/iter |
1.06 |
Schema_Frame_KrakenD_Reachable |
644078080.9998614 ns/iter |
610679164.999965 ns/iter |
1.05 |
Schema_Frame_ISO_Language_Locations_To_JSON |
185753234.00000343 ns/iter |
177104546.25000694 ns/iter |
1.05 |
Schema_Frame_Many_Resources_References |
395396430.49999994 ns/iter |
382125141.9999499 ns/iter |
1.03 |
Schema_Iterator_ISO_Language |
4287182.484471973 ns/iter |
3798716.4615380284 ns/iter |
1.13 |
Schema_Tracker_ISO_Language |
5533436.01562517 ns/iter |
5389127.523438119 ns/iter |
1.03 |
Schema_Tracker_ISO_Language_To_JSON |
28318672.92000425 ns/iter |
26548997.53846306 ns/iter |
1.07 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/gcc)
Details
| Benchmark suite | Current: 3c17eb9 | Previous: 4abcf44 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
133692 ns |
120136 ns |
1.11 |
E2E_Evaluator_ansible-meta |
549671 ns |
545564 ns |
1.01 |
E2E_Evaluator_aws-cdk |
156861 ns |
129323 ns |
1.21 |
E2E_Evaluator_babelrc |
371974 ns |
345015 ns |
1.08 |
E2E_Evaluator_cerebrum-criminal-case |
3314834 ns |
2685992 ns |
1.23 |
E2E_Evaluator_clang-format |
277288 ns |
261966 ns |
1.06 |
E2E_Evaluator_cmake-presets |
24391574 ns |
18562042 ns |
1.31 |
E2E_Evaluator_code-climate |
540713 ns |
496459 ns |
1.09 |
E2E_Evaluator_cql2 |
1307783 ns |
1224948 ns |
1.07 |
E2E_Evaluator_cspell |
1643748 ns |
1629292 ns |
1.01 |
E2E_Evaluator_cypress |
801643 ns |
826197 ns |
0.97 |
E2E_Evaluator_deno |
1069344 ns |
1072745 ns |
1.00 |
E2E_Evaluator_dependabot |
1163660 ns |
1138175 ns |
1.02 |
E2E_Evaluator_draft-04 |
22720053 ns |
21911960 ns |
1.04 |
E2E_Evaluator_fabric-mod |
2609052 ns |
2476255 ns |
1.05 |
E2E_Evaluator_geojson |
23228130 ns |
25734733 ns |
0.90 |
E2E_Evaluator_gitpod-configuration |
754175 ns |
726427 ns |
1.04 |
E2E_Evaluator_helm-chart-lock |
989498 ns |
996111 ns |
0.99 |
E2E_Evaluator_importmap |
274105 ns |
261385 ns |
1.05 |
E2E_Evaluator_jasmine |
300636 ns |
281708 ns |
1.07 |
E2E_Evaluator_jsconfig |
1273154 ns |
1489071 ns |
0.85 |
E2E_Evaluator_jshintrc |
2785675 ns |
2869081 ns |
0.97 |
E2E_Evaluator_krakend |
683138 ns |
650496 ns |
1.05 |
E2E_Evaluator_lazygit |
519127 ns |
459901 ns |
1.13 |
E2E_Evaluator_lerna |
463472 ns |
446110 ns |
1.04 |
E2E_Evaluator_nest-cli |
624619 ns |
607235 ns |
1.03 |
E2E_Evaluator_omc |
97335 ns |
96836 ns |
1.01 |
E2E_Evaluator_omnisharp |
1432451 ns |
1470251 ns |
0.97 |
E2E_Evaluator_openapi |
27405182 ns |
25701388 ns |
1.07 |
E2E_Evaluator_pre-commit-hooks |
2213701 ns |
2082040 ns |
1.06 |
E2E_Evaluator_pulumi |
1983921 ns |
2049915 ns |
0.97 |
E2E_Evaluator_semantic-release |
264466 ns |
223850 ns |
1.18 |
E2E_Evaluator_stale |
408900 ns |
373641 ns |
1.09 |
E2E_Evaluator_stylecop |
1242289 ns |
1199769 ns |
1.04 |
E2E_Evaluator_tmuxinator |
244386 ns |
220655 ns |
1.11 |
E2E_Evaluator_ui5 |
2455948 ns |
2219983 ns |
1.11 |
E2E_Evaluator_ui5-manifest |
14955151 ns |
10782033 ns |
1.39 |
E2E_Evaluator_unreal-engine-uproject |
1544751 ns |
1616442 ns |
0.96 |
E2E_Evaluator_users-array |
4550195 ns |
2902147 ns |
1.57 |
E2E_Evaluator_vercel |
994559 ns |
1057806 ns |
0.94 |
E2E_Evaluator_yamllint |
26312 ns |
23896 ns |
1.10 |
This comment was automatically generated by workflow using github-action-benchmark.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com