Better distinguish between invalid or missing schema linter titles#634
Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
🤖 Augment PR SummarySummary: This PR improves schema linter rule-title diagnostics by separating “missing title” from “invalid title”. 🤖 Was this summary useful? React with 👍 or 👎 |
| #endif | ||
|
|
||
| /// @ingroup linter | ||
| /// An error that represents a missing rule name |
There was a problem hiding this comment.
The docstring says this is a “missing rule name”, but the error is specifically about a missing schema title (and what() also says “title”); consider aligning the terminology so the public API/docs/message are consistent.
Severity: low
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
| throw LinterInvalidNameError( | ||
| "", "The schema rule title is missing or not a string"); | ||
| if (!schema.defines("title")) { | ||
| throw LinterMissingNameError{}; |
There was a problem hiding this comment.
This changes the exception type for a missing title from LinterInvalidNameError to LinterMissingNameError; consider whether any existing callers (outside tests) rely on catching LinterInvalidNameError for this case.
Severity: medium
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
| if (!schema.at("title").is_string()) { | ||
| std::ostringstream result; | ||
| sourcemeta::core::stringify(schema.at("title"), result); | ||
| throw LinterInvalidNameError(std::move(result).str(), |
There was a problem hiding this comment.
For non-string title values, LinterInvalidNameError::identifier() will now carry a stringified JSON value (previously it was empty); consider whether this observable behavior change should be documented and/or locked in via a test assertion.
Severity: low
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: 9f475e7 | Previous: e520223 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
60154018.555560164 ns/iter |
84534481.44444388 ns/iter |
0.71 |
E2E_Compiler_ansible_meta |
22247228.48387178 ns/iter |
34865085.39999704 ns/iter |
0.64 |
E2E_Compiler_aws_cdk |
350358.36273941235 ns/iter |
525545.2124412602 ns/iter |
0.67 |
E2E_Compiler_babelrc |
2136448.2275446076 ns/iter |
3619592.0125000686 ns/iter |
0.59 |
E2E_Compiler_clang_format |
14075601.294117477 ns/iter |
17629266.222223174 ns/iter |
0.80 |
E2E_Compiler_cmake_presets |
26637036.458334744 ns/iter |
33393125.000002112 ns/iter |
0.80 |
E2E_Compiler_code_climate |
2175494.624633466 ns/iter |
2617862.48351643 ns/iter |
0.83 |
E2E_Compiler_cql2 |
12531111.122807726 ns/iter |
15232784.160000391 ns/iter |
0.82 |
E2E_Compiler_cspell |
22184159.73333473 ns/iter |
24814196.42856914 ns/iter |
0.89 |
E2E_Compiler_cypress |
4000189.73446313 ns/iter |
5166791.12418319 ns/iter |
0.77 |
E2E_Compiler_deno |
6946775.350515448 ns/iter |
6763742.29347788 ns/iter |
1.03 |
E2E_Compiler_dependabot |
3441594.864077571 ns/iter |
3422061.480392256 ns/iter |
1.01 |
E2E_Compiler_draft_04 |
2005567.5207755645 ns/iter |
1996588.3111113827 ns/iter |
1.00 |
E2E_Compiler_fabric_mod |
3748663.4615386436 ns/iter |
3854762.096774457 ns/iter |
0.97 |
E2E_Compiler_geojson |
23074694.466667246 ns/iter |
24044695.833333664 ns/iter |
0.96 |
E2E_Compiler_gitpod_configuration |
4150145.4678357025 ns/iter |
4167000.939849158 ns/iter |
1.00 |
E2E_Compiler_helm_chart_lock |
553350.283901663 ns/iter |
565448.0030143813 ns/iter |
0.98 |
E2E_Compiler_importmap |
246480.73959066195 ns/iter |
264933.817866749 ns/iter |
0.93 |
E2E_Compiler_jasmine |
1074480.6395760048 ns/iter |
1080349.2614677495 ns/iter |
0.99 |
E2E_Compiler_jshintrc |
3135022.1238934523 ns/iter |
3084774.7156861247 ns/iter |
1.02 |
E2E_Compiler_jsconfig |
18755748.921050422 ns/iter |
18944093.1842096 ns/iter |
0.99 |
E2E_Compiler_krakend |
165997656.2499992 ns/iter |
173080072.99999416 ns/iter |
0.96 |
E2E_Compiler_lazygit |
46914579.38095244 ns/iter |
40362859.63158399 ns/iter |
1.16 |
E2E_Compiler_lerna |
1982479.730769306 ns/iter |
1749990.7601809993 ns/iter |
1.13 |
E2E_Compiler_nest_cli |
6372284.78260864 ns/iter |
7153023.047059083 ns/iter |
0.89 |
E2E_Compiler_omc |
174791583.3333309 ns/iter |
211027985.9999764 ns/iter |
0.83 |
E2E_Compiler_omnisharp |
6064134.615385189 ns/iter |
6773259.256410089 ns/iter |
0.90 |
E2E_Compiler_openapi |
22846235.687499218 ns/iter |
26758098.599998448 ns/iter |
0.85 |
E2E_Compiler_pre_commit_hooks |
5651581.639534433 ns/iter |
5114870.419999988 ns/iter |
1.10 |
E2E_Compiler_pulumi |
4370394.982455956 ns/iter |
3977535.2544379444 ns/iter |
1.10 |
E2E_Compiler_semantic_release |
1490982.7610617324 ns/iter |
1543365.621809805 ns/iter |
0.97 |
E2E_Compiler_stale |
1515851.4897579495 ns/iter |
1455209.2181466678 ns/iter |
1.04 |
E2E_Compiler_stylecop |
5587749.389705972 ns/iter |
5219408.452554642 ns/iter |
1.07 |
E2E_Compiler_tmuxinator |
1797339.2857142617 ns/iter |
1565000.1873590664 ns/iter |
1.15 |
E2E_Compiler_ui5 |
57177441.600003935 ns/iter |
60434621.18181899 ns/iter |
0.95 |
E2E_Compiler_ui5_manifest |
342400207.99995816 ns/iter |
331986437.50000656 ns/iter |
1.03 |
E2E_Compiler_unreal_engine_uproject |
3647428.39195999 ns/iter |
3802876.105960452 ns/iter |
0.96 |
E2E_Compiler_vercel |
13626773.93616979 ns/iter |
13531852.629628077 ns/iter |
1.01 |
E2E_Compiler_yamllint |
308981.907511948 ns/iter |
303898.0925846747 ns/iter |
1.02 |
E2E_Evaluator_adaptivecard |
23644.60801909048 ns/iter |
24744.82193420359 ns/iter |
0.96 |
E2E_Evaluator_ansible_meta |
211315.92677595056 ns/iter |
201819.2185777186 ns/iter |
1.05 |
E2E_Evaluator_aws_cdk |
50106.978633663864 ns/iter |
60483.372460800245 ns/iter |
0.83 |
E2E_Evaluator_babelrc |
112838.32032378628 ns/iter |
146762.27402334235 ns/iter |
0.77 |
E2E_Evaluator_cerebrum_criminal_case |
1161136.9153976082 ns/iter |
1612228.706237469 ns/iter |
0.72 |
E2E_Evaluator_clang_format |
126478.65972010541 ns/iter |
145592.2992957688 ns/iter |
0.87 |
E2E_Evaluator_cmake_presets |
4787608.660130662 ns/iter |
5610885.880596911 ns/iter |
0.85 |
E2E_Evaluator_code_climate |
198151.32526139592 ns/iter |
269947.9894941576 ns/iter |
0.73 |
E2E_Evaluator_cql2 |
196713.83333333442 ns/iter |
356299.0472019475 ns/iter |
0.55 |
E2E_Evaluator_cspell |
484672.6778711685 ns/iter |
795073.6178451079 ns/iter |
0.61 |
E2E_Evaluator_cypress |
153433.11720065653 ns/iter |
264225.84269661363 ns/iter |
0.58 |
E2E_Evaluator_deno |
267943.0999646769 ns/iter |
333969.39561486663 ns/iter |
0.80 |
E2E_Evaluator_dependabot |
418299.1697416751 ns/iter |
417025.5272152022 ns/iter |
1.00 |
E2E_Evaluator_draft_04 |
6858960.9527559625 ns/iter |
5949447.8105271375 ns/iter |
1.15 |
E2E_Evaluator_fabric_mod |
605792.1940928205 ns/iter |
1058659.7225086153 ns/iter |
0.57 |
E2E_Evaluator_geojson |
22030455.12820632 ns/iter |
36547744.565214284 ns/iter |
0.60 |
E2E_Evaluator_gitpod_configuration |
207397.16374450384 ns/iter |
328054.42007266165 ns/iter |
0.63 |
E2E_Evaluator_helm_chart_lock |
341801.92176039785 ns/iter |
436801.94498190307 ns/iter |
0.78 |
E2E_Evaluator_importmap |
56964.843166537044 ns/iter |
71389.70205505687 ns/iter |
0.80 |
E2E_Evaluator_jasmine |
145891.80284410555 ns/iter |
182542.72151898572 ns/iter |
0.80 |
E2E_Evaluator_jshintrc |
1106582.7988588584 ns/iter |
1542362.3345323452 ns/iter |
0.72 |
E2E_Evaluator_jsconfig |
410401.8755129669 ns/iter |
669756.2499999775 ns/iter |
0.61 |
E2E_Evaluator_krakend |
213277.3548728801 ns/iter |
236507.98709473803 ns/iter |
0.90 |
E2E_Evaluator_lazygit |
125625.12602348265 ns/iter |
179053.2262935208 ns/iter |
0.70 |
E2E_Evaluator_lerna |
183337.58411682444 ns/iter |
180393.75231316712 ns/iter |
1.02 |
E2E_Evaluator_nest_cli |
186989.59447980305 ns/iter |
218539.68978101964 ns/iter |
0.86 |
E2E_Evaluator_omc |
18079.121611546216 ns/iter |
26419.505109174555 ns/iter |
0.68 |
E2E_Evaluator_omnisharp |
469391.46614584833 ns/iter |
638406.3464505769 ns/iter |
0.74 |
E2E_Evaluator_openapi |
9229060.081395347 ns/iter |
11618166.661764583 ns/iter |
0.79 |
E2E_Evaluator_pre_commit_hooks |
484812.12985570316 ns/iter |
491347.5094508654 ns/iter |
0.99 |
E2E_Evaluator_pulumi |
771273.8341708103 ns/iter |
889053.2670455608 ns/iter |
0.87 |
E2E_Evaluator_semantic_release |
111007.36119756947 ns/iter |
156075.63814832873 ns/iter |
0.71 |
E2E_Evaluator_stale |
142768.28768987168 ns/iter |
187544.81591754174 ns/iter |
0.76 |
E2E_Evaluator_stylecop |
272736.4119732046 ns/iter |
347066.45370761654 ns/iter |
0.79 |
E2E_Evaluator_tmuxinator |
96302.07095159314 ns/iter |
112283.24370861083 ns/iter |
0.86 |
E2E_Evaluator_ui5 |
481505.1055241334 ns/iter |
648454.9169999809 ns/iter |
0.74 |
E2E_Evaluator_ui5_manifest |
2171151.308157264 ns/iter |
2455633.9285713388 ns/iter |
0.88 |
E2E_Evaluator_unreal_engine_uproject |
404272.26462237426 ns/iter |
439083.81203515275 ns/iter |
0.92 |
E2E_Evaluator_vercel |
252598.04080919945 ns/iter |
317439.90283054387 ns/iter |
0.80 |
E2E_Evaluator_yamllint |
12826.550453630554 ns/iter |
14293.682727328083 ns/iter |
0.90 |
Micro_Draft4_Meta_1_No_Callback |
171.0814030178796 ns/iter |
181.6140605063236 ns/iter |
0.94 |
Micro_Draft4_Required_Properties |
707.7538890504691 ns/iter |
717.1006934239814 ns/iter |
0.99 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
21.65367297090677 ns/iter |
21.764178985498837 ns/iter |
0.99 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
11.941144048487036 ns/iter |
11.829744962181813 ns/iter |
1.01 |
Micro_Draft4_Items_Schema |
490.22396335411463 ns/iter |
473.9375156209175 ns/iter |
1.03 |
Micro_Draft4_Nested_Object |
3.094547734711414 ns/iter |
2.7809003629390934 ns/iter |
1.11 |
Micro_Draft4_Properties_Triad_Optional |
286.10603462047874 ns/iter |
306.9495393234708 ns/iter |
0.93 |
Micro_Draft4_Properties_Triad_Closed |
261.3027520313316 ns/iter |
228.70460117937446 ns/iter |
1.14 |
Micro_Draft4_Properties_Triad_Required |
333.63308293385063 ns/iter |
310.70381495658205 ns/iter |
1.07 |
Micro_Draft4_Properties_Closed |
50.671362499997485 ns/iter |
55.38934126101469 ns/iter |
0.91 |
Micro_Draft4_Non_Recursive_Ref |
25.450461044049575 ns/iter |
24.421373872165162 ns/iter |
1.04 |
Micro_Draft4_Pattern_Properties_True |
178.39005934304075 ns/iter |
174.8923023791445 ns/iter |
1.02 |
Micro_Draft4_Ref_To_Single_Property |
13.772753016817429 ns/iter |
15.378487541333698 ns/iter |
0.90 |
Micro_Draft4_Additional_Properties_Type |
43.85352695759152 ns/iter |
57.171064283241954 ns/iter |
0.77 |
Micro_Draft4_Nested_Oneof |
64.89000746217978 ns/iter |
66.94036359097366 ns/iter |
0.97 |
Micro_Draft4_Short_Enum |
9.39133767937742 ns/iter |
11.981179977206967 ns/iter |
0.78 |
Micro_Draft4_Long_Enum |
13.97176552198229 ns/iter |
18.598535077952377 ns/iter |
0.75 |
Micro_Draft4_Long_Enum_Short_Strings |
10.248249003881025 ns/iter |
12.327314903739495 ns/iter |
0.83 |
Micro_Draft4_Type_Object |
5.7475766015634795 ns/iter |
7.51532323567119 ns/iter |
0.76 |
Micro_Draft4_Ref_Single_100 |
1739637.0000000163 ns/iter |
2133219.2138888533 ns/iter |
0.82 |
Micro_Draft4_Compile_Ref_Many_Nested |
1332193.9756554726 ns/iter |
1429692.8528676718 ns/iter |
0.93 |
Micro_Draft4_Compile_Wrap |
2134504.7425149903 ns/iter |
2209776.848591811 ns/iter |
0.97 |
Micro_Draft6_Property_Names |
102.94057739764747 ns/iter |
107.8114076093165 ns/iter |
0.95 |
Micro_Draft6_Compile_FHIR |
9770191167.000008 ns/iter |
12076395208.000008 ns/iter |
0.81 |
Micro_Draft7_If_Then_Else |
29.66140318454631 ns/iter |
36.82484002019581 ns/iter |
0.81 |
Micro_2019_09_Unevaluated_Properties |
37.69407115166712 ns/iter |
43.39601868097461 ns/iter |
0.87 |
Micro_2019_09_Compile_Wrap |
299485666.999999 ns/iter |
365557437.5000015 ns/iter |
0.82 |
Micro_2019_09_KrakenD_Linter_Check |
693689875.0000182 ns/iter |
884861666.9999956 ns/iter |
0.78 |
Micro_2019_09_KrakenD_Linter_Apply |
6497683415.999972 ns/iter |
7285815165.999907 ns/iter |
0.89 |
Micro_2020_12_Dynamic_Ref |
295.74112388757806 ns/iter |
256.8496800715724 ns/iter |
1.15 |
Micro_2020_12_Dynamic_Ref_Single |
5.806100826109351 ns/iter |
5.9289136871951555 ns/iter |
0.98 |
Micro_2020_12_Simple_Output_Mask |
142715.4869295618 ns/iter |
148723.10154440894 ns/iter |
0.96 |
Micro_2020_12_Simple_Output_Annotations |
158168.90645503066 ns/iter |
222760.1125191967 ns/iter |
0.71 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
847952.9339853947 ns/iter |
1415849.2271973372 ns/iter |
0.60 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: 9f475e7 | Previous: e520223 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
68639911.1249969 ns/iter |
62829204.50000234 ns/iter |
1.09 |
E2E_Compiler_ansible_meta |
28114205.96000062 ns/iter |
27345552.961538017 ns/iter |
1.03 |
E2E_Compiler_aws_cdk |
471080.653846152 ns/iter |
471923.94362413866 ns/iter |
1.00 |
E2E_Compiler_babelrc |
2567598.9779411666 ns/iter |
2548892.672727189 ns/iter |
1.01 |
E2E_Compiler_clang_format |
17811345.717948604 ns/iter |
17302522.219513156 ns/iter |
1.03 |
E2E_Compiler_cmake_presets |
27775826.23077006 ns/iter |
25201140.035712957 ns/iter |
1.10 |
E2E_Compiler_code_climate |
2553762.959706878 ns/iter |
2537741.1268115556 ns/iter |
1.01 |
E2E_Compiler_cql2 |
13301972.999999199 ns/iter |
12777084.090908952 ns/iter |
1.04 |
E2E_Compiler_cspell |
24080540.206896253 ns/iter |
22353161.12903217 ns/iter |
1.08 |
E2E_Compiler_cypress |
4036630.6436782316 ns/iter |
3966037.863636403 ns/iter |
1.02 |
E2E_Compiler_deno |
7356629.7916668095 ns/iter |
7341173.589473951 ns/iter |
1.00 |
E2E_Compiler_dependabot |
3786319.4054054744 ns/iter |
3786102.886486308 ns/iter |
1.00 |
E2E_Compiler_draft_04 |
2666909.2775666923 ns/iter |
2681604.874045685 ns/iter |
0.99 |
E2E_Compiler_fabric_mod |
4639020.533333375 ns/iter |
4641854.072847474 ns/iter |
1.00 |
E2E_Compiler_geojson |
21635801.781249244 ns/iter |
21063362.333334778 ns/iter |
1.03 |
E2E_Compiler_gitpod_configuration |
4764753.605442223 ns/iter |
4747150.340135874 ns/iter |
1.00 |
E2E_Compiler_helm_chart_lock |
783052.4827201761 ns/iter |
782477.764309748 ns/iter |
1.00 |
E2E_Compiler_importmap |
386055.2922399612 ns/iter |
383595.9840921557 ns/iter |
1.01 |
E2E_Compiler_jasmine |
1408649.5272727925 ns/iter |
1406278.9497991644 ns/iter |
1.00 |
E2E_Compiler_jshintrc |
4273673.213414601 ns/iter |
4261097.926829285 ns/iter |
1.00 |
E2E_Compiler_jsconfig |
21480013.181818582 ns/iter |
20680714.264706105 ns/iter |
1.04 |
E2E_Compiler_krakend |
159346726.99999908 ns/iter |
144046984.4000063 ns/iter |
1.11 |
E2E_Compiler_lazygit |
33002425.90476154 ns/iter |
31818341.136365484 ns/iter |
1.04 |
E2E_Compiler_lerna |
1628513.2720931184 ns/iter |
1627615.9860466165 ns/iter |
1.00 |
E2E_Compiler_nest_cli |
7171045.867346957 ns/iter |
7117039.636363753 ns/iter |
1.01 |
E2E_Compiler_omc |
165697276.00000307 ns/iter |
148143091.50000328 ns/iter |
1.12 |
E2E_Compiler_omnisharp |
6435778.959595921 ns/iter |
6430296.009174539 ns/iter |
1.00 |
E2E_Compiler_openapi |
24194576.31034526 ns/iter |
23767082.793105196 ns/iter |
1.02 |
E2E_Compiler_pre_commit_hooks |
5136564.14814797 ns/iter |
5120125.451851773 ns/iter |
1.00 |
E2E_Compiler_pulumi |
3958172.431817983 ns/iter |
3954946.079096319 ns/iter |
1.00 |
E2E_Compiler_semantic_release |
1606064.5057736454 ns/iter |
1604216.6729858068 ns/iter |
1.00 |
E2E_Compiler_stale |
1587474.61990956 ns/iter |
1590657.5854215268 ns/iter |
1.00 |
E2E_Compiler_stylecop |
5699852.73983729 ns/iter |
5691820.626015957 ns/iter |
1.00 |
E2E_Compiler_tmuxinator |
1957904.5251396617 ns/iter |
1957286.070027955 ns/iter |
1.00 |
E2E_Compiler_ui5 |
51509942.28571498 ns/iter |
46881816.266666956 ns/iter |
1.10 |
E2E_Compiler_ui5_manifest |
346971073.00002015 ns/iter |
315880601.4999982 ns/iter |
1.10 |
E2E_Compiler_unreal_engine_uproject |
4464011.128205286 ns/iter |
4443046.159235419 ns/iter |
1.00 |
E2E_Compiler_vercel |
12622243.80000031 ns/iter |
12393033.803572198 ns/iter |
1.02 |
E2E_Compiler_yamllint |
446120.98090386234 ns/iter |
453731.86061379616 ns/iter |
0.98 |
E2E_Evaluator_adaptivecard |
36161.8199448835 ns/iter |
36672.275502298064 ns/iter |
0.99 |
E2E_Evaluator_ansible_meta |
312208.24228879384 ns/iter |
317333.9411240019 ns/iter |
0.98 |
E2E_Evaluator_aws_cdk |
78340.4224166213 ns/iter |
76602.21134922079 ns/iter |
1.02 |
E2E_Evaluator_babelrc |
156220.47659196 ns/iter |
158041.96680870737 ns/iter |
0.99 |
E2E_Evaluator_cerebrum_criminal_case |
1682280.7079439473 ns/iter |
1622275.2840647134 ns/iter |
1.04 |
E2E_Evaluator_clang_format |
137394.6253230004 ns/iter |
138456.83884948917 ns/iter |
0.99 |
E2E_Evaluator_cmake_presets |
6573759.924999934 ns/iter |
5498843.96093736 ns/iter |
1.20 |
E2E_Evaluator_code_climate |
285666.5667495847 ns/iter |
280815.25149462715 ns/iter |
1.02 |
E2E_Evaluator_cql2 |
300545.50994253386 ns/iter |
303787.05713059026 ns/iter |
0.99 |
E2E_Evaluator_cspell |
721385.1329179788 ns/iter |
725718.0391349185 ns/iter |
0.99 |
E2E_Evaluator_cypress |
230651.4231149332 ns/iter |
231956.44046435403 ns/iter |
0.99 |
E2E_Evaluator_deno |
412936.47904537444 ns/iter |
410871.7400000013 ns/iter |
1.01 |
E2E_Evaluator_dependabot |
579632.2847626861 ns/iter |
587403.6201163926 ns/iter |
0.99 |
E2E_Evaluator_draft_04 |
10417896.818181865 ns/iter |
10628782.426666323 ns/iter |
0.98 |
E2E_Evaluator_fabric_mod |
937338.9594594067 ns/iter |
937520.0427807565 ns/iter |
1.00 |
E2E_Evaluator_geojson |
32056458.227272473 ns/iter |
31726332.56521907 ns/iter |
1.01 |
E2E_Evaluator_gitpod_configuration |
307765.26014108484 ns/iter |
306398.49846016907 ns/iter |
1.00 |
E2E_Evaluator_helm_chart_lock |
454813.2154838508 ns/iter |
458718.75445293734 ns/iter |
0.99 |
E2E_Evaluator_importmap |
69507.3884066621 ns/iter |
69545.98852603795 ns/iter |
1.00 |
E2E_Evaluator_jasmine |
166326.26428570942 ns/iter |
165406.19670201046 ns/iter |
1.01 |
E2E_Evaluator_jshintrc |
1304073.5263157962 ns/iter |
1310744.8600745802 ns/iter |
0.99 |
E2E_Evaluator_jsconfig |
526267.0489457918 ns/iter |
526475.4577412074 ns/iter |
1.00 |
E2E_Evaluator_krakend |
270008.1654482433 ns/iter |
263295.51655882463 ns/iter |
1.03 |
E2E_Evaluator_lazygit |
179381.6174530689 ns/iter |
176970.63842389014 ns/iter |
1.01 |
E2E_Evaluator_lerna |
210073.05776712627 ns/iter |
210644.51709659127 ns/iter |
1.00 |
E2E_Evaluator_nest_cli |
259545.85104869588 ns/iter |
247860.46495909174 ns/iter |
1.05 |
E2E_Evaluator_omc |
28278.05205040982 ns/iter |
28784.638307206857 ns/iter |
0.98 |
E2E_Evaluator_omnisharp |
714455.4492307319 ns/iter |
720130.4617768498 ns/iter |
0.99 |
E2E_Evaluator_openapi |
17866470.769229762 ns/iter |
17352148.925000675 ns/iter |
1.03 |
E2E_Evaluator_pre_commit_hooks |
592461.8775509993 ns/iter |
590959.5938827441 ns/iter |
1.00 |
E2E_Evaluator_pulumi |
867298.6100000201 ns/iter |
874688.2768079481 ns/iter |
0.99 |
E2E_Evaluator_semantic_release |
143134.89582072102 ns/iter |
141648.38416834077 ns/iter |
1.01 |
E2E_Evaluator_stale |
206182.84246172832 ns/iter |
208848.94346920497 ns/iter |
0.99 |
E2E_Evaluator_stylecop |
365187.7824961085 ns/iter |
364130.83359914686 ns/iter |
1.00 |
E2E_Evaluator_tmuxinator |
135128.75966322402 ns/iter |
135549.321961619 ns/iter |
1.00 |
E2E_Evaluator_ui5 |
709883.3582834054 ns/iter |
695074.3030906783 ns/iter |
1.02 |
E2E_Evaluator_ui5_manifest |
3975475.877005521 ns/iter |
3376608.347825943 ns/iter |
1.18 |
E2E_Evaluator_unreal_engine_uproject |
546138.2873741047 ns/iter |
546271.5848909685 ns/iter |
1.00 |
E2E_Evaluator_vercel |
390862.44917127927 ns/iter |
389690.8420762293 ns/iter |
1.00 |
E2E_Evaluator_yamllint |
17612.264426776237 ns/iter |
17733.795028975917 ns/iter |
0.99 |
Micro_Draft4_Meta_1_No_Callback |
261.53461194787565 ns/iter |
263.0234898191893 ns/iter |
0.99 |
Micro_Draft4_Required_Properties |
1141.9819856424378 ns/iter |
1139.2967306941575 ns/iter |
1.00 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
31.854250876014106 ns/iter |
31.813552863959462 ns/iter |
1.00 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
20.465252733543412 ns/iter |
20.011697785654672 ns/iter |
1.02 |
Micro_Draft4_Items_Schema |
668.9168211050777 ns/iter |
650.4171153856894 ns/iter |
1.03 |
Micro_Draft4_Nested_Object |
3.111993470214874 ns/iter |
3.113311973310329 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Optional |
391.2165233565425 ns/iter |
386.370657141901 ns/iter |
1.01 |
Micro_Draft4_Properties_Triad_Closed |
329.64313649843314 ns/iter |
326.46283693806924 ns/iter |
1.01 |
Micro_Draft4_Properties_Triad_Required |
434.4040884870417 ns/iter |
434.2356890018835 ns/iter |
1.00 |
Micro_Draft4_Properties_Closed |
78.91292311428509 ns/iter |
78.83388586485026 ns/iter |
1.00 |
Micro_Draft4_Non_Recursive_Ref |
31.989487015386377 ns/iter |
31.96482840553404 ns/iter |
1.00 |
Micro_Draft4_Pattern_Properties_True |
272.70378562045255 ns/iter |
270.7776840493554 ns/iter |
1.01 |
Micro_Draft4_Ref_To_Single_Property |
19.949292815455976 ns/iter |
19.951726331330374 ns/iter |
1.00 |
Micro_Draft4_Additional_Properties_Type |
60.16584230391427 ns/iter |
60.0393507897928 ns/iter |
1.00 |
Micro_Draft4_Nested_Oneof |
85.72601059516697 ns/iter |
85.97512324289045 ns/iter |
1.00 |
Micro_Draft4_Short_Enum |
15.268769265602538 ns/iter |
15.050783975965995 ns/iter |
1.01 |
Micro_Draft4_Long_Enum |
18.687044864438175 ns/iter |
18.698993523069856 ns/iter |
1.00 |
Micro_Draft4_Long_Enum_Short_Strings |
15.368810836260549 ns/iter |
15.043873161224761 ns/iter |
1.02 |
Micro_Draft4_Type_Object |
8.411145741874401 ns/iter |
8.427399310532467 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
2456393.5543858204 ns/iter |
2467707.301754448 ns/iter |
1.00 |
Micro_Draft4_Compile_Ref_Many_Nested |
1825255.1540468968 ns/iter |
1855214.8089005433 ns/iter |
0.98 |
Micro_Draft4_Compile_Wrap |
2426244.0276814103 ns/iter |
2423583.22413785 ns/iter |
1.00 |
Micro_Draft6_Property_Names |
133.3436209323654 ns/iter |
133.41758961465538 ns/iter |
1.00 |
Micro_Draft6_Compile_FHIR |
17473969648.99997 ns/iter |
15525178965.00001 ns/iter |
1.13 |
Micro_Draft7_If_Then_Else |
39.265464114181356 ns/iter |
39.245579087486284 ns/iter |
1.00 |
Micro_2019_09_Unevaluated_Properties |
52.00266983623567 ns/iter |
51.96855542080075 ns/iter |
1.00 |
Micro_2019_09_Compile_Wrap |
342946210.999969 ns/iter |
286941273.0000249 ns/iter |
1.20 |
Micro_2019_09_KrakenD_Linter_Check |
1281967861.9999876 ns/iter |
1222195194.9999833 ns/iter |
1.05 |
Micro_2019_09_KrakenD_Linter_Apply |
11450427684.000032 ns/iter |
10851066260.999971 ns/iter |
1.06 |
Micro_2020_12_Dynamic_Ref |
365.1770763764096 ns/iter |
371.51912190574654 ns/iter |
0.98 |
Micro_2020_12_Dynamic_Ref_Single |
8.726620844609096 ns/iter |
8.745531059946305 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
141292.63286499633 ns/iter |
142913.73945661727 ns/iter |
0.99 |
Micro_2020_12_Simple_Output_Annotations |
173012.40732653794 ns/iter |
170199.4920982168 ns/iter |
1.02 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1098276.4905659955 ns/iter |
1095456.489827883 ns/iter |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: 9f475e7 | Previous: e520223 | Ratio |
|---|---|---|---|
Micro_2020_12_Dynamic_Ref |
457.78391438607713 ns/iter |
449.48937714352684 ns/iter |
1.02 |
Micro_2020_12_Dynamic_Ref_Single |
9.188811839379428 ns/iter |
9.194021342212329 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
137770.6269730217 ns/iter |
138249.16643524167 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Annotations |
175936.22569265403 ns/iter |
178345.63420849462 ns/iter |
0.99 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1239971.458406909 ns/iter |
1237130.9929205654 ns/iter |
1.00 |
Micro_2019_09_Unevaluated_Properties |
46.829141259585924 ns/iter |
46.80294964650555 ns/iter |
1.00 |
Micro_2019_09_Compile_Wrap |
325129489.00000536 ns/iter |
323609688.0000332 ns/iter |
1.00 |
Micro_2019_09_KrakenD_Linter_Check |
1297988350.999958 ns/iter |
1271682678.9999232 ns/iter |
1.02 |
Micro_2019_09_KrakenD_Linter_Apply |
11484511901.000134 ns/iter |
11384961043.999966 ns/iter |
1.01 |
Micro_Draft7_If_Then_Else |
44.809014033456826 ns/iter |
45.05118400938955 ns/iter |
0.99 |
Micro_Draft6_Property_Names |
164.63654701427853 ns/iter |
164.4813354384668 ns/iter |
1.00 |
Micro_Draft6_Compile_FHIR |
15527984970.999796 ns/iter |
14868317317.99998 ns/iter |
1.04 |
Micro_Draft4_Meta_1_No_Callback |
218.72970043232505 ns/iter |
218.5949781444235 ns/iter |
1.00 |
Micro_Draft4_Required_Properties |
758.522514961556 ns/iter |
758.2380345433969 ns/iter |
1.00 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
27.073975745208525 ns/iter |
27.762847173179782 ns/iter |
0.98 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
16.61537389242279 ns/iter |
16.585838459260778 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
545.6552994424059 ns/iter |
535.6605993264905 ns/iter |
1.02 |
Micro_Draft4_Nested_Object |
3.5017099203606388 ns/iter |
3.416428057959331 ns/iter |
1.02 |
Micro_Draft4_Properties_Triad_Optional |
466.2728015993088 ns/iter |
480.72781120441203 ns/iter |
0.97 |
Micro_Draft4_Properties_Triad_Closed |
373.38688364781143 ns/iter |
389.1691228152929 ns/iter |
0.96 |
Micro_Draft4_Properties_Triad_Required |
498.66147807931384 ns/iter |
504.5905270852402 ns/iter |
0.99 |
Micro_Draft4_Properties_Closed |
70.31257233776404 ns/iter |
70.19244328115036 ns/iter |
1.00 |
Micro_Draft4_Non_Recursive_Ref |
14.12941167788205 ns/iter |
14.129105836889007 ns/iter |
1.00 |
Micro_Draft4_Pattern_Properties_True |
267.61896292697475 ns/iter |
268.914297441768 ns/iter |
1.00 |
Micro_Draft4_Ref_To_Single_Property |
16.657135267728187 ns/iter |
16.634507903717545 ns/iter |
1.00 |
Micro_Draft4_Additional_Properties_Type |
19.446044329359275 ns/iter |
19.426349737294274 ns/iter |
1.00 |
Micro_Draft4_Nested_Oneof |
113.04223631690705 ns/iter |
114.09464012919109 ns/iter |
0.99 |
Micro_Draft4_Short_Enum |
17.77562202620686 ns/iter |
17.783434586079004 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
18.853847189632603 ns/iter |
19.78054035885182 ns/iter |
0.95 |
Micro_Draft4_Long_Enum_Short_Strings |
17.793156546895915 ns/iter |
17.80209246939245 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
9.156810215525734 ns/iter |
9.263322109773139 ns/iter |
0.99 |
Micro_Draft4_Ref_Single_100 |
2623905.11278155 ns/iter |
2626554.3169808188 ns/iter |
1.00 |
Micro_Draft4_Compile_Ref_Many_Nested |
1954410.224999492 ns/iter |
1941478.501385441 ns/iter |
1.01 |
Micro_Draft4_Compile_Wrap |
2675731.7816088265 ns/iter |
2661825.9353605728 ns/iter |
1.01 |
E2E_Compiler_adaptivecard |
72274946.09999213 ns/iter |
70236382.69999991 ns/iter |
1.03 |
E2E_Compiler_ansible_meta |
30381134.69564569 ns/iter |
30112761.47826127 ns/iter |
1.01 |
E2E_Compiler_aws_cdk |
520784.27856608015 ns/iter |
522533.1794294962 ns/iter |
1.00 |
E2E_Compiler_babelrc |
2956755.9439663943 ns/iter |
2896316.9256195957 ns/iter |
1.02 |
E2E_Compiler_clang_format |
19701130.914290845 ns/iter |
19711031.499999385 ns/iter |
1.00 |
E2E_Compiler_cmake_presets |
27655164.159996275 ns/iter |
27663910.640003454 ns/iter |
1.00 |
E2E_Compiler_code_climate |
2895157.809128993 ns/iter |
2905586.1611571475 ns/iter |
1.00 |
E2E_Compiler_cql2 |
14606215.458333813 ns/iter |
14578796.95833242 ns/iter |
1.00 |
E2E_Compiler_cspell |
24503277.785713963 ns/iter |
24467859.344824698 ns/iter |
1.00 |
E2E_Compiler_cypress |
4319789.3888887325 ns/iter |
4324789.055556126 ns/iter |
1.00 |
E2E_Compiler_deno |
8930645.01190652 ns/iter |
8236896.61176425 ns/iter |
1.08 |
E2E_Compiler_dependabot |
4271092.32121328 ns/iter |
4253115.872727379 ns/iter |
1.00 |
E2E_Compiler_draft_04 |
3121212.5294118016 ns/iter |
3063245.943478606 ns/iter |
1.02 |
E2E_Compiler_fabric_mod |
5231108.428572207 ns/iter |
5244532.22388091 ns/iter |
1.00 |
E2E_Compiler_geojson |
24146960.620688833 ns/iter |
23925121.00000047 ns/iter |
1.01 |
E2E_Compiler_gitpod_configuration |
5357017.427480733 ns/iter |
5376022.576923298 ns/iter |
1.00 |
E2E_Compiler_helm_chart_lock |
859897.5847666407 ns/iter |
856868.0321783439 ns/iter |
1.00 |
E2E_Compiler_importmap |
420058.00300845737 ns/iter |
421899.98307144945 ns/iter |
1.00 |
E2E_Compiler_jasmine |
1576888.0790063564 ns/iter |
1586087.6213148516 ns/iter |
0.99 |
E2E_Compiler_jshintrc |
4821869.151725156 ns/iter |
4799516.186207696 ns/iter |
1.00 |
E2E_Compiler_jsconfig |
23199103.40000509 ns/iter |
23077287.733334135 ns/iter |
1.01 |
E2E_Compiler_krakend |
166108445.4999582 ns/iter |
162151085.9999944 ns/iter |
1.02 |
E2E_Compiler_lazygit |
35571993.60000141 ns/iter |
35502280.949992836 ns/iter |
1.00 |
E2E_Compiler_lerna |
1839838.986876594 ns/iter |
1840298.751979013 ns/iter |
1.00 |
E2E_Compiler_nest_cli |
8036951.241378454 ns/iter |
8055829.873563031 ns/iter |
1.00 |
E2E_Compiler_omc |
180117993.500005 ns/iter |
179922587.25001875 ns/iter |
1.00 |
E2E_Compiler_omnisharp |
7226132.082474371 ns/iter |
7243889.164947552 ns/iter |
1.00 |
E2E_Compiler_openapi |
27055850.153846435 ns/iter |
26980082.15384107 ns/iter |
1.00 |
E2E_Compiler_pre_commit_hooks |
5813917.31404911 ns/iter |
5834826.224999764 ns/iter |
1.00 |
E2E_Compiler_pulumi |
4475355.493589643 ns/iter |
4462698.872611367 ns/iter |
1.00 |
E2E_Compiler_semantic_release |
1804754.76424888 ns/iter |
1804845.1907217435 ns/iter |
1.00 |
E2E_Compiler_stale |
1776354.898734271 ns/iter |
1776447.063451452 ns/iter |
1.00 |
E2E_Compiler_stylecop |
6288341.378376981 ns/iter |
6269047.875000362 ns/iter |
1.00 |
E2E_Compiler_tmuxinator |
2207670.5299681844 ns/iter |
2209046.9018984307 ns/iter |
1.00 |
E2E_Compiler_ui5 |
51551120.000015415 ns/iter |
50059117.09999964 ns/iter |
1.03 |
E2E_Compiler_ui5_manifest |
348673497.00004977 ns/iter |
338213393.0000464 ns/iter |
1.03 |
E2E_Compiler_unreal_engine_uproject |
5018033.930000456 ns/iter |
5012446.2700000545 ns/iter |
1.00 |
E2E_Compiler_vercel |
13473318.749998514 ns/iter |
13430099.519229528 ns/iter |
1.00 |
E2E_Compiler_yamllint |
494071.34626238217 ns/iter |
495656.231205656 ns/iter |
1.00 |
E2E_Evaluator_adaptivecard |
33674.02918908662 ns/iter |
32084.38061083857 ns/iter |
1.05 |
E2E_Evaluator_ansible_meta |
298317.4802379656 ns/iter |
292386.9462411094 ns/iter |
1.02 |
E2E_Evaluator_aws_cdk |
58929.00254797119 ns/iter |
58279.71492448282 ns/iter |
1.01 |
E2E_Evaluator_babelrc |
136288.72163538166 ns/iter |
137732.15279405116 ns/iter |
0.99 |
E2E_Evaluator_cerebrum_criminal_case |
1449385.0670858084 ns/iter |
1381489.154761806 ns/iter |
1.05 |
E2E_Evaluator_clang_format |
107147.72304377022 ns/iter |
105144.33816932094 ns/iter |
1.02 |
E2E_Evaluator_cmake_presets |
6353036.328000599 ns/iter |
5210131.244274364 ns/iter |
1.22 |
E2E_Evaluator_code_climate |
231556.64211928254 ns/iter |
232994.09702714445 ns/iter |
0.99 |
E2E_Evaluator_cql2 |
317798.2309794237 ns/iter |
311045.05767519306 ns/iter |
1.02 |
E2E_Evaluator_cspell |
645378.833486748 ns/iter |
619991.0992844331 ns/iter |
1.04 |
E2E_Evaluator_cypress |
188101.31243676844 ns/iter |
176640.92418770652 ns/iter |
1.06 |
E2E_Evaluator_deno |
363537.52480269276 ns/iter |
354820.8347436003 ns/iter |
1.02 |
E2E_Evaluator_dependabot |
529646.2210030854 ns/iter |
493595.12234781176 ns/iter |
1.07 |
E2E_Evaluator_draft_04 |
8788302.690141201 ns/iter |
8412502.088607583 ns/iter |
1.04 |
E2E_Evaluator_fabric_mod |
958964.8903923795 ns/iter |
891228.4853131137 ns/iter |
1.08 |
E2E_Evaluator_geojson |
26521681.407403875 ns/iter |
25908106.629635263 ns/iter |
1.02 |
E2E_Evaluator_gitpod_configuration |
281128.6863543167 ns/iter |
274873.67382814654 ns/iter |
1.02 |
E2E_Evaluator_helm_chart_lock |
348249.2867647124 ns/iter |
344274.18632653623 ns/iter |
1.01 |
E2E_Evaluator_importmap |
57735.203602124006 ns/iter |
58135.088995836435 ns/iter |
0.99 |
E2E_Evaluator_jasmine |
141043.42443730528 ns/iter |
138233.31526703644 ns/iter |
1.02 |
E2E_Evaluator_jshintrc |
1016351.752907059 ns/iter |
1015897.9884225556 ns/iter |
1.00 |
E2E_Evaluator_jsconfig |
471308.9156146972 ns/iter |
468220.4919137835 ns/iter |
1.01 |
E2E_Evaluator_krakend |
240464.77739250523 ns/iter |
233564.79114341325 ns/iter |
1.03 |
E2E_Evaluator_lazygit |
166875.5790852785 ns/iter |
160536.96409419997 ns/iter |
1.04 |
E2E_Evaluator_lerna |
152699.00553957434 ns/iter |
152022.56996512966 ns/iter |
1.00 |
E2E_Evaluator_nest_cli |
228009.5566775285 ns/iter |
223370.6449760793 ns/iter |
1.02 |
E2E_Evaluator_omc |
27209.184239172442 ns/iter |
25939.545194275703 ns/iter |
1.05 |
E2E_Evaluator_omnisharp |
580283.2876144003 ns/iter |
562507.9578606522 ns/iter |
1.03 |
E2E_Evaluator_openapi |
15252563.577774305 ns/iter |
13474144.895833245 ns/iter |
1.13 |
E2E_Evaluator_pre_commit_hooks |
534271.1191950203 ns/iter |
533750.4204894212 ns/iter |
1.00 |
E2E_Evaluator_pulumi |
852641.4188035454 ns/iter |
843066.3502415833 ns/iter |
1.01 |
E2E_Evaluator_semantic_release |
136936.57428241795 ns/iter |
134952.60539405362 ns/iter |
1.01 |
E2E_Evaluator_stale |
173524.55411794625 ns/iter |
170630.94147275816 ns/iter |
1.02 |
E2E_Evaluator_stylecop |
345242.0909090615 ns/iter |
341187.9946105024 ns/iter |
1.01 |
E2E_Evaluator_tmuxinator |
129422.13661300536 ns/iter |
124639.68749996138 ns/iter |
1.04 |
E2E_Evaluator_ui5 |
657475.7592769848 ns/iter |
651556.0898035599 ns/iter |
1.01 |
E2E_Evaluator_ui5_manifest |
3125003.1454543537 ns/iter |
3046265.951964983 ns/iter |
1.03 |
E2E_Evaluator_unreal_engine_uproject |
505902.80783187883 ns/iter |
505049.2894356276 ns/iter |
1.00 |
E2E_Evaluator_vercel |
344356.43551583483 ns/iter |
344152.54058274115 ns/iter |
1.00 |
E2E_Evaluator_yamllint |
12778.813937716995 ns/iter |
12635.074521270755 ns/iter |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com