Preserve certain errors when linting default/examples

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[augmentcode]

🤖 Augment PR Summary

Summary: This PR adjusts AlterSchema linter behavior so certain schema-compilation errors are no longer swallowed when validating the default and examples keywords.

Changes:

• In ValidDefault and ValidExamples, explicitly rethrow CompilerReferenceTargetNotSchemaError and SchemaVocabularyError instead of treating them as “rule not applicable”.
• Add lint regression tests for 2020-12 to ensure unsupported required vocabularies surface as SchemaVocabularyError.
• Add lint regression tests for Draft-07 to ensure references into non-subschema locations surface as CompilerReferenceTargetNotSchemaError.
• Extend the test resolver with a metaschema that requires an unsupported vocabulary to exercise the new behavior.

Technical Notes: Other unexpected compilation failures are still handled as before (caught by the generic handler and treated as non-applicability for these rules).

_{🤖 Was this summary useful? React with 👍 or 👎}

[augmentcode]

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

[cubic-dev-ai]

No issues found across 5 files

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: 55090fa	Previous: 06b8d70	Ratio
E2E_Compiler_adaptivecard	62945255.77778307 ns/iter	63778337.88888489 ns/iter	0.99
E2E_Compiler_ansible_meta	29859173.65217376 ns/iter	29593172.208331946 ns/iter	1.01
E2E_Compiler_aws_cdk	372262.38473683794 ns/iter	392222.89500003174 ns/iter	0.95
E2E_Compiler_babelrc	2569576.5824173163 ns/iter	2633699.2716980325 ns/iter	0.98
E2E_Compiler_clang_format	18485726.00000041 ns/iter	18801478.567564953 ns/iter	0.98
E2E_Compiler_cmake_presets	25860341.62962918 ns/iter	26255984.962964013 ns/iter	0.98
E2E_Compiler_code_climate	2647728.4469695985 ns/iter	2668147.2633588556 ns/iter	0.99
E2E_Compiler_cql2	13040084.944445122 ns/iter	13166902.943395434 ns/iter	0.99
E2E_Compiler_cspell	22859843.38709568 ns/iter	23209794.733331062 ns/iter	0.98
E2E_Compiler_cypress	3929339.5449440754 ns/iter	4086542.588571709 ns/iter	0.96
E2E_Compiler_deno	7716540.777778391 ns/iter	7880085.966291334 ns/iter	0.98
E2E_Compiler_dependabot	3959794.6647724956 ns/iter	4030336.589594798 ns/iter	0.98
E2E_Compiler_draft_04	2675818.461832113 ns/iter	2825387.454901615 ns/iter	0.95
E2E_Compiler_fabric_mod	4779086.198630167 ns/iter	4877655.370629403 ns/iter	0.98
E2E_Compiler_geojson	22359846.935482744 ns/iter	22504061.709678207 ns/iter	0.99
E2E_Compiler_gitpod_configuration	4919503.725352089 ns/iter	5024627.228570873 ns/iter	0.98
E2E_Compiler_helm_chart_lock	683399.7245098767 ns/iter	750471.9773661749 ns/iter	0.91
E2E_Compiler_importmap	275949.10094637796 ns/iter	292800.8216857133 ns/iter	0.94
E2E_Compiler_jasmine	1344342.0346155004 ns/iter	1399185.5401605247 ns/iter	0.96
E2E_Compiler_jshintrc	4320161.419753383 ns/iter	4483315.974522058 ns/iter	0.96
E2E_Compiler_jsconfig	21973589.906249203 ns/iter	22616593.419354193 ns/iter	0.97
E2E_Compiler_krakend	136333750.99998373 ns/iter	154040466.80000645 ns/iter	0.89
E2E_Compiler_lazygit	33969984.71428755 ns/iter	34700679.94999795 ns/iter	0.98
E2E_Compiler_lerna	1575534.528216611 ns/iter	1663118.184397281 ns/iter	0.95
E2E_Compiler_nest_cli	7467493.159574491 ns/iter	7644565.428571005 ns/iter	0.98
E2E_Compiler_omc	154455689.24999976 ns/iter	167072271.50001812 ns/iter	0.92
E2E_Compiler_omnisharp	6790069.475727851 ns/iter	6945360.811880506 ns/iter	0.98
E2E_Compiler_openapi	25080694.392857235 ns/iter	25760072.777778212 ns/iter	0.97
E2E_Compiler_pre_commit_hooks	5380131.976922852 ns/iter	5470701.218749596 ns/iter	0.98
E2E_Compiler_pulumi	4043747.167630589 ns/iter	4144537.2603548956 ns/iter	0.98
E2E_Compiler_semantic_release	1574858.8134829844 ns/iter	1637428.6926604616 ns/iter	0.96
E2E_Compiler_stale	1543676.283185668 ns/iter	1598906.9931818407 ns/iter	0.97
E2E_Compiler_stylecop	6261564.207206574 ns/iter	6347436.243243932 ns/iter	0.99
E2E_Compiler_tmuxinator	1922511.2022158983 ns/iter	1978479.538243658 ns/iter	0.97
E2E_Compiler_ui5	48101098.92857132 ns/iter	48523845.71428762 ns/iter	0.99
E2E_Compiler_ui5_manifest	304437086.9999966 ns/iter	335362641.50001216 ns/iter	0.91
E2E_Compiler_unreal_engine_uproject	4648540.874172224 ns/iter	4708774.675675398 ns/iter	0.99
E2E_Compiler_users_array	767190.1845303801 ns/iter	804023.7100115302 ns/iter	0.95
E2E_Compiler_vercel	12449848.303571034 ns/iter	12779679.927271817 ns/iter	0.97
E2E_Compiler_yamllint	338138.9042808635 ns/iter	358419.8474141802 ns/iter	0.94
E2E_Evaluator_adaptivecard	24245.5360491884 ns/iter	25982.962998664872 ns/iter	0.93
E2E_Evaluator_ansible_meta	203410.95280574018 ns/iter	233797.5244277254 ns/iter	0.87
E2E_Evaluator_aws_cdk	42203.65190711379 ns/iter	49374.39216662 ns/iter	0.85
E2E_Evaluator_babelrc	86212.17946198831 ns/iter	110236.88694242181 ns/iter	0.78
E2E_Evaluator_cerebrum_criminal_case	995640.2656250418 ns/iter	984732.3231622798 ns/iter	1.01
E2E_Evaluator_clang_format	115139.87906135584 ns/iter	121924.58080807449 ns/iter	0.94
E2E_Evaluator_cmake_presets	4134766.5823530084 ns/iter	4533391.947368003 ns/iter	0.91
E2E_Evaluator_code_climate	152217.88173913292 ns/iter	178813.54766734972 ns/iter	0.85
E2E_Evaluator_cql2	180224.79490478992 ns/iter	224280.9366687821 ns/iter	0.80
E2E_Evaluator_cspell	539726.3708399475 ns/iter	567167.971659916 ns/iter	0.95
E2E_Evaluator_cypress	166653.60422602016 ns/iter	191374.90443404648 ns/iter	0.87
E2E_Evaluator_deno	244509.95764205794 ns/iter	316219.42915163486 ns/iter	0.77
E2E_Evaluator_dependabot	300466.3450946358 ns/iter	320787.30082044075 ns/iter	0.94
E2E_Evaluator_draft_04	6859875.838383939 ns/iter	8136392.909090932 ns/iter	0.84
E2E_Evaluator_fabric_mod	648389.615740699 ns/iter	681666.7053571215 ns/iter	0.95
E2E_Evaluator_geojson	15807954.795455068 ns/iter	16262634.976743717 ns/iter	0.97
E2E_Evaluator_gitpod_configuration	200944.5296816918 ns/iter	231284.89336412086 ns/iter	0.87
E2E_Evaluator_helm_chart_lock	241921.77581955507 ns/iter	364031.80922756 ns/iter	0.66
E2E_Evaluator_importmap	42807.218269171484 ns/iter	49248.27164569504 ns/iter	0.87
E2E_Evaluator_jasmine	95653.76854115678 ns/iter	105183.34851454697 ns/iter	0.91
E2E_Evaluator_jshintrc	1165002.31840795 ns/iter	1201155.8133561853 ns/iter	0.97
E2E_Evaluator_jsconfig	400051.46758460766 ns/iter	426297.3952641284 ns/iter	0.94
E2E_Evaluator_krakend	173966.673940318 ns/iter	207232.4832254169 ns/iter	0.84
E2E_Evaluator_lazygit	120985.29108468209 ns/iter	152287.1141363577 ns/iter	0.79
E2E_Evaluator_lerna	108015.9789114689 ns/iter	139051.1414362488 ns/iter	0.78
E2E_Evaluator_nest_cli	165688.1565692728 ns/iter	177773.7771208206 ns/iter	0.93
E2E_Evaluator_omc	17101.06261709811 ns/iter	18342.17270855744 ns/iter	0.93
E2E_Evaluator_omnisharp	561970.7580905886 ns/iter	629694.8213644166 ns/iter	0.89
E2E_Evaluator_openapi	9464056.486111064 ns/iter	10751260.316667791 ns/iter	0.88
E2E_Evaluator_pre_commit_hooks	462690.31919195433 ns/iter	490226.698036522 ns/iter	0.94
E2E_Evaluator_pulumi	678306.4800388633 ns/iter	682792.7988224045 ns/iter	0.99
E2E_Evaluator_semantic_release	77990.8033472812 ns/iter	99242.03901834176 ns/iter	0.79
E2E_Evaluator_stale	143888.1857990655 ns/iter	147805.55077188805 ns/iter	0.97
E2E_Evaluator_stylecop	259223.7141251126 ns/iter	287719.9224774427 ns/iter	0.90
E2E_Evaluator_tmuxinator	80418.10745035461 ns/iter	104305.45544835177 ns/iter	0.77
E2E_Evaluator_ui5	458616.6756401828 ns/iter	517244.82079644373 ns/iter	0.89
E2E_Evaluator_ui5_manifest	2244315.954248363 ns/iter	2582250.21978003 ns/iter	0.87
E2E_Evaluator_unreal_engine_uproject	407601.71403606876 ns/iter	422086.69040432456 ns/iter	0.97
E2E_Evaluator_users_array	539601.1403238508 ns/iter	550049.541319239 ns/iter	0.98
E2E_Evaluator_vercel	243960.0143356761 ns/iter	327269.85694117664 ns/iter	0.75
E2E_Evaluator_yamllint	8078.468453404095 ns/iter	8383.463163819735 ns/iter	0.96
Micro_Draft4_Meta_1_No_Callback	193.43594952842795 ns/iter	191.37263103665524 ns/iter	1.01
Micro_Draft4_Required_Properties	857.2283683204095 ns/iter	789.679890112057 ns/iter	1.09
Micro_Draft4_Many_Optional_Properties_Minimal_Match	23.757874053272726 ns/iter	21.135976878405472 ns/iter	1.12
Micro_Draft4_Few_Optional_Properties_Minimal_Match	11.044630968443292 ns/iter	10.89709636943729 ns/iter	1.01
Micro_Draft4_Items_Schema	296.46839429722877 ns/iter	297.2834794624667 ns/iter	1.00
Micro_Draft4_Nested_Object	1.4070540582607713 ns/iter	1.7658269150852512 ns/iter	0.80
Micro_Draft4_Properties_Triad_Optional	318.6331526188965 ns/iter	322.40399912832083 ns/iter	0.99
Micro_Draft4_Properties_Triad_Closed	265.14276953899554 ns/iter	269.3432369344295 ns/iter	0.98
Micro_Draft4_Properties_Triad_Required	331.9287584065604 ns/iter	341.03281680808146 ns/iter	0.97
Micro_Draft4_Properties_Closed	59.82248180070515 ns/iter	55.13857093930336 ns/iter	1.08
Micro_Draft4_Non_Recursive_Ref	14.782461948453378 ns/iter	12.13153284948147 ns/iter	1.22
Micro_Draft4_Pattern_Properties_True	145.58728668091604 ns/iter	151.71578500217558 ns/iter	0.96
Micro_Draft4_Ref_To_Single_Property	10.646101021404014 ns/iter	10.91123942400216 ns/iter	0.98
Micro_Draft4_Additional_Properties_Type	23.855372174177177 ns/iter	22.863594073694763 ns/iter	1.04
Micro_Draft4_Nested_Oneof	54.51974994506778 ns/iter	57.929657848982544 ns/iter	0.94
Micro_Draft4_Short_Enum	14.062537766511994 ns/iter	14.012886257947786 ns/iter	1.00
Micro_Draft4_Long_Enum	13.020456946371901 ns/iter	13.948079640058815 ns/iter	0.93
Micro_Draft4_Long_Enum_Short_Strings	14.068736403949908 ns/iter	14.060304374437276 ns/iter	1.00
Micro_Draft4_Type_Object	3.52714250568767 ns/iter	3.441057691635491 ns/iter	1.03
Micro_Draft4_Ref_Single_100	2336997.4366664793 ns/iter	2407532.6344825886 ns/iter	0.97
Micro_Draft4_Compile_Ref_Many_Nested	1711913.5999999943 ns/iter	1732135.7610838057 ns/iter	0.99
Micro_Draft4_Compile_Wrap	2360677.986531922 ns/iter	2392868.01369867 ns/iter	0.99
Micro_Draft6_Property_Names	115.39943696143884 ns/iter	119.21595335150383 ns/iter	0.97
Micro_Draft6_Compile_FHIR	15375991270.999975 ns/iter	13976729756.99993 ns/iter	1.10
Micro_Draft7_If_Then_Else	23.676897173881713 ns/iter	24.25232824736528 ns/iter	0.98
Micro_2019_09_Unevaluated_Properties	26.73952977032471 ns/iter	28.978991437961692 ns/iter	0.92
Micro_2019_09_Compile_Wrap	296495451.49999315 ns/iter	298577037.49996746 ns/iter	0.99
Micro_2020_12_Dynamic_Ref	225.5104428114819 ns/iter	225.8673968965174 ns/iter	1.00
Micro_2020_12_Dynamic_Ref_Single	3.5187615809708475 ns/iter	3.423143195307851 ns/iter	1.03
Micro_2020_12_Simple_Output_Mask	1015.6847710006008 ns/iter	1066.110448454944 ns/iter	0.95
Micro_2020_12_Simple_Output_Annotations	92072.40987208216 ns/iter	102557.26375260878 ns/iter	0.90
Micro_2020_12_Compile_NonCircular_Shared_Refs	1077096.6682098978 ns/iter	1128134.1945774197 ns/iter	0.95
Micro_2020_12_Exhaustive_Deep_Numeric	8959.603920664264 ns/iter	8018.502184205702 ns/iter	1.12
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	172380.90527578988 ns/iter	176760.11971131084 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	23551.915506190668 ns/iter	22975.22668126891 ns/iter	1.03
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	147.83800971889704 ns/iter	141.9859674545769 ns/iter	1.04
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4012.008570535085 ns/iter	4318.304769743936 ns/iter	0.93
Alterschema_Check_Readibility_ISO_Language_Set_3	321480818.5000493 ns/iter	353261868.99999356 ns/iter	0.91
Alterschema_Check_Readibility_OMC	89609897.24999991 ns/iter	86769003.3749966 ns/iter	1.03
Alterschema_Check_Readibility_KrakenD	1288522256.9999542 ns/iter	1211019138.9999728 ns/iter	1.06
Alterschema_Apply_Readibility_KrakenD	129183756875.00009 ns/iter	122057578902.99992 ns/iter	1.06
Alterschema_Check_Invalid_External_Refs	277591318.3333311 ns/iter	306167769.0000124 ns/iter	0.91

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: 55090fa	Previous: 06b8d70	Ratio
E2E_Evaluator_adaptivecard	119139 ns	113527 ns	1.05
E2E_Evaluator_ansible-meta	518918 ns	511030 ns	1.02
E2E_Evaluator_aws-cdk	124614 ns	140904 ns	0.88
E2E_Evaluator_babelrc	294411 ns	315319 ns	0.93
E2E_Evaluator_cerebrum-criminal-case	2609070 ns	2636666 ns	0.99
E2E_Evaluator_clang-format	247718 ns	267228 ns	0.93
E2E_Evaluator_cmake-presets	16997520 ns	16801843 ns	1.01
E2E_Evaluator_code-climate	476841 ns	493965 ns	0.97
E2E_Evaluator_cql2	1232394 ns	1154441 ns	1.07
E2E_Evaluator_cspell	1554257 ns	1458816 ns	1.07
E2E_Evaluator_cypress	807454 ns	776080 ns	1.04
E2E_Evaluator_deno	1014595 ns	1037235 ns	0.98
E2E_Evaluator_dependabot	1004319 ns	1042554 ns	0.96
E2E_Evaluator_draft-04	20487092 ns	23562312 ns	0.87
E2E_Evaluator_fabric-mod	2416754 ns	2455823 ns	0.98
E2E_Evaluator_geojson	25946214 ns	26914083 ns	0.96
E2E_Evaluator_gitpod-configuration	702915 ns	714064 ns	0.98
E2E_Evaluator_helm-chart-lock	1048168 ns	989355 ns	1.06
E2E_Evaluator_importmap	268997 ns	272144 ns	0.99
E2E_Evaluator_jasmine	278841 ns	301625 ns	0.92
E2E_Evaluator_jsconfig	1405540 ns	1245057 ns	1.13
E2E_Evaluator_jshintrc	2956986 ns	2858778 ns	1.03
E2E_Evaluator_krakend	668534 ns	702058 ns	0.95
E2E_Evaluator_lazygit	447344 ns	496771 ns	0.90
E2E_Evaluator_lerna	406685 ns	449864 ns	0.90
E2E_Evaluator_nest-cli	574770 ns	578401 ns	0.99
E2E_Evaluator_omc	91045 ns	86806 ns	1.05
E2E_Evaluator_omnisharp	1451652 ns	1428189 ns	1.02
E2E_Evaluator_openapi	22757643 ns	25952414 ns	0.88
E2E_Evaluator_pre-commit-hooks	1917839 ns	1945125 ns	0.99
E2E_Evaluator_pulumi	1892927 ns	1800758 ns	1.05
E2E_Evaluator_semantic-release	227986 ns	259509 ns	0.88
E2E_Evaluator_stale	359811 ns	387353 ns	0.93
E2E_Evaluator_stylecop	1108169 ns	1153666 ns	0.96
E2E_Evaluator_tmuxinator	213858 ns	222639 ns	0.96
E2E_Evaluator_ui5	2030651 ns	2007152 ns	1.01
E2E_Evaluator_ui5-manifest	9487679 ns	10873478 ns	0.87
E2E_Evaluator_unreal-engine-uproject	1509583 ns	1477499 ns	1.02
E2E_Evaluator_users-array	2261308 ns	2289445 ns	0.99
E2E_Evaluator_vercel	946674 ns	946162 ns	1.00
E2E_Evaluator_yamllint	26379 ns	28143 ns	0.94

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: 55090fa	Previous: 06b8d70	Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3	348966727.0000609 ns/iter	334594464.0000198 ns/iter	1.04
Alterschema_Check_Readibility_OMC	93978329.28568408 ns/iter	98584714.99998294 ns/iter	0.95
Alterschema_Check_Readibility_KrakenD	1217268335.999961 ns/iter	1425317214.99995 ns/iter	0.85
Alterschema_Apply_Readibility_KrakenD	122183298781.00008 ns/iter	132366179933.00002 ns/iter	0.92
Alterschema_Check_Invalid_External_Refs	334767184.00004303 ns/iter	305369528.50002307 ns/iter	1.10
Micro_2020_12_Dynamic_Ref	262.5416489178132 ns/iter	259.6633650966929 ns/iter	1.01
Micro_2020_12_Dynamic_Ref_Single	4.727764479930865 ns/iter	4.2232971848307095 ns/iter	1.12
Micro_2020_12_Simple_Output_Mask	1184.7351623730544 ns/iter	1113.3908438922504 ns/iter	1.06
Micro_2020_12_Simple_Output_Annotations	117399.64228723315 ns/iter	105842.44970589408 ns/iter	1.11
Micro_2020_12_Compile_NonCircular_Shared_Refs	1204056.979310641 ns/iter	1172385.1708541266 ns/iter	1.03
Micro_2020_12_Exhaustive_Deep_Numeric	8607.463251696598 ns/iter	8004.480294351814 ns/iter	1.08
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	170425.82881771156 ns/iter	165439.2690593544 ns/iter	1.03
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	25819.934084971334 ns/iter	26417.120187644952 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	145.23283735993945 ns/iter	135.24470861545237 ns/iter	1.07
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4858.589135413362 ns/iter	4562.739427047708 ns/iter	1.06
Micro_2019_09_Unevaluated_Properties	28.69038250141154 ns/iter	28.839282128093092 ns/iter	0.99
Micro_2019_09_Compile_Wrap	308908641.49989736 ns/iter	309552663.49997145 ns/iter	1.00
Micro_Draft7_If_Then_Else	24.60458698651579 ns/iter	25.032336607310803 ns/iter	0.98
Micro_Draft6_Property_Names	141.93727586224034 ns/iter	142.2574321830171 ns/iter	1.00
Micro_Draft6_Compile_FHIR	13666451903.000051 ns/iter	14506133119.999958 ns/iter	0.94
Micro_Draft4_Meta_1_No_Callback	165.0493129524329 ns/iter	171.98629294925593 ns/iter	0.96
Micro_Draft4_Required_Properties	826.99377915846 ns/iter	810.1915277386887 ns/iter	1.02
Micro_Draft4_Many_Optional_Properties_Minimal_Match	20.289745094972034 ns/iter	21.08562608416435 ns/iter	0.96
Micro_Draft4_Few_Optional_Properties_Minimal_Match	12.778614556015633 ns/iter	13.549436687376113 ns/iter	0.94
Micro_Draft4_Items_Schema	350.8849252803406 ns/iter	316.80185148965717 ns/iter	1.11
Micro_Draft4_Nested_Object	1.8720773390723122 ns/iter	2.463845805271711 ns/iter	0.76
Micro_Draft4_Properties_Triad_Optional	454.6714812026215 ns/iter	408.75408453924103 ns/iter	1.11
Micro_Draft4_Properties_Triad_Closed	359.5340318182423 ns/iter	356.0345237193346 ns/iter	1.01
Micro_Draft4_Properties_Triad_Required	495.34576388207597 ns/iter	438.6384807203178 ns/iter	1.13
Micro_Draft4_Properties_Closed	63.0073024442582 ns/iter	62.34084524204172 ns/iter	1.01
Micro_Draft4_Non_Recursive_Ref	9.654760059615619 ns/iter	8.8387472179643 ns/iter	1.09
Micro_Draft4_Pattern_Properties_True	208.3201803004635 ns/iter	197.90871180759848 ns/iter	1.05
Micro_Draft4_Ref_To_Single_Property	12.781185037792907 ns/iter	13.042918074880111 ns/iter	0.98
Micro_Draft4_Additional_Properties_Type	15.246508173992765 ns/iter	15.10850236352994 ns/iter	1.01
Micro_Draft4_Nested_Oneof	64.7964801670886 ns/iter	65.91414864132624 ns/iter	0.98
Micro_Draft4_Short_Enum	14.698043276993458 ns/iter	14.785830541746279 ns/iter	0.99
Micro_Draft4_Long_Enum	14.335022957150974 ns/iter	14.441152415506814 ns/iter	0.99
Micro_Draft4_Long_Enum_Short_Strings	14.656154897664283 ns/iter	14.788180260423164 ns/iter	0.99
Micro_Draft4_Type_Object	4.670841597515695 ns/iter	4.223339550690596 ns/iter	1.11
Micro_Draft4_Ref_Single_100	2488828.3416376356 ns/iter	2521544.5143887154 ns/iter	0.99
Micro_Draft4_Compile_Ref_Many_Nested	1809217.3514214805 ns/iter	1859821.7742784116 ns/iter	0.97
Micro_Draft4_Compile_Wrap	2574917.4227944887 ns/iter	2599425.5836428395 ns/iter	0.99
E2E_Compiler_adaptivecard	64778630.363620825 ns/iter	65068142.72727918 ns/iter	1.00
E2E_Compiler_ansible_meta	30360513.304339807 ns/iter	30800909.086950846 ns/iter	0.99
E2E_Compiler_aws_cdk	419025.71437124 ns/iter	395841.93420306477 ns/iter	1.06
E2E_Compiler_babelrc	2790639.768924424 ns/iter	2780836.697211162 ns/iter	1.00
E2E_Compiler_clang_format	19685766.08333529 ns/iter	21774812.114290398 ns/iter	0.90
E2E_Compiler_cmake_presets	26845091.576923065 ns/iter	27712212.52000032 ns/iter	0.97
E2E_Compiler_code_climate	2817862.891129336 ns/iter	2858128.122448873 ns/iter	0.99
E2E_Compiler_cql2	13878619.239999352 ns/iter	14039006.39999847 ns/iter	0.99
E2E_Compiler_cspell	23685660.800000127 ns/iter	24267887.724136017 ns/iter	0.98
E2E_Compiler_cypress	4121950.2470579864 ns/iter	4240567.301204158 ns/iter	0.97
E2E_Compiler_deno	8220665.458825619 ns/iter	8351368.0714277355 ns/iter	0.98
E2E_Compiler_dependabot	4212791.120482002 ns/iter	4297764.5185183175 ns/iter	0.98
E2E_Compiler_draft_04	2930706.1715483936 ns/iter	2920869.372384617 ns/iter	1.00
E2E_Compiler_fabric_mod	5153536.051471305 ns/iter	5159765.058823161 ns/iter	1.00
E2E_Compiler_geojson	24041260.41379829 ns/iter	24586106.137929104 ns/iter	0.98
E2E_Compiler_gitpod_configuration	5300560.0458000675 ns/iter	5343645.801526031 ns/iter	0.99
E2E_Compiler_helm_chart_lock	757774.4015152073 ns/iter	727991.6255186216 ns/iter	1.04
E2E_Compiler_importmap	311588.9256787786 ns/iter	295350.1989043942 ns/iter	1.05
E2E_Compiler_jasmine	1479515.0738397255 ns/iter	1451502.5746888749 ns/iter	1.02
E2E_Compiler_jshintrc	4702073.000000407 ns/iter	4641375.066667024 ns/iter	1.01
E2E_Compiler_jsconfig	23367345.966668535 ns/iter	23427299.566666685 ns/iter	1.00
E2E_Compiler_krakend	142414958.40001336 ns/iter	141210190.1999904 ns/iter	1.01
E2E_Compiler_lazygit	35448850.00000022 ns/iter	36047016.736838005 ns/iter	0.98
E2E_Compiler_lerna	1758285.0050381487 ns/iter	1729000.2432432307 ns/iter	1.02
E2E_Compiler_nest_cli	8015937.579544512 ns/iter	8065671.5862063 ns/iter	0.99
E2E_Compiler_omc	165512184.000022 ns/iter	164227720.99997473 ns/iter	1.01
E2E_Compiler_omnisharp	7197670.87628863 ns/iter	7308012.752577569 ns/iter	0.98
E2E_Compiler_openapi	26618157.653851647 ns/iter	26779193.73077377 ns/iter	0.99
E2E_Compiler_pre_commit_hooks	5709971.910569149 ns/iter	5775671.966943234 ns/iter	0.99
E2E_Compiler_pulumi	4366653.043749125 ns/iter	4387182.325000083 ns/iter	1.00
E2E_Compiler_semantic_release	1708296.5206817172 ns/iter	1697659.189320233 ns/iter	1.01
E2E_Compiler_stale	1669004.39140799 ns/iter	1659831.5390072686 ns/iter	1.01
E2E_Compiler_stylecop	6338503.8181815455 ns/iter	6418676.009174089 ns/iter	0.99
E2E_Compiler_tmuxinator	2106190.414414149 ns/iter	2088827.647590536 ns/iter	1.01
E2E_Compiler_ui5	48217298.133325435 ns/iter	50727255.42856915 ns/iter	0.95
E2E_Compiler_ui5_manifest	321295174.50005096 ns/iter	313317865.49992555 ns/iter	1.03
E2E_Compiler_unreal_engine_uproject	4925785.514083594 ns/iter	4937476.211268122 ns/iter	1.00
E2E_Compiler_users_array	874667.5423940349 ns/iter	850478.041062822 ns/iter	1.03
E2E_Compiler_vercel	13111936.056604017 ns/iter	13267416.226413706 ns/iter	0.99
E2E_Compiler_yamllint	381873.8399782055 ns/iter	363428.70322237187 ns/iter	1.05
E2E_Evaluator_adaptivecard	23017.149461163714 ns/iter	23160.41411053678 ns/iter	0.99
E2E_Evaluator_ansible_meta	244119.57680249886 ns/iter	222461.207379134 ns/iter	1.10
E2E_Evaluator_aws_cdk	52090.719192657416 ns/iter	44135.70930668252 ns/iter	1.18
E2E_Evaluator_babelrc	108799.4536953126 ns/iter	84428.74470144743 ns/iter	1.29
E2E_Evaluator_cerebrum_criminal_case	986056.7360913731 ns/iter	1057590.9969462955 ns/iter	0.93
E2E_Evaluator_clang_format	103218.61042669958 ns/iter	93717.56789630669 ns/iter	1.10
E2E_Evaluator_cmake_presets	4362726.677216622 ns/iter	4480927.160257008 ns/iter	0.97
E2E_Evaluator_code_climate	190029.45818479892 ns/iter	164290.49073191325 ns/iter	1.16
E2E_Evaluator_cql2	219856.126993874 ns/iter	201774.71077722323 ns/iter	1.09
E2E_Evaluator_cspell	532662.8632871357 ns/iter	500889.8079709532 ns/iter	1.06
E2E_Evaluator_cypress	174808.58215262234 ns/iter	141250.60250199155 ns/iter	1.24
E2E_Evaluator_deno	333937.9539411164 ns/iter	281892.2341993058 ns/iter	1.18
E2E_Evaluator_dependabot	361582.91993887903 ns/iter	333986.768053661 ns/iter	1.08
E2E_Evaluator_draft_04	6863342.530000409 ns/iter	6259556.368931247 ns/iter	1.10
E2E_Evaluator_fabric_mod	747369.9171092297 ns/iter	712338.7631578145 ns/iter	1.05
E2E_Evaluator_geojson	16774857.487806046 ns/iter	16959402.80000059 ns/iter	0.99
E2E_Evaluator_gitpod_configuration	250920.0283560537 ns/iter	221185.94846353118 ns/iter	1.13
E2E_Evaluator_helm_chart_lock	324715.8797378875 ns/iter	213890.51543208575 ns/iter	1.52
E2E_Evaluator_importmap	47014.2697430382 ns/iter	40708.70946724633 ns/iter	1.15
E2E_Evaluator_jasmine	116319.4814083772 ns/iter	102644.50080349091 ns/iter	1.13
E2E_Evaluator_jshintrc	1059073.549549589 ns/iter	1007064.1428571749 ns/iter	1.05
E2E_Evaluator_jsconfig	407149.02840577916 ns/iter	374512.78101796936 ns/iter	1.09
E2E_Evaluator_krakend	204034.17016866317 ns/iter	181655.56799163885 ns/iter	1.12
E2E_Evaluator_lazygit	136304.59008746417 ns/iter	121494.23960152981 ns/iter	1.12
E2E_Evaluator_lerna	149815.0222804613 ns/iter	116832.00498670306 ns/iter	1.28
E2E_Evaluator_nest_cli	194239.37920315732 ns/iter	177522.86268053154 ns/iter	1.09
E2E_Evaluator_omc	18310.281058905606 ns/iter	18520.479000424122 ns/iter	0.99
E2E_Evaluator_omnisharp	555836.0901834874 ns/iter	526998.1996962702 ns/iter	1.05
E2E_Evaluator_openapi	9261220.662161527 ns/iter	9304269.249999681 ns/iter	1.00
E2E_Evaluator_pre_commit_hooks	502862.56263577746 ns/iter	466384.3530192316 ns/iter	1.08
E2E_Evaluator_pulumi	710809.2165473939 ns/iter	713120.8886598822 ns/iter	1.00
E2E_Evaluator_semantic_release	101052.33166404538 ns/iter	85174.53327632575 ns/iter	1.19
E2E_Evaluator_stale	156963.19179301566 ns/iter	149524.31756758783 ns/iter	1.05
E2E_Evaluator_stylecop	313177.7933920739 ns/iter	287165.06696609396 ns/iter	1.09
E2E_Evaluator_tmuxinator	101090.20225037461 ns/iter	86810.1583249533 ns/iter	1.16
E2E_Evaluator_ui5	523729.11144130706 ns/iter	492705.5590716583 ns/iter	1.06
E2E_Evaluator_ui5_manifest	2688753.938696819 ns/iter	2577071.7399264756 ns/iter	1.04
E2E_Evaluator_unreal_engine_uproject	463171.7343441382 ns/iter	430048.04480398196 ns/iter	1.08
E2E_Evaluator_users_array	643304.3829402411 ns/iter	679655.6716838334 ns/iter	0.95
E2E_Evaluator_vercel	303133.16457887273 ns/iter	255452.14536155795 ns/iter	1.19
E2E_Evaluator_yamllint	10670.40234262339 ns/iter	9197.375141198472 ns/iter	1.16

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: 55090fa	Previous: 06b8d70	Ratio
E2E_Evaluator_adaptivecard	113410 ns	117139 ns	0.97
E2E_Evaluator_ansible-meta	495839 ns	543096 ns	0.91
E2E_Evaluator_aws-cdk	140436 ns	127785 ns	1.10
E2E_Evaluator_babelrc	316639 ns	293739 ns	1.08
E2E_Evaluator_cerebrum-criminal-case	2373600 ns	2574071 ns	0.92
E2E_Evaluator_clang-format	256795 ns	256190 ns	1.00
E2E_Evaluator_cmake-presets	16580933 ns	17076167 ns	0.97
E2E_Evaluator_code-climate	483850 ns	485757 ns	1.00
E2E_Evaluator_cql2	1178238 ns	1205158 ns	0.98
E2E_Evaluator_cspell	1425487 ns	1610053 ns	0.89
E2E_Evaluator_cypress	765477 ns	816461 ns	0.94
E2E_Evaluator_deno	978157 ns	1050339 ns	0.93
E2E_Evaluator_dependabot	1018781 ns	1038725 ns	0.98
E2E_Evaluator_draft-04	21124354 ns	20711083 ns	1.02
E2E_Evaluator_fabric-mod	2265608 ns	2472765 ns	0.92
E2E_Evaluator_geojson	26338963 ns	27049699 ns	0.97
E2E_Evaluator_gitpod-configuration	684634 ns	710569 ns	0.96
E2E_Evaluator_helm-chart-lock	969483 ns	1056023 ns	0.92
E2E_Evaluator_importmap	262095 ns	269273 ns	0.97
E2E_Evaluator_jasmine	289818 ns	288152 ns	1.01
E2E_Evaluator_jsconfig	1213454 ns	1401124 ns	0.87
E2E_Evaluator_jshintrc	2751652 ns	3018936 ns	0.91
E2E_Evaluator_krakend	687302 ns	673634 ns	1.02
E2E_Evaluator_lazygit	484246 ns	440937 ns	1.10
E2E_Evaluator_lerna	441759 ns	410317 ns	1.08
E2E_Evaluator_nest-cli	562542 ns	573120 ns	0.98
E2E_Evaluator_omc	90316 ns	89690 ns	1.01
E2E_Evaluator_omnisharp	1386127 ns	1460626 ns	0.95
E2E_Evaluator_openapi	21856220 ns	22792819 ns	0.96
E2E_Evaluator_pre-commit-hooks	1838688 ns	1991554 ns	0.92
E2E_Evaluator_pulumi	1764334 ns	1932787 ns	0.91
E2E_Evaluator_semantic-release	249546 ns	229365 ns	1.09
E2E_Evaluator_stale	389025 ns	368763 ns	1.05
E2E_Evaluator_stylecop	1106574 ns	1128569 ns	0.98
E2E_Evaluator_tmuxinator	223986 ns	212695 ns	1.05
E2E_Evaluator_ui5	2100823 ns	2002892 ns	1.05
E2E_Evaluator_ui5-manifest	10334533 ns	9455565 ns	1.09
E2E_Evaluator_unreal-engine-uproject	1441678 ns	1520435 ns	0.95
E2E_Evaluator_users-array	2283035 ns	2303392 ns	0.99
E2E_Evaluator_vercel	921880 ns	952277 ns	0.97
E2E_Evaluator_yamllint	27772 ns	26501 ns	1.05

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: 55090fa	Previous: 06b8d70	Ratio
E2E_Compiler_adaptivecard	69253027.77777788 ns/iter	67854439.36363126 ns/iter	1.02
E2E_Compiler_ansible_meta	26926854.19231111 ns/iter	33643925.374998204 ns/iter	0.80
E2E_Compiler_aws_cdk	297659.7195727015 ns/iter	353359.44674558257 ns/iter	0.84
E2E_Compiler_babelrc	2199992.488524421 ns/iter	2513778.174603243 ns/iter	0.88
E2E_Compiler_clang_format	17245176.425531294 ns/iter	18900238.75675426 ns/iter	0.91
E2E_Compiler_cmake_presets	26258922.814812884 ns/iter	32769056.818184793 ns/iter	0.80
E2E_Compiler_code_climate	2438577.563076391 ns/iter	2672440.5172413317 ns/iter	0.91
E2E_Compiler_cql2	12905075.471696861 ns/iter	15051759.615383495 ns/iter	0.86
E2E_Compiler_cspell	23733593.749998108 ns/iter	28839524.666666336 ns/iter	0.82
E2E_Compiler_cypress	3609514.939394057 ns/iter	6119569.937499339 ns/iter	0.59
E2E_Compiler_deno	6828194.819820613 ns/iter	9221946.709302766 ns/iter	0.74
E2E_Compiler_dependabot	3944687.7303369935 ns/iter	4923777.527272415 ns/iter	0.80
E2E_Compiler_draft_04	2161220.0520830057 ns/iter	2495270.8333334313 ns/iter	0.87
E2E_Compiler_fabric_mod	3752899.0641705003 ns/iter	4056700.9542857185 ns/iter	0.93
E2E_Compiler_geojson	22953869.612908214 ns/iter	27885516.35714092 ns/iter	0.82
E2E_Compiler_gitpod_configuration	4127902.857143064 ns/iter	5863953.336000122 ns/iter	0.70
E2E_Compiler_helm_chart_lock	516879.2500001018 ns/iter	657666.4719100822 ns/iter	0.79
E2E_Compiler_importmap	223717.99507241586 ns/iter	245527.98297388753 ns/iter	0.91
E2E_Compiler_jasmine	1323495.9530988364 ns/iter	1356328.6202019977 ns/iter	0.98
E2E_Compiler_jshintrc	3250578.3043478113 ns/iter	4346296.686746991 ns/iter	0.75
E2E_Compiler_jsconfig	18361245.605259873 ns/iter	25626321.225808345 ns/iter	0.72
E2E_Compiler_krakend	131513583.40001026 ns/iter	197464458.25001046 ns/iter	0.67
E2E_Compiler_lazygit	42371007.95237547 ns/iter	43139255.18749784 ns/iter	0.98
E2E_Compiler_lerna	1558941.888620002 ns/iter	1706608.8161157472 ns/iter	0.91
E2E_Compiler_nest_cli	6677086.591304507 ns/iter	7796518.257142843 ns/iter	0.86
E2E_Compiler_omc	199150781.25001174 ns/iter	264474291.66667762 ns/iter	0.75
E2E_Compiler_omnisharp	6809894.368422263 ns/iter	9925848.75000034 ns/iter	0.69
E2E_Compiler_openapi	26741877.86207203 ns/iter	29646641.699997645 ns/iter	0.90
E2E_Compiler_pre_commit_hooks	5393580.751725213 ns/iter	5512846.074380335 ns/iter	0.98
E2E_Compiler_pulumi	4773162.321739817 ns/iter	3835298.9562504543 ns/iter	1.24
E2E_Compiler_semantic_release	1647871.5285713752 ns/iter	1566663.964205844 ns/iter	1.05
E2E_Compiler_stale	1502373.91836756 ns/iter	1608180.5840165594 ns/iter	0.93
E2E_Compiler_stylecop	7003805.8888893295 ns/iter	6486389.462810252 ns/iter	1.08
E2E_Compiler_tmuxinator	1755390.2894055082 ns/iter	1902808.1292684118 ns/iter	0.92
E2E_Compiler_ui5	64472666.636365004 ns/iter	66428541.636365816 ns/iter	0.97
E2E_Compiler_ui5_manifest	398545853.9999627 ns/iter	405669999.9999864 ns/iter	0.98
E2E_Compiler_unreal_engine_uproject	4663909.035210848 ns/iter	4392694.444444554 ns/iter	1.06
E2E_Compiler_users_array	872577.2357724071 ns/iter	1142592.2685774658 ns/iter	0.76
E2E_Compiler_vercel	13158495.535715733 ns/iter	19371218.512194503 ns/iter	0.68
E2E_Compiler_yamllint	273164.9061033159 ns/iter	353121.11394973076 ns/iter	0.77
E2E_Evaluator_adaptivecard	23014.944888365488 ns/iter	21144.87146313973 ns/iter	1.09
E2E_Evaluator_ansible_meta	187657.31660724236 ns/iter	166792.91950033256 ns/iter	1.13
E2E_Evaluator_aws_cdk	40031.91217769207 ns/iter	43628.05841096271 ns/iter	0.92
E2E_Evaluator_babelrc	93780.33403517057 ns/iter	118049.09287083364 ns/iter	0.79
E2E_Evaluator_cerebrum_criminal_case	831975.9664803125 ns/iter	925145.3663133197 ns/iter	0.90
E2E_Evaluator_clang_format	134898.01668748076 ns/iter	115834.58013584932 ns/iter	1.16
E2E_Evaluator_cmake_presets	3856368.2513964963 ns/iter	3926549.3589744857 ns/iter	0.98
E2E_Evaluator_code_climate	146431.9356699132 ns/iter	155790.38761704502 ns/iter	0.94
E2E_Evaluator_cql2	165892.50023595832 ns/iter	199347.47740999583 ns/iter	0.83
E2E_Evaluator_cspell	615809.4798165454 ns/iter	417275.4041522658 ns/iter	1.48
E2E_Evaluator_cypress	179407.43205377998 ns/iter	188713.151998294 ns/iter	0.95
E2E_Evaluator_deno	280426.5290722038 ns/iter	215535.36908122903 ns/iter	1.30
E2E_Evaluator_dependabot	306875.76028846786 ns/iter	277774.01494022354 ns/iter	1.10
E2E_Evaluator_draft_04	6105300.813007074 ns/iter	4826214.154412448 ns/iter	1.27
E2E_Evaluator_fabric_mod	643121.4548611544 ns/iter	471465.70133724506 ns/iter	1.36
E2E_Evaluator_geojson	10468003.906247247 ns/iter	10796722.02739521 ns/iter	0.97
E2E_Evaluator_gitpod_configuration	153278.71179042076 ns/iter	170226.49719628788 ns/iter	0.90
E2E_Evaluator_helm_chart_lock	197469.0802427806 ns/iter	212910.57511423735 ns/iter	0.93
E2E_Evaluator_importmap	30421.31748105464 ns/iter	28737.193389162054 ns/iter	1.06
E2E_Evaluator_jasmine	81221.26619022813 ns/iter	77483.17165218273 ns/iter	1.05
E2E_Evaluator_jshintrc	898934.5930232699 ns/iter	840022.155688677 ns/iter	1.07
E2E_Evaluator_jsconfig	300182.43684869853 ns/iter	274674.7683881337 ns/iter	1.09
E2E_Evaluator_krakend	125342.91323962399 ns/iter	134920.92391304858 ns/iter	0.93
E2E_Evaluator_lazygit	88364.92086241292 ns/iter	84305.62060694369 ns/iter	1.05
E2E_Evaluator_lerna	107173.22446152348 ns/iter	100160.90292647523 ns/iter	1.07
E2E_Evaluator_nest_cli	130277.0889526502 ns/iter	111052.13967547704 ns/iter	1.17
E2E_Evaluator_omc	12721.094495133606 ns/iter	12037.730075307176 ns/iter	1.06
E2E_Evaluator_omnisharp	428797.2059347213 ns/iter	401403.54642056854 ns/iter	1.07
E2E_Evaluator_openapi	5502424.804687322 ns/iter	4833815.573643846 ns/iter	1.14
E2E_Evaluator_pre_commit_hooks	326297.0331186526 ns/iter	302583.1316600744 ns/iter	1.08
E2E_Evaluator_pulumi	486039.8550725252 ns/iter	458383.8585185057 ns/iter	1.06
E2E_Evaluator_semantic_release	67706.431934399 ns/iter	65232.434017076695 ns/iter	1.04
E2E_Evaluator_stale	109678.06647132285 ns/iter	101332.21548724303 ns/iter	1.08
E2E_Evaluator_stylecop	182317.4558786587 ns/iter	165926.62945699162 ns/iter	1.10
E2E_Evaluator_tmuxinator	68177.15046629768 ns/iter	63052.32900842004 ns/iter	1.08
E2E_Evaluator_ui5	321004.25287353573 ns/iter	298646.5904232614 ns/iter	1.07
E2E_Evaluator_ui5_manifest	1518742.4339621498 ns/iter	1332627.316091895 ns/iter	1.14
E2E_Evaluator_unreal_engine_uproject	303204.8310224892 ns/iter	282918.4886639136 ns/iter	1.07
E2E_Evaluator_users_array	400558.97305211535 ns/iter	371898.1972428003 ns/iter	1.08
E2E_Evaluator_vercel	209274.78782223625 ns/iter	194837.09746369353 ns/iter	1.07
E2E_Evaluator_yamllint	5666.695596264904 ns/iter	5226.266616503612 ns/iter	1.08
Micro_Draft4_Meta_1_No_Callback	124.04275339976961 ns/iter	117.22621021679383 ns/iter	1.06
Micro_Draft4_Required_Properties	607.8175571949326 ns/iter	569.6679483857682 ns/iter	1.07
Micro_Draft4_Many_Optional_Properties_Minimal_Match	15.325529409576177 ns/iter	14.382313976447815 ns/iter	1.07
Micro_Draft4_Few_Optional_Properties_Minimal_Match	6.947380186807416 ns/iter	6.48014843646608 ns/iter	1.07
Micro_Draft4_Items_Schema	251.09422794068152 ns/iter	244.70069715099243 ns/iter	1.03
Micro_Draft4_Nested_Object	0.6879412896332823 ns/iter	0.6470032336582935 ns/iter	1.06
Micro_Draft4_Properties_Triad_Optional	196.81539704083607 ns/iter	183.63084156200097 ns/iter	1.07
Micro_Draft4_Properties_Triad_Closed	161.42624066680938 ns/iter	151.2269577586396 ns/iter	1.07
Micro_Draft4_Properties_Triad_Required	202.7538040057736 ns/iter	191.68590070589218 ns/iter	1.06
Micro_Draft4_Properties_Closed	36.092128618890285 ns/iter	34.02595640850718 ns/iter	1.06
Micro_Draft4_Non_Recursive_Ref	12.378791423381843 ns/iter	11.874722347794929 ns/iter	1.04
Micro_Draft4_Pattern_Properties_True	131.70132174177584 ns/iter	137.23702603695503 ns/iter	0.96
Micro_Draft4_Ref_To_Single_Property	6.869377618208758 ns/iter	6.586328535766052 ns/iter	1.04
Micro_Draft4_Additional_Properties_Type	24.90195294132108 ns/iter	23.44071100473424 ns/iter	1.06
Micro_Draft4_Nested_Oneof	41.10979534003199 ns/iter	38.94321739418388 ns/iter	1.06
Micro_Draft4_Short_Enum	4.834736943201277 ns/iter	4.6142421045451725 ns/iter	1.05
Micro_Draft4_Long_Enum	9.840944914341627 ns/iter	9.525353498107503 ns/iter	1.03
Micro_Draft4_Long_Enum_Short_Strings	6.32909363720891 ns/iter	5.66022584422106 ns/iter	1.12
Micro_Draft4_Type_Object	2.1246953904398556 ns/iter	1.9977589983359674 ns/iter	1.06
Micro_Draft4_Ref_Single_100	1641328.360382125 ns/iter	1547576.3424033516 ns/iter	1.06
Micro_Draft4_Compile_Ref_Many_Nested	1203371.105820396 ns/iter	1122162.2137160546 ns/iter	1.07
Micro_Draft4_Compile_Wrap	1957616.315492897 ns/iter	1829406.1406252857 ns/iter	1.07
Micro_Draft6_Property_Names	91.99511653672872 ns/iter	87.40584010936895 ns/iter	1.05
Micro_Draft6_Compile_FHIR	8971429333.00006 ns/iter	7251638167.0000105 ns/iter	1.24
Micro_Draft7_If_Then_Else	17.238274184655985 ns/iter	17.007902689563945 ns/iter	1.01
Micro_2019_09_Unevaluated_Properties	25.769619164215257 ns/iter	24.62341378740114 ns/iter	1.05
Micro_2019_09_Compile_Wrap	291217707.99997646 ns/iter	264121972.33329 ns/iter	1.10
Micro_2020_12_Dynamic_Ref	180.73625855441563 ns/iter	170.43158819121663 ns/iter	1.06
Micro_2020_12_Dynamic_Ref_Single	2.1158660942529757 ns/iter	2.005071334235757 ns/iter	1.06
Micro_2020_12_Simple_Output_Mask	758.4729572082957 ns/iter	716.4698748888796 ns/iter	1.06
Micro_2020_12_Simple_Output_Annotations	85792.71454111072 ns/iter	79338.49994357566 ns/iter	1.08
Micro_2020_12_Compile_NonCircular_Shared_Refs	835280.8953340544 ns/iter	731852.5543934533 ns/iter	1.14
Micro_2020_12_Exhaustive_Deep_Numeric	5143.712334270601 ns/iter	5073.358302413843 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	114426.37768863041 ns/iter	107144.70778906517 ns/iter	1.07
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	14016.996224164584 ns/iter	13133.58224337371 ns/iter	1.07
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	92.22402445165575 ns/iter	85.8873589265601 ns/iter	1.07
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4682.286047556477 ns/iter	4540.868762748984 ns/iter	1.03
Alterschema_Check_Readibility_ISO_Language_Set_3	231110097.33338508 ns/iter	207981902.99994227 ns/iter	1.11
Alterschema_Check_Readibility_OMC	57476125.00001272 ns/iter	50536238.071426205 ns/iter	1.14
Alterschema_Check_Readibility_KrakenD	654915500.0000155 ns/iter	564041542.0000409 ns/iter	1.16
Alterschema_Apply_Readibility_KrakenD	66126090167.00003 ns/iter	58472012041.0002 ns/iter	1.13
Alterschema_Check_Invalid_External_Refs	173426406.2499733 ns/iter	142577725.000001 ns/iter	1.22

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: 55090fa	Previous: 06b8d70	Ratio
E2E_Evaluator_adaptivecard	94473 ns	89403 ns	1.06
E2E_Evaluator_ansible-meta	341228 ns	318559 ns	1.07
E2E_Evaluator_aws-cdk	116311 ns	112236 ns	1.04
E2E_Evaluator_babelrc	243730 ns	235228 ns	1.04
E2E_Evaluator_cerebrum-criminal-case	1672923 ns	1583382 ns	1.06
E2E_Evaluator_clang-format	214730 ns	166073 ns	1.29
E2E_Evaluator_cmake-presets	12206914 ns	10493954 ns	1.16
E2E_Evaluator_code-climate	411940 ns	367842 ns	1.12
E2E_Evaluator_cql2	999666 ns	940878 ns	1.06
E2E_Evaluator_cspell	1281855 ns	1039508 ns	1.23
E2E_Evaluator_cypress	559932 ns	510323 ns	1.10
E2E_Evaluator_deno	776604 ns	594431 ns	1.31
E2E_Evaluator_dependabot	771066 ns	673970 ns	1.14
E2E_Evaluator_draft-04	15933888 ns	14664140 ns	1.09
E2E_Evaluator_fabric-mod	1502525 ns	1321155 ns	1.14
E2E_Evaluator_geojson	16593640 ns	15345265 ns	1.08
E2E_Evaluator_gitpod-configuration	478817 ns	439382 ns	1.09
E2E_Evaluator_helm-chart-lock	871911 ns	814116 ns	1.07
E2E_Evaluator_importmap	228107 ns	198560 ns	1.15
E2E_Evaluator_jasmine	218440 ns	206003 ns	1.06
E2E_Evaluator_jsconfig	944033 ns	826690 ns	1.14
E2E_Evaluator_jshintrc	2105612 ns	1911289 ns	1.10
E2E_Evaluator_krakend	444401 ns	409457 ns	1.09
E2E_Evaluator_lazygit	270498 ns	253969 ns	1.07
E2E_Evaluator_lerna	316160 ns	289432 ns	1.09
E2E_Evaluator_nest-cli	405732 ns	384690 ns	1.05
E2E_Evaluator_omc	69473 ns	68400 ns	1.02
E2E_Evaluator_omnisharp	1027136 ns	954300 ns	1.08
E2E_Evaluator_openapi	16697233 ns	14609807 ns	1.14
E2E_Evaluator_pre-commit-hooks	1302474 ns	1210853 ns	1.08
E2E_Evaluator_pulumi	1433118 ns	1249902 ns	1.15
E2E_Evaluator_semantic-release	179064 ns	167686 ns	1.07
E2E_Evaluator_stale	286374 ns	264155 ns	1.08
E2E_Evaluator_stylecop	711024 ns	659287 ns	1.08
E2E_Evaluator_tmuxinator	162729 ns	149755 ns	1.09
E2E_Evaluator_ui5	1594983 ns	1385062 ns	1.15
E2E_Evaluator_ui5-manifest	8048291 ns	6484438 ns	1.24
E2E_Evaluator_unreal-engine-uproject	1218196 ns	1066891 ns	1.14
E2E_Evaluator_users-array	1860908 ns	1705996 ns	1.09
E2E_Evaluator_vercel	861641 ns	645380 ns	1.34
E2E_Evaluator_yamllint	26973 ns	25071 ns	1.08

This comment was automatically generated by workflow using github-action-benchmark.