Merge the Codegen project into Blaze#739
Merged
Merged
Conversation
Mostly out of convenience. So we don't have to be switching between projects and upgrading them all the time. Lots of time wasted due to that. Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
jviotti
commented
Apr 21, 2026
jviotti
commented
Apr 21, 2026
jviotti
commented
Apr 21, 2026
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
|
This pull request is abnormally large and would use a significant amount of tokens to review. If you still wish to review it, comment "augment review" and we will review it. |
![cubic-dev-ai[bot]](https://avatars.githubusercontent.com/in/1082092?s=60&v=4){kind=small}
There was a problem hiding this comment.
6 issues found across 214 files
Note: This PR contains a large number of files. cubic only reviews up to 75 files per PR, so some files may not have been reviewed. cubic prioritises the most important files to review.
Prompt for AI agents (unresolved issues)
Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.
<file name="src/codegen/include/sourcemeta/blaze/codegen_error.h">
<violation number="1" location="src/codegen/include/sourcemeta/blaze/codegen_error.h:32">
P1: Storing `message` as `const char *` makes `what()` lifetime-unsafe; a non-static input string can leave a dangling pointer.</violation>
</file>
<file name="test/codegen/e2e/typescript/2020-12/allof_intersection/schema.json">
<violation number="1" location="test/codegen/e2e/typescript/2020-12/allof_intersection/schema.json:10">
P2: Move the closed-object constraint out of each `allOf` branch. As written, each branch rejects the other field, so this fixture can never validate the "name + age" case that the test expects.</violation>
</file>
<file name="config.cmake.in">
<violation number="1" location="config.cmake.in:13">
P1: Make the default codegen component conditional on `BLAZE_CODEGEN`; otherwise installs built without codegen will fail during `find_package(Blaze)`.</violation>
</file>
<file name="src/codegen/include/sourcemeta/blaze/codegen_typescript.h">
<violation number="1" location="src/codegen/include/sourcemeta/blaze/codegen_typescript.h:54">
P2: Storing `std::string_view` as a long-lived member risks dangling references when the constructor is called with a temporary or short-lived string. Prefer owning storage (e.g., `std::string`) or otherwise guarantee the lifetime in the API.</violation>
</file>
<file name="src/codegen/CMakeLists.txt">
<violation number="1" location="src/codegen/CMakeLists.txt:18">
P1: Add the missing core::regex/core::uri link dependencies; this target's sources use those symbols directly, but the CMake file only links json/jsonschema/alterschema.</violation>
</file>
<file name="contrib/typescript.cc">
<violation number="1" location="contrib/typescript.cc:28">
P2: Handle non-codegen failures here too; invalid options and unreadable schemas currently escape as uncaught exceptions.</violation>
</file>
Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.
| public: | ||
| CodegenUnsupportedKeywordError(sourcemeta::core::JSON json, | ||
| sourcemeta::core::Pointer pointer, | ||
| std::string keyword, const char *message) |
There was a problem hiding this comment.
P1: Storing message as const char * makes what() lifetime-unsafe; a non-static input string can leave a dangling pointer.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/codegen/include/sourcemeta/blaze/codegen_error.h, line 32:
<comment>Storing `message` as `const char *` makes `what()` lifetime-unsafe; a non-static input string can leave a dangling pointer.</comment>
<file context>
@@ -0,0 +1,181 @@
+public:
+ CodegenUnsupportedKeywordError(sourcemeta::core::JSON json,
+ sourcemeta::core::Pointer pointer,
+ std::string keyword, const char *message)
+ : json_{std::move(json)}, pointer_{std::move(pointer)},
+ keyword_{std::move(keyword)}, message_{message} {}
</file context>
| list(APPEND BLAZE_COMPONENTS test) | ||
| list(APPEND BLAZE_COMPONENTS configuration) | ||
| list(APPEND BLAZE_COMPONENTS alterschema) | ||
| list(APPEND BLAZE_COMPONENTS codegen) |
There was a problem hiding this comment.
P1: Make the default codegen component conditional on BLAZE_CODEGEN; otherwise installs built without codegen will fail during find_package(Blaze).
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At config.cmake.in, line 13:
<comment>Make the default codegen component conditional on `BLAZE_CODEGEN`; otherwise installs built without codegen will fail during `find_package(Blaze)`.</comment>
<file context>
@@ -10,6 +10,7 @@ if(NOT BLAZE_COMPONENTS)
list(APPEND BLAZE_COMPONENTS test)
list(APPEND BLAZE_COMPONENTS configuration)
list(APPEND BLAZE_COMPONENTS alterschema)
+ list(APPEND BLAZE_COMPONENTS codegen)
endif()
</file context>
Suggested change
| list(APPEND BLAZE_COMPONENTS codegen) | |
| if(@BLAZE_CODEGEN@) | |
| list(APPEND BLAZE_COMPONENTS codegen) | |
| endif() |
| target_link_libraries(sourcemeta_blaze_codegen PUBLIC | ||
| sourcemeta::core::json) | ||
| target_link_libraries(sourcemeta_blaze_codegen PUBLIC | ||
| sourcemeta::core::jsonschema) |
There was a problem hiding this comment.
P1: Add the missing core::regex/core::uri link dependencies; this target's sources use those symbols directly, but the CMake file only links json/jsonschema/alterschema.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/codegen/CMakeLists.txt, line 18:
<comment>Add the missing core::regex/core::uri link dependencies; this target's sources use those symbols directly, but the CMake file only links json/jsonschema/alterschema.</comment>
<file context>
@@ -0,0 +1,20 @@
+target_link_libraries(sourcemeta_blaze_codegen PUBLIC
+ sourcemeta::core::json)
+target_link_libraries(sourcemeta_blaze_codegen PUBLIC
+ sourcemeta::core::jsonschema)
+target_link_libraries(sourcemeta_blaze_codegen PRIVATE
+ sourcemeta::blaze::alterschema)
</file context>
| "name": { "type": "string" } | ||
| }, | ||
| "required": [ "name" ], | ||
| "additionalProperties": false |
There was a problem hiding this comment.
P2: Move the closed-object constraint out of each allOf branch. As written, each branch rejects the other field, so this fixture can never validate the "name + age" case that the test expects.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/codegen/e2e/typescript/2020-12/allof_intersection/schema.json, line 10:
<comment>Move the closed-object constraint out of each `allOf` branch. As written, each branch rejects the other field, so this fixture can never validate the "name + age" case that the test expects.</comment>
<file context>
@@ -0,0 +1,21 @@
+ "name": { "type": "string" }
+ },
+ "required": [ "name" ],
+ "additionalProperties": false
+ },
+ {
</file context>
| #endif | ||
| // NOLINTNEXTLINE(cppcoreguidelines-avoid-const-or-ref-data-members) | ||
| std::ostream &output; | ||
| std::string_view prefix; |
There was a problem hiding this comment.
P2: Storing std::string_view as a long-lived member risks dangling references when the constructor is called with a temporary or short-lived string. Prefer owning storage (e.g., std::string) or otherwise guarantee the lifetime in the API.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/codegen/include/sourcemeta/blaze/codegen_typescript.h, line 54:
<comment>Storing `std::string_view` as a long-lived member risks dangling references when the constructor is called with a temporary or short-lived string. Prefer owning storage (e.g., `std::string`) or otherwise guarantee the lifetime in the API.</comment>
<file context>
@@ -0,0 +1,63 @@
+#endif
+ // NOLINTNEXTLINE(cppcoreguidelines-avoid-const-or-ref-data-members)
+ std::ostream &output;
+ std::string_view prefix;
+ std::map<std::string, sourcemeta::core::Pointer> cache;
+#if defined(_MSC_VER)
</file context>
| @@ -0,0 +1,75 @@ | |||
| #include <sourcemeta/blaze/codegen.h> | |||
There was a problem hiding this comment.
P2: Handle non-codegen failures here too; invalid options and unreadable schemas currently escape as uncaught exceptions.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At contrib/typescript.cc, line 28:
<comment>Handle non-codegen failures here too; invalid options and unreadable schemas currently escape as uncaught exceptions.</comment>
<file context>
@@ -0,0 +1,75 @@
+ const std::filesystem::path schema_path{positional_arguments.front()};
+
+ try {
+ const auto schema{sourcemeta::core::read_json(schema_path)};
+
+ const auto result{
</file context>
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: 4ab2c85 | Previous: 0ff98cb | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
62690355.22223021 ns/iter |
59765908.500003204 ns/iter |
1.05 |
E2E_Compiler_ansible_meta |
29143543.374999583 ns/iter |
25609544.703703098 ns/iter |
1.14 |
E2E_Compiler_aws_cdk |
380367.96800432436 ns/iter |
332631.24940504745 ns/iter |
1.14 |
E2E_Compiler_babelrc |
2585187.8339480916 ns/iter |
2264976.738709654 ns/iter |
1.14 |
E2E_Compiler_clang_format |
18599117.894735318 ns/iter |
16297539.325581396 ns/iter |
1.14 |
E2E_Compiler_cmake_presets |
25756481.333334904 ns/iter |
24052355.89655039 ns/iter |
1.07 |
E2E_Compiler_code_climate |
2615973.8426966295 ns/iter |
2339060.9499999 ns/iter |
1.12 |
E2E_Compiler_cql2 |
12931202.185185425 ns/iter |
12053080.844827162 ns/iter |
1.07 |
E2E_Compiler_cspell |
22622702.677417986 ns/iter |
20860160.06060645 ns/iter |
1.08 |
E2E_Compiler_cypress |
3918383.2849161844 ns/iter |
3510538.605000022 ns/iter |
1.12 |
E2E_Compiler_deno |
7742206.611111315 ns/iter |
6644865.9238095125 ns/iter |
1.17 |
E2E_Compiler_dependabot |
3957117.5875704223 ns/iter |
3461276.975247468 ns/iter |
1.14 |
E2E_Compiler_draft_04 |
2700936.768339601 ns/iter |
2391933.4965753076 ns/iter |
1.13 |
E2E_Compiler_fabric_mod |
4804307.787670863 ns/iter |
4232919.212121156 ns/iter |
1.13 |
E2E_Compiler_geojson |
22046764.21875007 ns/iter |
19974510.48571455 ns/iter |
1.10 |
E2E_Compiler_gitpod_configuration |
4939634.401408275 ns/iter |
4322384.574073991 ns/iter |
1.14 |
E2E_Compiler_helm_chart_lock |
710626.2728205902 ns/iter |
605986.0513489565 ns/iter |
1.17 |
E2E_Compiler_importmap |
284903.695599021 ns/iter |
252840.4178571415 ns/iter |
1.13 |
E2E_Compiler_jasmine |
1361797.9766989981 ns/iter |
1206940.7577319138 ns/iter |
1.13 |
E2E_Compiler_jshintrc |
4348620.559006162 ns/iter |
3716789.121693173 ns/iter |
1.17 |
E2E_Compiler_jsconfig |
21838009.749998834 ns/iter |
18853636.6216214 ns/iter |
1.16 |
E2E_Compiler_krakend |
139871114.59998685 ns/iter |
123609423.8333294 ns/iter |
1.13 |
E2E_Compiler_lazygit |
33317081.4761897 ns/iter |
29704672.208332285 ns/iter |
1.12 |
E2E_Compiler_lerna |
1606163.8597700468 ns/iter |
1410328.1108871882 ns/iter |
1.14 |
E2E_Compiler_nest_cli |
7429003.117021665 ns/iter |
6483091.733333541 ns/iter |
1.15 |
E2E_Compiler_omc |
153642490.79998446 ns/iter |
138866728.20000285 ns/iter |
1.11 |
E2E_Compiler_omnisharp |
6747976.884615635 ns/iter |
5783161.595041082 ns/iter |
1.17 |
E2E_Compiler_openapi |
24896107.857143436 ns/iter |
21907674.624999985 ns/iter |
1.14 |
E2E_Compiler_pre_commit_hooks |
5323042.924242248 ns/iter |
4625723.353333342 ns/iter |
1.15 |
E2E_Compiler_pulumi |
4017187.8160916767 ns/iter |
3550149.3807105892 ns/iter |
1.13 |
E2E_Compiler_semantic_release |
1575473.8171556199 ns/iter |
1414485.7303823726 ns/iter |
1.11 |
E2E_Compiler_stale |
1550584.7654867265 ns/iter |
1360956.603112787 ns/iter |
1.14 |
E2E_Compiler_stylecop |
6194851.65486721 ns/iter |
5287140.432835459 ns/iter |
1.17 |
E2E_Compiler_tmuxinator |
1935409.8725761762 ns/iter |
1701773.2815533252 ns/iter |
1.14 |
E2E_Compiler_ui5 |
48113211.1333333 ns/iter |
42781575.06250224 ns/iter |
1.12 |
E2E_Compiler_ui5_manifest |
305187234.5000106 ns/iter |
277023677.9999967 ns/iter |
1.10 |
E2E_Compiler_unreal_engine_uproject |
4588192.633987032 ns/iter |
4027272.9200000865 ns/iter |
1.14 |
E2E_Compiler_users_array |
792047.6896943505 ns/iter |
721769.1739583643 ns/iter |
1.10 |
E2E_Compiler_vercel |
12519041.696429716 ns/iter |
11098617.206349509 ns/iter |
1.13 |
E2E_Compiler_yamllint |
346686.60932076315 ns/iter |
307229.6125493784 ns/iter |
1.13 |
E2E_Evaluator_adaptivecard |
24230.028795006463 ns/iter |
20910.3446043164 ns/iter |
1.16 |
E2E_Evaluator_ansible_meta |
226950.22464238372 ns/iter |
197770.28948105316 ns/iter |
1.15 |
E2E_Evaluator_aws_cdk |
50066.53271877003 ns/iter |
42798.124086694734 ns/iter |
1.17 |
E2E_Evaluator_babelrc |
108325.29140967004 ns/iter |
89933.37176653855 ns/iter |
1.20 |
E2E_Evaluator_cerebrum_criminal_case |
947159.234417288 ns/iter |
987575.0428571856 ns/iter |
0.96 |
E2E_Evaluator_clang_format |
120372.83125863614 ns/iter |
114679.66971577394 ns/iter |
1.05 |
E2E_Evaluator_cmake_presets |
4140765.964706027 ns/iter |
4142647.9058824335 ns/iter |
1.00 |
E2E_Evaluator_code_climate |
172916.24411985162 ns/iter |
182478.80870021673 ns/iter |
0.95 |
E2E_Evaluator_cql2 |
221384.66537843423 ns/iter |
183687.25769938508 ns/iter |
1.21 |
E2E_Evaluator_cspell |
560026.6063745122 ns/iter |
544849.6387802606 ns/iter |
1.03 |
E2E_Evaluator_cypress |
189195.5081344945 ns/iter |
172172.76089633605 ns/iter |
1.10 |
E2E_Evaluator_deno |
311942.1715425623 ns/iter |
314427.7449118207 ns/iter |
0.99 |
E2E_Evaluator_dependabot |
312877.37522203947 ns/iter |
316632.0682640238 ns/iter |
0.99 |
E2E_Evaluator_draft_04 |
6810453.680411707 ns/iter |
7019890.60869548 ns/iter |
0.97 |
E2E_Evaluator_fabric_mod |
679481.2691190783 ns/iter |
645490.9239543702 ns/iter |
1.05 |
E2E_Evaluator_geojson |
15820014.255813327 ns/iter |
15891605.60465141 ns/iter |
1.00 |
E2E_Evaluator_gitpod_configuration |
226930.48850952942 ns/iter |
228260.51412614464 ns/iter |
0.99 |
E2E_Evaluator_helm_chart_lock |
346472.7739483019 ns/iter |
405203.73787527933 ns/iter |
0.86 |
E2E_Evaluator_importmap |
47366.85075629855 ns/iter |
34243.70883266783 ns/iter |
1.38 |
E2E_Evaluator_jasmine |
104732.84198679248 ns/iter |
94915.91874574045 ns/iter |
1.10 |
E2E_Evaluator_jshintrc |
1200714.965753452 ns/iter |
1143051.8983606594 ns/iter |
1.05 |
E2E_Evaluator_jsconfig |
419577.7125748796 ns/iter |
377880.05157436914 ns/iter |
1.11 |
E2E_Evaluator_krakend |
201812.65750650933 ns/iter |
172800.79548274458 ns/iter |
1.17 |
E2E_Evaluator_lazygit |
149802.86045521358 ns/iter |
140324.3228267316 ns/iter |
1.07 |
E2E_Evaluator_lerna |
136595.95477582765 ns/iter |
125973.82376381235 ns/iter |
1.08 |
E2E_Evaluator_nest_cli |
174861.1383647654 ns/iter |
177206.0918548526 ns/iter |
0.99 |
E2E_Evaluator_omc |
17517.689995769844 ns/iter |
16058.784032868767 ns/iter |
1.09 |
E2E_Evaluator_omnisharp |
614960.2230971379 ns/iter |
553461.9641719778 ns/iter |
1.11 |
E2E_Evaluator_openapi |
9092908.054794425 ns/iter |
9388145.24999998 ns/iter |
0.97 |
E2E_Evaluator_pre_commit_hooks |
464351.5977394064 ns/iter |
497055.6872778911 ns/iter |
0.93 |
E2E_Evaluator_pulumi |
668916.2449566869 ns/iter |
702658.7794715217 ns/iter |
0.95 |
E2E_Evaluator_semantic_release |
95776.56611514676 ns/iter |
77318.39316239559 ns/iter |
1.24 |
E2E_Evaluator_stale |
146276.36323806204 ns/iter |
138046.38616600752 ns/iter |
1.06 |
E2E_Evaluator_stylecop |
287719.0883910713 ns/iter |
300628.0745047051 ns/iter |
0.96 |
E2E_Evaluator_tmuxinator |
99569.65602485064 ns/iter |
80604.1878969757 ns/iter |
1.24 |
E2E_Evaluator_ui5 |
497370.5485507134 ns/iter |
459482.2899604056 ns/iter |
1.08 |
E2E_Evaluator_ui5_manifest |
2466695.1654411075 ns/iter |
2405078.5724139605 ns/iter |
1.03 |
E2E_Evaluator_unreal_engine_uproject |
420437.5922798567 ns/iter |
427085.99633925693 ns/iter |
0.98 |
E2E_Evaluator_users_array |
528942.3603331452 ns/iter |
576931.9744645647 ns/iter |
0.92 |
E2E_Evaluator_vercel |
323839.5094600898 ns/iter |
329884.741828489 ns/iter |
0.98 |
E2E_Evaluator_yamllint |
8074.128870956294 ns/iter |
7627.208668428475 ns/iter |
1.06 |
Micro_Draft4_Meta_1_No_Callback |
198.59252314205577 ns/iter |
188.86599119378886 ns/iter |
1.05 |
Micro_Draft4_Required_Properties |
790.2968124681541 ns/iter |
817.8461076345507 ns/iter |
0.97 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
20.87576520350357 ns/iter |
21.730104302075127 ns/iter |
0.96 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
10.904284681467562 ns/iter |
9.942832857639576 ns/iter |
1.10 |
Micro_Draft4_Items_Schema |
312.69913339300587 ns/iter |
280.0581527036163 ns/iter |
1.12 |
Micro_Draft4_Nested_Object |
1.8154779913279948 ns/iter |
1.1523353982746989 ns/iter |
1.58 |
Micro_Draft4_Properties_Triad_Optional |
323.3018310803232 ns/iter |
303.0385021359922 ns/iter |
1.07 |
Micro_Draft4_Properties_Triad_Closed |
266.0781205869697 ns/iter |
249.77485421367066 ns/iter |
1.07 |
Micro_Draft4_Properties_Triad_Required |
342.1461540037268 ns/iter |
315.63166565902515 ns/iter |
1.08 |
Micro_Draft4_Properties_Closed |
55.42924112837182 ns/iter |
54.311016481855205 ns/iter |
1.02 |
Micro_Draft4_Non_Recursive_Ref |
12.16228019368626 ns/iter |
10.41800798090356 ns/iter |
1.17 |
Micro_Draft4_Pattern_Properties_True |
151.59252962322867 ns/iter |
119.4746929465881 ns/iter |
1.27 |
Micro_Draft4_Ref_To_Single_Property |
10.892046900788733 ns/iter |
9.93960153570779 ns/iter |
1.10 |
Micro_Draft4_Additional_Properties_Type |
22.112633305803243 ns/iter |
19.098049623834992 ns/iter |
1.16 |
Micro_Draft4_Nested_Oneof |
57.90074325859981 ns/iter |
47.11872317733245 ns/iter |
1.23 |
Micro_Draft4_Short_Enum |
11.831155438845968 ns/iter |
10.132608386380717 ns/iter |
1.17 |
Micro_Draft4_Long_Enum |
14.030747925326283 ns/iter |
10.634686184831468 ns/iter |
1.32 |
Micro_Draft4_Long_Enum_Short_Strings |
11.83079952247468 ns/iter |
10.112693314379504 ns/iter |
1.17 |
Micro_Draft4_Type_Object |
3.425427361799554 ns/iter |
2.8885100492478544 ns/iter |
1.19 |
Micro_Draft4_Ref_Single_100 |
2383207.5748299956 ns/iter |
2113396.9063443327 ns/iter |
1.13 |
Micro_Draft4_Compile_Ref_Many_Nested |
1717738.563725697 ns/iter |
1541306.341409826 ns/iter |
1.11 |
Micro_Draft4_Compile_Wrap |
2354838.0675675627 ns/iter |
2109156.05421678 ns/iter |
1.12 |
Micro_Draft6_Property_Names |
119.13767049591407 ns/iter |
113.5935187990898 ns/iter |
1.05 |
Micro_Draft6_Compile_FHIR |
14538219914.000025 ns/iter |
17734331783.000015 ns/iter |
0.82 |
Micro_Draft7_If_Then_Else |
23.346107317138628 ns/iter |
20.319184213712703 ns/iter |
1.15 |
Micro_2019_09_Unevaluated_Properties |
28.985809676452366 ns/iter |
25.780864966082707 ns/iter |
1.12 |
Micro_2019_09_Compile_Wrap |
314773583.5000276 ns/iter |
266251076.6666628 ns/iter |
1.18 |
Micro_2020_12_Dynamic_Ref |
225.74608455086317 ns/iter |
288.0794707746311 ns/iter |
0.78 |
Micro_2020_12_Dynamic_Ref_Single |
3.4253306505838848 ns/iter |
2.8823565255771486 ns/iter |
1.19 |
Micro_2020_12_Simple_Output_Mask |
1074.8972092561814 ns/iter |
921.715326970839 ns/iter |
1.17 |
Micro_2020_12_Simple_Output_Annotations |
103833.66209033647 ns/iter |
97932.14975368764 ns/iter |
1.06 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1111950.1150159095 ns/iter |
978573.0671327738 ns/iter |
1.14 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8498.604468664147 ns/iter |
8448.20323828506 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
175782.64002010928 ns/iter |
152106.9524432854 ns/iter |
1.16 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
22300.149601786306 ns/iter |
20761.629379371534 ns/iter |
1.07 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
142.01064987506888 ns/iter |
138.53182430444576 ns/iter |
1.03 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4319.301768435633 ns/iter |
3984.4722453914123 ns/iter |
1.08 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
345384648.9999819 ns/iter |
303009611.49998784 ns/iter |
1.14 |
Alterschema_Check_Readibility_OMC |
83930213.49999686 ns/iter |
88059346.62500192 ns/iter |
0.95 |
Alterschema_Check_Readibility_KrakenD |
1167432016.0000207 ns/iter |
1409364202.9999955 ns/iter |
0.83 |
Alterschema_Apply_Readibility_KrakenD |
117772327884.0001 ns/iter |
140244138005.0001 ns/iter |
0.84 |
Alterschema_Check_Invalid_External_Refs |
292318911.50004685 ns/iter |
229643458.00001714 ns/iter |
1.27 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/llvm)
Details
| Benchmark suite | Current: 4ab2c85 | Previous: 0ff98cb | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
115162 ns |
111187 ns |
1.04 |
E2E_Evaluator_ansible-meta |
504021 ns |
517390 ns |
0.97 |
E2E_Evaluator_aws-cdk |
135497 ns |
145704 ns |
0.93 |
E2E_Evaluator_babelrc |
307750 ns |
441668 ns |
0.70 |
E2E_Evaluator_cerebrum-criminal-case |
2347268 ns |
2401920 ns |
0.98 |
E2E_Evaluator_clang-format |
259020 ns |
307927 ns |
0.84 |
E2E_Evaluator_cmake-presets |
17286129 ns |
17204265 ns |
1.00 |
E2E_Evaluator_code-climate |
501207 ns |
526890 ns |
0.95 |
E2E_Evaluator_cql2 |
1160146 ns |
1135790 ns |
1.02 |
E2E_Evaluator_cspell |
1423872 ns |
1678050 ns |
0.85 |
E2E_Evaluator_cypress |
751376 ns |
988906 ns |
0.76 |
E2E_Evaluator_deno |
991160 ns |
1028368 ns |
0.96 |
E2E_Evaluator_dependabot |
1044238 ns |
1061066 ns |
0.98 |
E2E_Evaluator_draft-04 |
22669261 ns |
20502810 ns |
1.11 |
E2E_Evaluator_fabric-mod |
2281691 ns |
2248527 ns |
1.01 |
E2E_Evaluator_geojson |
27086238 ns |
26729093 ns |
1.01 |
E2E_Evaluator_gitpod-configuration |
687350 ns |
775451 ns |
0.89 |
E2E_Evaluator_helm-chart-lock |
966767 ns |
1061038 ns |
0.91 |
E2E_Evaluator_importmap |
273118 ns |
321635 ns |
0.85 |
E2E_Evaluator_jasmine |
293441 ns |
334207 ns |
0.88 |
E2E_Evaluator_jsconfig |
1223641 ns |
1602386 ns |
0.76 |
E2E_Evaluator_jshintrc |
2851081 ns |
3098841 ns |
0.92 |
E2E_Evaluator_krakend |
704185 ns |
639902 ns |
1.10 |
E2E_Evaluator_lazygit |
492265 ns |
474266 ns |
1.04 |
E2E_Evaluator_lerna |
451580 ns |
464571 ns |
0.97 |
E2E_Evaluator_nest-cli |
568567 ns |
687302 ns |
0.83 |
E2E_Evaluator_omc |
89433 ns |
84472 ns |
1.06 |
E2E_Evaluator_omnisharp |
1398288 ns |
1514752 ns |
0.92 |
E2E_Evaluator_openapi |
25174035 ns |
23741243 ns |
1.06 |
E2E_Evaluator_pre-commit-hooks |
1864303 ns |
2023945 ns |
0.92 |
E2E_Evaluator_pulumi |
1750249 ns |
2060948 ns |
0.85 |
E2E_Evaluator_semantic-release |
250541 ns |
314285 ns |
0.80 |
E2E_Evaluator_stale |
382758 ns |
426544 ns |
0.90 |
E2E_Evaluator_stylecop |
1110189 ns |
1135492 ns |
0.98 |
E2E_Evaluator_tmuxinator |
223068 ns |
296525 ns |
0.75 |
E2E_Evaluator_ui5 |
1990289 ns |
2024502 ns |
0.98 |
E2E_Evaluator_ui5-manifest |
10203014 ns |
9436709 ns |
1.08 |
E2E_Evaluator_unreal-engine-uproject |
1456960 ns |
1627323 ns |
0.90 |
E2E_Evaluator_users-array |
2286306 ns |
2182826 ns |
1.05 |
E2E_Evaluator_vercel |
947103 ns |
1041332 ns |
0.91 |
E2E_Evaluator_yamllint |
28084 ns |
29136 ns |
0.96 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: 4ab2c85 | Previous: 0ff98cb | Ratio |
|---|---|---|---|
Alterschema_Check_Readibility_ISO_Language_Set_3 |
347928507.000006 ns/iter |
370017957.0000728 ns/iter |
0.94 |
Alterschema_Check_Readibility_OMC |
95509227.42856267 ns/iter |
103188871.14284994 ns/iter |
0.93 |
Alterschema_Check_Readibility_KrakenD |
1285652973.9999588 ns/iter |
1466671142.999985 ns/iter |
0.88 |
Alterschema_Apply_Readibility_KrakenD |
123206350270.00003 ns/iter |
149481684477.00003 ns/iter |
0.82 |
Alterschema_Check_Invalid_External_Refs |
334033112.4999238 ns/iter |
316821075.99999654 ns/iter |
1.05 |
Micro_2020_12_Dynamic_Ref |
262.435855860011 ns/iter |
259.72978887182023 ns/iter |
1.01 |
Micro_2020_12_Dynamic_Ref_Single |
4.672723511482932 ns/iter |
4.359353907353041 ns/iter |
1.07 |
Micro_2020_12_Simple_Output_Mask |
1220.8754095840839 ns/iter |
1116.592137642876 ns/iter |
1.09 |
Micro_2020_12_Simple_Output_Annotations |
113742.04566951799 ns/iter |
103763.63186074625 ns/iter |
1.10 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1201173.774913898 ns/iter |
1183200.3513513051 ns/iter |
1.02 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8573.180763611492 ns/iter |
8290.122869521889 ns/iter |
1.03 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
166831.6437169316 ns/iter |
168144.26757527882 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
25605.34740091962 ns/iter |
26894.16934723661 ns/iter |
0.95 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
130.23854804458895 ns/iter |
135.37179201658134 ns/iter |
0.96 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4777.229130208496 ns/iter |
4531.341155765975 ns/iter |
1.05 |
Micro_2019_09_Unevaluated_Properties |
31.886364782167707 ns/iter |
29.237941984879978 ns/iter |
1.09 |
Micro_2019_09_Compile_Wrap |
301608374.00001127 ns/iter |
352372208.5000145 ns/iter |
0.86 |
Micro_Draft7_If_Then_Else |
24.287301548802066 ns/iter |
25.018944755670237 ns/iter |
0.97 |
Micro_Draft6_Property_Names |
143.1167281192115 ns/iter |
142.12109440805577 ns/iter |
1.01 |
Micro_Draft6_Compile_FHIR |
13223253189.00016 ns/iter |
20168387739.00008 ns/iter |
0.66 |
Micro_Draft4_Meta_1_No_Callback |
165.71953570353062 ns/iter |
173.03370584826553 ns/iter |
0.96 |
Micro_Draft4_Required_Properties |
826.8536997454398 ns/iter |
811.2547758325682 ns/iter |
1.02 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
20.893719031978335 ns/iter |
21.24614445849175 ns/iter |
0.98 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
13.41633434936468 ns/iter |
12.663300546585578 ns/iter |
1.06 |
Micro_Draft4_Items_Schema |
327.1435587836662 ns/iter |
318.2198184558657 ns/iter |
1.03 |
Micro_Draft4_Nested_Object |
2.17941841808732 ns/iter |
2.4632801469992964 ns/iter |
0.88 |
Micro_Draft4_Properties_Triad_Optional |
448.374043437919 ns/iter |
443.8416423386548 ns/iter |
1.01 |
Micro_Draft4_Properties_Triad_Closed |
364.4468834793179 ns/iter |
358.0856115018203 ns/iter |
1.02 |
Micro_Draft4_Properties_Triad_Required |
465.7198217165756 ns/iter |
453.46493777443385 ns/iter |
1.03 |
Micro_Draft4_Properties_Closed |
63.590676380601906 ns/iter |
62.08003759771148 ns/iter |
1.02 |
Micro_Draft4_Non_Recursive_Ref |
9.649125954911032 ns/iter |
8.847652198289463 ns/iter |
1.09 |
Micro_Draft4_Pattern_Properties_True |
216.8475409400139 ns/iter |
198.04988899375428 ns/iter |
1.09 |
Micro_Draft4_Ref_To_Single_Property |
14.022455545600922 ns/iter |
13.018054000017814 ns/iter |
1.08 |
Micro_Draft4_Additional_Properties_Type |
14.635047330090897 ns/iter |
15.160489936858108 ns/iter |
0.97 |
Micro_Draft4_Nested_Oneof |
65.44109499906688 ns/iter |
65.81322157161593 ns/iter |
0.99 |
Micro_Draft4_Short_Enum |
14.649108245190563 ns/iter |
14.767850332945814 ns/iter |
0.99 |
Micro_Draft4_Long_Enum |
14.647515304909833 ns/iter |
14.07275132732552 ns/iter |
1.04 |
Micro_Draft4_Long_Enum_Short_Strings |
14.656853437687891 ns/iter |
14.772478406186744 ns/iter |
0.99 |
Micro_Draft4_Type_Object |
4.669429349058538 ns/iter |
4.2331203267644675 ns/iter |
1.10 |
Micro_Draft4_Ref_Single_100 |
2508412.666665987 ns/iter |
2499615.871885998 ns/iter |
1.00 |
Micro_Draft4_Compile_Ref_Many_Nested |
1812987.800518277 ns/iter |
1826120.6467534727 ns/iter |
0.99 |
Micro_Draft4_Compile_Wrap |
2606199.770370613 ns/iter |
2579077.8671589545 ns/iter |
1.01 |
E2E_Compiler_adaptivecard |
64867823.36363914 ns/iter |
74249667.77777323 ns/iter |
0.87 |
E2E_Compiler_ansible_meta |
30271425.39129905 ns/iter |
31338957.52174122 ns/iter |
0.97 |
E2E_Compiler_aws_cdk |
417739.7201669811 ns/iter |
396912.24335035577 ns/iter |
1.05 |
E2E_Compiler_babelrc |
2787996.7250994076 ns/iter |
2789147.637450838 ns/iter |
1.00 |
E2E_Compiler_clang_format |
19656742.111111373 ns/iter |
20180509.85713801 ns/iter |
0.97 |
E2E_Compiler_cmake_presets |
27454743.759999476 ns/iter |
29198654.791665982 ns/iter |
0.94 |
E2E_Compiler_code_climate |
2842263.7854258837 ns/iter |
2846783.763265639 ns/iter |
1.00 |
E2E_Compiler_cql2 |
14159792.673469884 ns/iter |
14287105.959181422 ns/iter |
0.99 |
E2E_Compiler_cspell |
24102723.275855795 ns/iter |
25364496.275862057 ns/iter |
0.95 |
E2E_Compiler_cypress |
4245425.730538797 ns/iter |
4221244.987878559 ns/iter |
1.01 |
E2E_Compiler_deno |
8277879.694116349 ns/iter |
8359275.819276558 ns/iter |
0.99 |
E2E_Compiler_dependabot |
4272314.363635649 ns/iter |
4295534.425926145 ns/iter |
0.99 |
E2E_Compiler_draft_04 |
2936892.468618734 ns/iter |
2924289.037500216 ns/iter |
1.00 |
E2E_Compiler_fabric_mod |
5160359.272058954 ns/iter |
5171125.488888921 ns/iter |
1.00 |
E2E_Compiler_geojson |
24075852.103445366 ns/iter |
25862580.285718195 ns/iter |
0.93 |
E2E_Compiler_gitpod_configuration |
5307066.575756959 ns/iter |
5363490.276923026 ns/iter |
0.99 |
E2E_Compiler_helm_chart_lock |
755328.1515151275 ns/iter |
729464.1664933434 ns/iter |
1.04 |
E2E_Compiler_importmap |
311064.6348713499 ns/iter |
294325.3309534706 ns/iter |
1.06 |
E2E_Compiler_jasmine |
1488065.5621053798 ns/iter |
1449070.117768661 ns/iter |
1.03 |
E2E_Compiler_jshintrc |
4695987.570469227 ns/iter |
4685468.721854644 ns/iter |
1.00 |
E2E_Compiler_jsconfig |
23368284.533330552 ns/iter |
24213011.103444748 ns/iter |
0.97 |
E2E_Compiler_krakend |
143176962.60000047 ns/iter |
155929175.49997765 ns/iter |
0.92 |
E2E_Compiler_lazygit |
35364108.150008634 ns/iter |
37806718.388891466 ns/iter |
0.94 |
E2E_Compiler_lerna |
1767293.7607051698 ns/iter |
1732624.2419753892 ns/iter |
1.02 |
E2E_Compiler_nest_cli |
8059466.0344836125 ns/iter |
8077679.09195352 ns/iter |
1.00 |
E2E_Compiler_omc |
161894291.75000215 ns/iter |
177308951.25004053 ns/iter |
0.91 |
E2E_Compiler_omnisharp |
7299619.374999604 ns/iter |
7246634.572917779 ns/iter |
1.01 |
E2E_Compiler_openapi |
26727270.000002626 ns/iter |
27186406.96153985 ns/iter |
0.98 |
E2E_Compiler_pre_commit_hooks |
5718257.495933669 ns/iter |
5769398.264462798 ns/iter |
0.99 |
E2E_Compiler_pulumi |
4398360.220126143 ns/iter |
4388028.737500349 ns/iter |
1.00 |
E2E_Compiler_semantic_release |
1694026.012077684 ns/iter |
1687138.8840576804 ns/iter |
1.00 |
E2E_Compiler_stale |
1670673.602380984 ns/iter |
1659413.4407578772 ns/iter |
1.01 |
E2E_Compiler_stylecop |
6370448.153153153 ns/iter |
6415625.754545379 ns/iter |
0.99 |
E2E_Compiler_tmuxinator |
2106682.495495606 ns/iter |
2081089.934717858 ns/iter |
1.01 |
E2E_Compiler_ui5 |
48953381.07142574 ns/iter |
55025678.916668616 ns/iter |
0.89 |
E2E_Compiler_ui5_manifest |
315480834.49990827 ns/iter |
364540963.49996233 ns/iter |
0.87 |
E2E_Compiler_unreal_engine_uproject |
4927766.666666059 ns/iter |
4960960.071428287 ns/iter |
0.99 |
E2E_Compiler_users_array |
884230.2644108627 ns/iter |
848657.099999866 ns/iter |
1.04 |
E2E_Compiler_vercel |
13202740.749997806 ns/iter |
13607780.76923015 ns/iter |
0.97 |
E2E_Compiler_yamllint |
379113.59730457346 ns/iter |
363196.71613909793 ns/iter |
1.04 |
E2E_Evaluator_adaptivecard |
23115.172379070824 ns/iter |
23401.98467305884 ns/iter |
0.99 |
E2E_Evaluator_ansible_meta |
246886.28057807538 ns/iter |
223667.77255281908 ns/iter |
1.10 |
E2E_Evaluator_aws_cdk |
51937.257475450904 ns/iter |
44094.00037706732 ns/iter |
1.18 |
E2E_Evaluator_babelrc |
107725.94966340908 ns/iter |
84168.58262660196 ns/iter |
1.28 |
E2E_Evaluator_cerebrum_criminal_case |
1005645.351156248 ns/iter |
1075365.2121687403 ns/iter |
0.94 |
E2E_Evaluator_clang_format |
104920.35547047603 ns/iter |
102788.45554034857 ns/iter |
1.02 |
E2E_Evaluator_cmake_presets |
4356597.525000439 ns/iter |
5753880.412844035 ns/iter |
0.76 |
E2E_Evaluator_code_climate |
193484.42025742412 ns/iter |
164994.02880758158 ns/iter |
1.17 |
E2E_Evaluator_cql2 |
217821.8289225321 ns/iter |
201720.81907516668 ns/iter |
1.08 |
E2E_Evaluator_cspell |
548556.1859921021 ns/iter |
504283.23094339884 ns/iter |
1.09 |
E2E_Evaluator_cypress |
175138.3604302021 ns/iter |
141937.76017646972 ns/iter |
1.23 |
E2E_Evaluator_deno |
347290.7582195261 ns/iter |
274104.6716010687 ns/iter |
1.27 |
E2E_Evaluator_dependabot |
349913.8494461717 ns/iter |
338877.58345367905 ns/iter |
1.03 |
E2E_Evaluator_draft_04 |
6184491.564814228 ns/iter |
9591464.013157602 ns/iter |
0.64 |
E2E_Evaluator_fabric_mod |
727985.0604796865 ns/iter |
719352.3817991606 ns/iter |
1.01 |
E2E_Evaluator_geojson |
16122340.863634318 ns/iter |
18391005.578947492 ns/iter |
0.88 |
E2E_Evaluator_gitpod_configuration |
250067.88465646998 ns/iter |
224114.3006155182 ns/iter |
1.12 |
E2E_Evaluator_helm_chart_lock |
319915.00733266113 ns/iter |
222558.10158726707 ns/iter |
1.44 |
E2E_Evaluator_importmap |
50061.88679999468 ns/iter |
39888.94382866204 ns/iter |
1.26 |
E2E_Evaluator_jasmine |
115163.37613468483 ns/iter |
103700.70994392032 ns/iter |
1.11 |
E2E_Evaluator_jshintrc |
1037314.94213651 ns/iter |
1001194.7112068146 ns/iter |
1.04 |
E2E_Evaluator_jsconfig |
417591.52307688765 ns/iter |
367612.19269449665 ns/iter |
1.14 |
E2E_Evaluator_krakend |
209502.89497166988 ns/iter |
182030.7053712143 ns/iter |
1.15 |
E2E_Evaluator_lazygit |
139979.48926530697 ns/iter |
120992.135757562 ns/iter |
1.16 |
E2E_Evaluator_lerna |
148529.0424385897 ns/iter |
117503.55802971292 ns/iter |
1.26 |
E2E_Evaluator_nest_cli |
192497.26381214653 ns/iter |
177981.84770787507 ns/iter |
1.08 |
E2E_Evaluator_omc |
18847.3882756373 ns/iter |
18352.37526904498 ns/iter |
1.03 |
E2E_Evaluator_omnisharp |
568246.747556961 ns/iter |
533771.5917394264 ns/iter |
1.06 |
E2E_Evaluator_openapi |
8946716.47368365 ns/iter |
12954686.12727084 ns/iter |
0.69 |
E2E_Evaluator_pre_commit_hooks |
507007.70682152774 ns/iter |
467080.42618568364 ns/iter |
1.09 |
E2E_Evaluator_pulumi |
713588.6690572195 ns/iter |
727224.9422460743 ns/iter |
0.98 |
E2E_Evaluator_semantic_release |
101585.55569892429 ns/iter |
86663.4756897191 ns/iter |
1.17 |
E2E_Evaluator_stale |
157145.82468969675 ns/iter |
149497.2938643689 ns/iter |
1.05 |
E2E_Evaluator_stylecop |
310379.26690551685 ns/iter |
285047.3709015734 ns/iter |
1.09 |
E2E_Evaluator_tmuxinator |
99766.73781702477 ns/iter |
87859.9753318279 ns/iter |
1.14 |
E2E_Evaluator_ui5 |
527821.5975885377 ns/iter |
499833.14497042145 ns/iter |
1.06 |
E2E_Evaluator_ui5_manifest |
2706455.759689667 ns/iter |
2744934.38750009 ns/iter |
0.99 |
E2E_Evaluator_unreal_engine_uproject |
454857.59117829625 ns/iter |
428109.88235291763 ns/iter |
1.06 |
E2E_Evaluator_users_array |
639590.9749104138 ns/iter |
665328.1678966768 ns/iter |
0.96 |
E2E_Evaluator_vercel |
306376.1791175065 ns/iter |
257878.47908331317 ns/iter |
1.19 |
E2E_Evaluator_yamllint |
10849.477596137303 ns/iter |
9168.719251618695 ns/iter |
1.18 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/gcc)
Details
| Benchmark suite | Current: 4ab2c85 | Previous: 0ff98cb | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
115549 ns |
116065 ns |
1.00 |
E2E_Evaluator_ansible-meta |
513142 ns |
533100 ns |
0.96 |
E2E_Evaluator_aws-cdk |
139553 ns |
131840 ns |
1.06 |
E2E_Evaluator_babelrc |
306737 ns |
315110 ns |
0.97 |
E2E_Evaluator_cerebrum-criminal-case |
2383048 ns |
2827700 ns |
0.84 |
E2E_Evaluator_clang-format |
247730 ns |
268803 ns |
0.92 |
E2E_Evaluator_cmake-presets |
16286286 ns |
19823166 ns |
0.82 |
E2E_Evaluator_code-climate |
485024 ns |
487255 ns |
1.00 |
E2E_Evaluator_cql2 |
1162450 ns |
1223036 ns |
0.95 |
E2E_Evaluator_cspell |
1394232 ns |
1794143 ns |
0.78 |
E2E_Evaluator_cypress |
744313 ns |
849833 ns |
0.88 |
E2E_Evaluator_deno |
995053 ns |
1074766 ns |
0.93 |
E2E_Evaluator_dependabot |
1020555 ns |
1049360 ns |
0.97 |
E2E_Evaluator_draft-04 |
19438530 ns |
24619335 ns |
0.79 |
E2E_Evaluator_fabric-mod |
2235105 ns |
2831694 ns |
0.79 |
E2E_Evaluator_geojson |
23642527 ns |
29061873 ns |
0.81 |
E2E_Evaluator_gitpod-configuration |
688334 ns |
750836 ns |
0.92 |
E2E_Evaluator_helm-chart-lock |
983544 ns |
1025687 ns |
0.96 |
E2E_Evaluator_importmap |
276402 ns |
278378 ns |
0.99 |
E2E_Evaluator_jasmine |
286764 ns |
288485 ns |
0.99 |
E2E_Evaluator_jsconfig |
1169508 ns |
1455793 ns |
0.80 |
E2E_Evaluator_jshintrc |
2722126 ns |
3066845 ns |
0.89 |
E2E_Evaluator_krakend |
708951 ns |
657730 ns |
1.08 |
E2E_Evaluator_lazygit |
478662 ns |
478845 ns |
1.00 |
E2E_Evaluator_lerna |
443867 ns |
444074 ns |
1.00 |
E2E_Evaluator_nest-cli |
554385 ns |
600066 ns |
0.92 |
E2E_Evaluator_omc |
87051 ns |
89612 ns |
0.97 |
E2E_Evaluator_omnisharp |
1406284 ns |
1498612 ns |
0.94 |
E2E_Evaluator_openapi |
21884177 ns |
27117215 ns |
0.81 |
E2E_Evaluator_pre-commit-hooks |
1862376 ns |
2004353 ns |
0.93 |
E2E_Evaluator_pulumi |
1764798 ns |
2051563 ns |
0.86 |
E2E_Evaluator_semantic-release |
252104 ns |
243571 ns |
1.04 |
E2E_Evaluator_stale |
374924 ns |
376613 ns |
1.00 |
E2E_Evaluator_stylecop |
1107532 ns |
1139606 ns |
0.97 |
E2E_Evaluator_tmuxinator |
220691 ns |
221342 ns |
1.00 |
E2E_Evaluator_ui5 |
1995539 ns |
1992567 ns |
1.00 |
E2E_Evaluator_ui5-manifest |
10104455 ns |
11728965 ns |
0.86 |
E2E_Evaluator_unreal-engine-uproject |
1438128 ns |
1582114 ns |
0.91 |
E2E_Evaluator_users-array |
2310797 ns |
2305320 ns |
1.00 |
E2E_Evaluator_vercel |
923046 ns |
974865 ns |
0.95 |
E2E_Evaluator_yamllint |
28160 ns |
27058 ns |
1.04 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: 4ab2c85 | Previous: 0ff98cb | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
83385934.571457 ns/iter |
60444117.45454619 ns/iter |
1.38 |
E2E_Compiler_ansible_meta |
38210835.61110249 ns/iter |
25119101.178570904 ns/iter |
1.52 |
E2E_Compiler_aws_cdk |
494303.8101605161 ns/iter |
309278.4465020355 ns/iter |
1.60 |
E2E_Compiler_babelrc |
3107936.2534566936 ns/iter |
2281334.8540143273 ns/iter |
1.36 |
E2E_Compiler_clang_format |
20134047.628568754 ns/iter |
15852476.866666622 ns/iter |
1.27 |
E2E_Compiler_cmake_presets |
29086304.347826984 ns/iter |
26157610.57692313 ns/iter |
1.11 |
E2E_Compiler_code_climate |
2881902.0491227363 ns/iter |
2246970.198675491 ns/iter |
1.28 |
E2E_Compiler_cql2 |
16279884.854545591 ns/iter |
12910752.083333438 ns/iter |
1.26 |
E2E_Compiler_cspell |
26430196.82758332 ns/iter |
22985466.931031782 ns/iter |
1.15 |
E2E_Compiler_cypress |
4582570.859871907 ns/iter |
3708184.6473687333 ns/iter |
1.24 |
E2E_Compiler_deno |
9416306.670000266 ns/iter |
7198714.740385325 ns/iter |
1.31 |
E2E_Compiler_dependabot |
4666098.305389148 ns/iter |
3726437.7234040005 ns/iter |
1.25 |
E2E_Compiler_draft_04 |
3074591.6277062474 ns/iter |
2096329.9329446075 ns/iter |
1.47 |
E2E_Compiler_fabric_mod |
5580003.40909075 ns/iter |
4209844.885869406 ns/iter |
1.33 |
E2E_Compiler_geojson |
30475210.45000394 ns/iter |
23410364.93103353 ns/iter |
1.30 |
E2E_Compiler_gitpod_configuration |
5838947.745902543 ns/iter |
4359097.633136191 ns/iter |
1.34 |
E2E_Compiler_helm_chart_lock |
753625.2358643244 ns/iter |
542842.9733636968 ns/iter |
1.39 |
E2E_Compiler_importmap |
254035.27607356154 ns/iter |
210860.78783468754 ns/iter |
1.20 |
E2E_Compiler_jasmine |
1111344.3181148956 ns/iter |
1259616.1029186735 ns/iter |
0.88 |
E2E_Compiler_jshintrc |
3545152.712264261 ns/iter |
3378165.4663459244 ns/iter |
1.05 |
E2E_Compiler_jsconfig |
22516511.583331876 ns/iter |
19733809.027775984 ns/iter |
1.14 |
E2E_Compiler_krakend |
169420100.00002486 ns/iter |
135576316.8000067 ns/iter |
1.25 |
E2E_Compiler_lazygit |
34887427.09999997 ns/iter |
35434323.42857094 ns/iter |
0.98 |
E2E_Compiler_lerna |
1534622.0647617362 ns/iter |
1393919.6247463892 ns/iter |
1.10 |
E2E_Compiler_nest_cli |
8770347.222222578 ns/iter |
6543527.771930058 ns/iter |
1.34 |
E2E_Compiler_omc |
226707874.99995032 ns/iter |
200164052.24998835 ns/iter |
1.13 |
E2E_Compiler_omnisharp |
8757128.518071288 ns/iter |
6882368.257143276 ns/iter |
1.27 |
E2E_Compiler_openapi |
29246132.217385028 ns/iter |
28685461.64000236 ns/iter |
1.02 |
E2E_Compiler_pre_commit_hooks |
5294886.10833179 ns/iter |
4940228.687022515 ns/iter |
1.07 |
E2E_Compiler_pulumi |
4473799.040816524 ns/iter |
4123235.834999832 ns/iter |
1.09 |
E2E_Compiler_semantic_release |
1762131.8450708825 ns/iter |
1760665.5684208986 ns/iter |
1.00 |
E2E_Compiler_stale |
1853156.5792504847 ns/iter |
1566010.148706919 ns/iter |
1.18 |
E2E_Compiler_stylecop |
7560167.391304038 ns/iter |
6025020.161290183 ns/iter |
1.25 |
E2E_Compiler_tmuxinator |
2179652.30199414 ns/iter |
2024727.0782394374 ns/iter |
1.08 |
E2E_Compiler_ui5 |
80890847.24999414 ns/iter |
65279420.45454438 ns/iter |
1.24 |
E2E_Compiler_ui5_manifest |
437251791.4999889 ns/iter |
342860729.0000514 ns/iter |
1.28 |
E2E_Compiler_unreal_engine_uproject |
5068321.670000842 ns/iter |
4444068.892045617 ns/iter |
1.14 |
E2E_Compiler_users_array |
1518447.5555555455 ns/iter |
885881.9532709074 ns/iter |
1.71 |
E2E_Compiler_vercel |
22485428.37500622 ns/iter |
13348541.673471285 ns/iter |
1.68 |
E2E_Compiler_yamllint |
403164.74926257686 ns/iter |
266887.0705716185 ns/iter |
1.51 |
E2E_Evaluator_adaptivecard |
24510.08927923683 ns/iter |
18874.210045303105 ns/iter |
1.30 |
E2E_Evaluator_ansible_meta |
233518.76619718966 ns/iter |
173255.84641909774 ns/iter |
1.35 |
E2E_Evaluator_aws_cdk |
52769.57722327608 ns/iter |
33683.03904209207 ns/iter |
1.57 |
E2E_Evaluator_babelrc |
103922.40904566302 ns/iter |
82491.73959917844 ns/iter |
1.26 |
E2E_Evaluator_cerebrum_criminal_case |
969076.1085008893 ns/iter |
615010.2053407556 ns/iter |
1.58 |
E2E_Evaluator_clang_format |
119868.74112698226 ns/iter |
93973.58334481134 ns/iter |
1.28 |
E2E_Evaluator_cmake_presets |
4329173.414285357 ns/iter |
3117812.312500031 ns/iter |
1.39 |
E2E_Evaluator_code_climate |
143167.1493365663 ns/iter |
137919.15574807054 ns/iter |
1.04 |
E2E_Evaluator_cql2 |
176808.44926851982 ns/iter |
144494.43953857446 ns/iter |
1.22 |
E2E_Evaluator_cspell |
452136.9420560356 ns/iter |
366939.9189484446 ns/iter |
1.23 |
E2E_Evaluator_cypress |
174413.67214237747 ns/iter |
154145.4465507115 ns/iter |
1.13 |
E2E_Evaluator_deno |
277733.2384566946 ns/iter |
219654.5608107652 ns/iter |
1.26 |
E2E_Evaluator_dependabot |
267983.0668058339 ns/iter |
224594.35458291863 ns/iter |
1.19 |
E2E_Evaluator_draft_04 |
7227968.312501312 ns/iter |
4870153.271428989 ns/iter |
1.48 |
E2E_Evaluator_fabric_mod |
503686.2500001007 ns/iter |
461715.08563894476 ns/iter |
1.09 |
E2E_Evaluator_geojson |
13933750.736840554 ns/iter |
10473962.18461752 ns/iter |
1.33 |
E2E_Evaluator_gitpod_configuration |
155936.61255975725 ns/iter |
152869.5882352946 ns/iter |
1.02 |
E2E_Evaluator_helm_chart_lock |
221041.36289380505 ns/iter |
203574.70352658816 ns/iter |
1.09 |
E2E_Evaluator_importmap |
30903.017243706356 ns/iter |
30764.184874311155 ns/iter |
1.00 |
E2E_Evaluator_jasmine |
78652.28702808305 ns/iter |
78096.53324208768 ns/iter |
1.01 |
E2E_Evaluator_jshintrc |
970259.9959569421 ns/iter |
938042.7664908435 ns/iter |
1.03 |
E2E_Evaluator_jsconfig |
304257.9110825239 ns/iter |
292280.18609573785 ns/iter |
1.04 |
E2E_Evaluator_krakend |
129704.34859361773 ns/iter |
122216.38469714858 ns/iter |
1.06 |
E2E_Evaluator_lazygit |
99776.50617836307 ns/iter |
88813.51055932094 ns/iter |
1.12 |
E2E_Evaluator_lerna |
106390.93217229577 ns/iter |
107692.42284660647 ns/iter |
0.99 |
E2E_Evaluator_nest_cli |
117345.12464336382 ns/iter |
118809.6585077381 ns/iter |
0.99 |
E2E_Evaluator_omc |
13493.268521218548 ns/iter |
12894.258132677416 ns/iter |
1.05 |
E2E_Evaluator_omnisharp |
432655.75963307644 ns/iter |
423281.53864301794 ns/iter |
1.02 |
E2E_Evaluator_openapi |
5689009.58730215 ns/iter |
5590139.688525804 ns/iter |
1.02 |
E2E_Evaluator_pre_commit_hooks |
361633.49468606967 ns/iter |
329764.7776197642 ns/iter |
1.10 |
E2E_Evaluator_pulumi |
510852.7350579887 ns/iter |
612556.0829998449 ns/iter |
0.83 |
E2E_Evaluator_semantic_release |
80706.3028243308 ns/iter |
67965.67494704477 ns/iter |
1.19 |
E2E_Evaluator_stale |
111108.49514258395 ns/iter |
109075.6106905048 ns/iter |
1.02 |
E2E_Evaluator_stylecop |
180700.62178320283 ns/iter |
176589.10287255497 ns/iter |
1.02 |
E2E_Evaluator_tmuxinator |
72316.04145177557 ns/iter |
66865.84269988147 ns/iter |
1.08 |
E2E_Evaluator_ui5 |
352454.49666029634 ns/iter |
324437.7767079365 ns/iter |
1.09 |
E2E_Evaluator_ui5_manifest |
1604650.77014257 ns/iter |
1513853.4859814758 ns/iter |
1.06 |
E2E_Evaluator_unreal_engine_uproject |
308009.4337567223 ns/iter |
309000.82581191364 ns/iter |
1.00 |
E2E_Evaluator_users_array |
404023.40579706675 ns/iter |
399295.88882453274 ns/iter |
1.01 |
E2E_Evaluator_vercel |
215142.38745048942 ns/iter |
212210.1180070319 ns/iter |
1.01 |
E2E_Evaluator_yamllint |
5849.463271598424 ns/iter |
5726.548279175061 ns/iter |
1.02 |
Micro_Draft4_Meta_1_No_Callback |
141.03504109269699 ns/iter |
125.70446013189546 ns/iter |
1.12 |
Micro_Draft4_Required_Properties |
618.3820205703498 ns/iter |
607.2760770693459 ns/iter |
1.02 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
16.060962340582506 ns/iter |
15.316541090765309 ns/iter |
1.05 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
7.259741139426044 ns/iter |
6.994396873312202 ns/iter |
1.04 |
Micro_Draft4_Items_Schema |
260.8234997551053 ns/iter |
253.48196877107128 ns/iter |
1.03 |
Micro_Draft4_Nested_Object |
0.6858059184865049 ns/iter |
0.679283973735497 ns/iter |
1.01 |
Micro_Draft4_Properties_Triad_Optional |
197.4193670396193 ns/iter |
199.29978861608274 ns/iter |
0.99 |
Micro_Draft4_Properties_Triad_Closed |
168.16676778949457 ns/iter |
163.0851221568171 ns/iter |
1.03 |
Micro_Draft4_Properties_Triad_Required |
240.81340092581132 ns/iter |
203.76932751402222 ns/iter |
1.18 |
Micro_Draft4_Properties_Closed |
39.4949323889786 ns/iter |
36.238800105184374 ns/iter |
1.09 |
Micro_Draft4_Non_Recursive_Ref |
12.878564894076371 ns/iter |
12.345380206763325 ns/iter |
1.04 |
Micro_Draft4_Pattern_Properties_True |
136.46239840707634 ns/iter |
145.12262989884127 ns/iter |
0.94 |
Micro_Draft4_Ref_To_Single_Property |
8.125205223572207 ns/iter |
6.86919407855951 ns/iter |
1.18 |
Micro_Draft4_Additional_Properties_Type |
25.67988322450648 ns/iter |
25.44635656457328 ns/iter |
1.01 |
Micro_Draft4_Nested_Oneof |
42.496686329078514 ns/iter |
41.8375898012048 ns/iter |
1.02 |
Micro_Draft4_Short_Enum |
4.937019840774293 ns/iter |
5.009952079999493 ns/iter |
0.99 |
Micro_Draft4_Long_Enum |
10.157671799816066 ns/iter |
9.85320667379247 ns/iter |
1.03 |
Micro_Draft4_Long_Enum_Short_Strings |
6.376218561936541 ns/iter |
6.335860398099111 ns/iter |
1.01 |
Micro_Draft4_Type_Object |
2.20063452522886 ns/iter |
2.2157759160371726 ns/iter |
0.99 |
Micro_Draft4_Ref_Single_100 |
1768323.9255581452 ns/iter |
1712882.081280862 ns/iter |
1.03 |
Micro_Draft4_Compile_Ref_Many_Nested |
1358930.7234783715 ns/iter |
1267364.7452336485 ns/iter |
1.07 |
Micro_Draft4_Compile_Wrap |
2158599.080267506 ns/iter |
2016270.3488377375 ns/iter |
1.07 |
Micro_Draft6_Property_Names |
95.30754161780766 ns/iter |
94.97237087624015 ns/iter |
1.00 |
Micro_Draft6_Compile_FHIR |
11013301667.000177 ns/iter |
9275438459.000042 ns/iter |
1.19 |
Micro_Draft7_If_Then_Else |
18.830019166996962 ns/iter |
17.411944764291174 ns/iter |
1.08 |
Micro_2019_09_Unevaluated_Properties |
27.4991894327817 ns/iter |
26.062926955314147 ns/iter |
1.06 |
Micro_2019_09_Compile_Wrap |
331702437.4999846 ns/iter |
288002291.49999267 ns/iter |
1.15 |
Micro_2020_12_Dynamic_Ref |
191.08445833283878 ns/iter |
185.87497707150771 ns/iter |
1.03 |
Micro_2020_12_Dynamic_Ref_Single |
2.210406067066207 ns/iter |
2.141976095156635 ns/iter |
1.03 |
Micro_2020_12_Simple_Output_Mask |
853.8497216284873 ns/iter |
767.306198816054 ns/iter |
1.11 |
Micro_2020_12_Simple_Output_Annotations |
88231.73117337246 ns/iter |
85342.66609673548 ns/iter |
1.03 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
827412.108204419 ns/iter |
797675.3282276266 ns/iter |
1.04 |
Micro_2020_12_Exhaustive_Deep_Numeric |
5396.62528942233 ns/iter |
5303.800875007868 ns/iter |
1.02 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
123804.62007107768 ns/iter |
115138.66177206556 ns/iter |
1.08 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
15668.51683117309 ns/iter |
14057.680860138968 ns/iter |
1.11 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
94.7978196982905 ns/iter |
91.54620585146175 ns/iter |
1.04 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4937.507094815108 ns/iter |
4750.8704690358345 ns/iter |
1.04 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
269508236.0000166 ns/iter |
225333666.6666807 ns/iter |
1.20 |
Alterschema_Check_Readibility_OMC |
68055768.44443649 ns/iter |
59129687.499989815 ns/iter |
1.15 |
Alterschema_Check_Readibility_KrakenD |
703586166.0001501 ns/iter |
620384958.0001588 ns/iter |
1.13 |
Alterschema_Apply_Readibility_KrakenD |
71992992292.00006 ns/iter |
67796937999.999954 ns/iter |
1.06 |
Alterschema_Check_Invalid_External_Refs |
170983531.24998766 ns/iter |
164951572.9999962 ns/iter |
1.04 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (macos/llvm)
Details
| Benchmark suite | Current: 4ab2c85 | Previous: 0ff98cb | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
95125 ns |
92387 ns |
1.03 |
E2E_Evaluator_ansible-meta |
328452 ns |
330361 ns |
0.99 |
E2E_Evaluator_aws-cdk |
123326 ns |
117067 ns |
1.05 |
E2E_Evaluator_babelrc |
258738 ns |
271895 ns |
0.95 |
E2E_Evaluator_cerebrum-criminal-case |
1595393 ns |
1605941 ns |
0.99 |
E2E_Evaluator_clang-format |
170426 ns |
178131 ns |
0.96 |
E2E_Evaluator_cmake-presets |
10706246 ns |
11608193 ns |
0.92 |
E2E_Evaluator_code-climate |
349598 ns |
351811 ns |
0.99 |
E2E_Evaluator_cql2 |
924011 ns |
898501 ns |
1.03 |
E2E_Evaluator_cspell |
1157456 ns |
1048482 ns |
1.10 |
E2E_Evaluator_cypress |
555972 ns |
574747 ns |
0.97 |
E2E_Evaluator_deno |
642701 ns |
699463 ns |
0.92 |
E2E_Evaluator_dependabot |
671714 ns |
772881 ns |
0.87 |
E2E_Evaluator_draft-04 |
13970260 ns |
15792952 ns |
0.88 |
E2E_Evaluator_fabric-mod |
1340769 ns |
1554457 ns |
0.86 |
E2E_Evaluator_geojson |
15468829 ns |
17669151 ns |
0.88 |
E2E_Evaluator_gitpod-configuration |
454833 ns |
483645 ns |
0.94 |
E2E_Evaluator_helm-chart-lock |
844736 ns |
877058 ns |
0.96 |
E2E_Evaluator_importmap |
199279 ns |
284683 ns |
0.70 |
E2E_Evaluator_jasmine |
208922 ns |
234000 ns |
0.89 |
E2E_Evaluator_jsconfig |
756857 ns |
864269 ns |
0.88 |
E2E_Evaluator_jshintrc |
1912123 ns |
2115151 ns |
0.90 |
E2E_Evaluator_krakend |
418783 ns |
450157 ns |
0.93 |
E2E_Evaluator_lazygit |
257699 ns |
270504 ns |
0.95 |
E2E_Evaluator_lerna |
295160 ns |
323171 ns |
0.91 |
E2E_Evaluator_nest-cli |
378700 ns |
419838 ns |
0.90 |
E2E_Evaluator_omc |
64536 ns |
69519 ns |
0.93 |
E2E_Evaluator_omnisharp |
919785 ns |
996451 ns |
0.92 |
E2E_Evaluator_openapi |
15086686 ns |
15979171 ns |
0.94 |
E2E_Evaluator_pre-commit-hooks |
1259250 ns |
1301395 ns |
0.97 |
E2E_Evaluator_pulumi |
1246153 ns |
1370999 ns |
0.91 |
E2E_Evaluator_semantic-release |
172693 ns |
180321 ns |
0.96 |
E2E_Evaluator_stale |
270934 ns |
289411 ns |
0.94 |
E2E_Evaluator_stylecop |
655107 ns |
697446 ns |
0.94 |
E2E_Evaluator_tmuxinator |
146698 ns |
161377 ns |
0.91 |
E2E_Evaluator_ui5 |
1470383 ns |
1538786 ns |
0.96 |
E2E_Evaluator_ui5-manifest |
6711927 ns |
8118519 ns |
0.83 |
E2E_Evaluator_unreal-engine-uproject |
1082681 ns |
1145498 ns |
0.95 |
E2E_Evaluator_users-array |
1793924 ns |
1821237 ns |
0.99 |
E2E_Evaluator_vercel |
683740 ns |
714125 ns |
0.96 |
E2E_Evaluator_yamllint |
24731 ns |
25848 ns |
0.96 |
This comment was automatically generated by workflow using github-action-benchmark.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Mostly out of convenience. So we don't have to be switching between
projects and upgrading them all the time. Lots of time wasted due to
that.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com