Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature](information_schema) add processlist table for information_schema db #32511

Merged
merged 1 commit into from Mar 22, 2024

Conversation

zy-kkk
Copy link
Member

@zy-kkk zy-kkk commented Mar 20, 2024

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

@@ -76,6 +76,10 @@ class SchemaHelper {
TListPrivilegesResult* privileges_result);

static std::string extract_db_name(const std::string& full_name);

static Status show_process_list(const std::string& ip, const int32_t port,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: parameter 'port' is const-qualified in the function declaration; const-qualification of parameters only has an effect in function definitions [readability-avoid-const-params-in-decls]

Suggested change
static Status show_process_list(const std::string& ip, const int32_t port,
static Status show_process_list(const std::string& ip, int32_t port,

{"STATE", TYPE_VARCHAR, sizeof(StringRef), false},
{"INFO", TYPE_VARCHAR, sizeof(StringRef), false}};

SchemaProcessListScanner::SchemaProcessListScanner()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use '= default' to define a trivial default constructor [modernize-use-equals-default]

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:43:

-         : SchemaScanner(_s_processlist_columns, TSchemaTableType::SCH_PROCESSLIST) {}
+         : SchemaScanner(_s_processlist_columns, TSchemaTableType::SCH_PROCESSLIST) = default;

return _fill_block_impl(block);
}

Status SchemaProcessListScanner::_fill_block_impl(vectorized::Block* block) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: method '_fill_block_impl' can be made static [readability-convert-member-functions-to-static]

be/src/exec/schema_scanner/schema_processlist_scanner.h:47:

-     Status _fill_block_impl(vectorized::Block* block);
+     static Status _fill_block_impl(vectorized::Block* block);

return _fill_block_impl(block);
}

Status SchemaProcessListScanner::_fill_block_impl(vectorized::Block* block) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: function '_fill_block_impl' has cognitive complexity of 57 (threshold 50) [readability-function-cognitive-complexity]

Status SchemaProcessListScanner::_fill_block_impl(vectorized::Block* block) {
                                 ^
Additional context

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:79: +1, including nesting penalty of 0, nesting level increased to 1

    if (row_num == 0) {
    ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:83: +1, including nesting penalty of 0, nesting level increased to 1

    for (size_t col_idx = 0; col_idx < _s_processlist_columns.size(); ++col_idx) {
    ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:90: +2, including nesting penalty of 1, nesting level increased to 2

        for (size_t row_idx = 0; row_idx < row_num; ++row_idx) {
        ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:97: +3, including nesting penalty of 2, nesting level increased to 3

            switch (col_idx) {
            ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:99: +4, including nesting penalty of 3, nesting level increased to 4

                column_value = row.size() > 1 ? row[1] : "";
                                              ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:102: +4, including nesting penalty of 3, nesting level increased to 4

                column_value = row.size() > 2 ? row[2] : "";
                                              ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:105: +4, including nesting penalty of 3, nesting level increased to 4

                column_value = row.size() > 3 ? row[3] : "";
                                              ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:108: +4, including nesting penalty of 3, nesting level increased to 4

                column_value = row.size() > 5 ? row[5] : "";
                                              ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:111: +4, including nesting penalty of 3, nesting level increased to 4

                column_value = row.size() > 6 ? row[6] : "";
                                              ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:114: +4, including nesting penalty of 3, nesting level increased to 4

                column_value = row.size() > 7 ? row[7] : "";
                                              ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:117: +4, including nesting penalty of 3, nesting level increased to 4

                column_value = row.size() > 8 ? row[8] : "";
                                              ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:120: +4, including nesting penalty of 3, nesting level increased to 4

                column_value = row.size() > 9 ? row[9] : "";
                                              ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:123: +4, including nesting penalty of 3, nesting level increased to 4

                column_value = row.size() > 11 ? row[11] : "";
                                               ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:130: +3, including nesting penalty of 2, nesting level increased to 3

            if (_s_processlist_columns[col_idx].type == TYPE_LARGEINT ||
            ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:130: +1

            if (_s_processlist_columns[col_idx].type == TYPE_LARGEINT ||
                                                                      ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:132: +4, including nesting penalty of 3, nesting level increased to 4

                int128_t val = !column_value.empty() ? std::stoll(column_value) : 0;
                                                     ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:135: +1, nesting level increased to 3

            } else {
              ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:142: +2, including nesting penalty of 1, nesting level increased to 2

        RETURN_IF_ERROR(fill_dest_column_for_range(block, col_idx, datas));
        ^

be/src/common/status.h:541: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:142: +3, including nesting penalty of 2, nesting level increased to 3

        RETURN_IF_ERROR(fill_dest_column_for_range(block, col_idx, datas));
        ^

be/src/common/status.h:543: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

morningman
morningman previously approved these changes Mar 20, 2024
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add test cases in next PR

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 20, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 20, 2024

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.26% (8728/24752)
Line Coverage: 27.07% (71424/263848)
Region Coverage: 26.31% (37062/140893)
Branch Coverage: 23.22% (18955/81644)
Coverage Report: http://coverage.selectdb-in.cc/coverage/242b831088bfd18223769e9df0e1b8929562b800_242b831088bfd18223769e9df0e1b8929562b800/report/index.html

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 21, 2024

run buildall

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 21, 2024

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.25% (8727/24757)
Line Coverage: 27.06% (71427/263944)
Region Coverage: 26.30% (37070/140947)
Branch Coverage: 23.21% (18955/81674)
Coverage Report: http://coverage.selectdb-in.cc/coverage/ba71fa8ff169c8b9bdde418f0661be0e2a889bf8_ba71fa8ff169c8b9bdde418f0661be0e2a889bf8/report/index.html

@shuke987
Copy link
Collaborator

run compile

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 21, 2024

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Mar 21, 2024
@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.25% (8728/24757)
Line Coverage: 27.07% (71437/263944)
Region Coverage: 26.31% (37079/140947)
Branch Coverage: 23.22% (18962/81674)
Coverage Report: http://coverage.selectdb-in.cc/coverage/11e20981d0c95b13c3f510829b5c7a125886d7ed_11e20981d0c95b13c3f510829b5c7a125886d7ed/report/index.html

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 21, 2024

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.26% (8730/24756)
Line Coverage: 27.09% (71502/263980)
Region Coverage: 26.31% (37079/140952)
Branch Coverage: 23.22% (18964/81680)
Coverage Report: http://coverage.selectdb-in.cc/coverage/11e20981d0c95b13c3f510829b5c7a125886d7ed_11e20981d0c95b13c3f510829b5c7a125886d7ed/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 37354 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 11e20981d0c95b13c3f510829b5c7a125886d7ed, data reload: false

------ Round 1 ----------------------------------
q1	17649	4201	4081	4081
q2	2030	153	140	140
q3	10598	1101	1188	1101
q4	10225	805	701	701
q5	7455	2972	2933	2933
q6	204	126	126	126
q7	1005	578	554	554
q8	9334	1982	1980	1980
q9	7142	6467	6445	6445
q10	8359	3317	3465	3317
q11	443	225	222	222
q12	442	201	195	195
q13	17783	2865	2874	2865
q14	240	214	211	211
q15	502	464	454	454
q16	466	360	362	360
q17	958	551	611	551
q18	7105	6342	6362	6342
q19	1990	1406	1471	1406
q20	549	254	248	248
q21	3564	2923	2828	2828
q22	340	294	300	294
Total cold run time: 108383 ms
Total hot run time: 37354 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4091	4099	4056	4056
q2	320	222	223	222
q3	2970	2853	2832	2832
q4	1824	1565	1526	1526
q5	5197	5240	5227	5227
q6	199	118	122	118
q7	2215	1847	1865	1847
q8	3141	3300	3283	3283
q9	8559	8540	8598	8540
q10	3732	3675	3621	3621
q11	548	435	440	435
q12	751	564	572	564
q13	16932	2844	2851	2844
q14	291	244	251	244
q15	493	441	439	439
q16	468	415	411	411
q17	1728	1488	1449	1449
q18	7431	7051	7057	7051
q19	1595	1486	1564	1486
q20	1993	1691	1720	1691
q21	4829	4683	4741	4683
q22	524	435	441	435
Total cold run time: 69831 ms
Total hot run time: 53004 ms

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 21, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38005 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c0c39ad18b07061c13ef2f93ad2a3082f5753a2e, data reload: false

------ Round 1 ----------------------------------
q1	18285	4356	4227	4227
q2	2393	156	147	147
q3	11037	1114	1249	1114
q4	10661	727	747	727
q5	7818	3077	3039	3039
q6	209	129	122	122
q7	1050	600	584	584
q8	10314	2054	2075	2054
q9	7234	6493	6507	6493
q10	8432	3369	3500	3369
q11	443	224	216	216
q12	364	199	189	189
q13	17805	2851	2835	2835
q14	241	208	212	208
q15	493	466	457	457
q16	481	358	372	358
q17	969	522	625	522
q18	7322	6467	6458	6458
q19	1554	1475	1406	1406
q20	544	248	251	248
q21	3529	2931	2961	2931
q22	354	301	301	301
Total cold run time: 111532 ms
Total hot run time: 38005 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4106	4084	4112	4084
q2	324	230	228	228
q3	3018	2855	2826	2826
q4	1837	1530	1578	1530
q5	5237	5387	5215	5215
q6	196	115	122	115
q7	2288	1878	1878	1878
q8	3169	3303	3291	3291
q9	8569	8559	8601	8559
q10	3747	3684	3694	3684
q11	549	446	434	434
q12	735	533	536	533
q13	16923	2856	2859	2856
q14	271	242	259	242
q15	486	455	450	450
q16	464	433	419	419
q17	1739	1483	1464	1464
q18	7457	7197	7061	7061
q19	1623	1540	1558	1540
q20	1901	1690	1694	1690
q21	4808	4735	4853	4735
q22	533	458	440	440
Total cold run time: 69980 ms
Total hot run time: 53274 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.26% (8728/24756)
Line Coverage: 27.07% (71467/263980)
Region Coverage: 26.29% (37063/140952)
Branch Coverage: 23.21% (18957/81680)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c0c39ad18b07061c13ef2f93ad2a3082f5753a2e_c0c39ad18b07061c13ef2f93ad2a3082f5753a2e/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 181049 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c0c39ad18b07061c13ef2f93ad2a3082f5753a2e, data reload: false

query1	921	365	337	337
query2	7667	2006	1994	1994
query3	6704	221	213	213
query4	31188	20721	20771	20721
query5	4396	404	396	396
query6	259	177	168	168
query7	4624	294	304	294
query8	229	164	161	161
query9	9902	2286	2246	2246
query10	454	246	240	240
query11	14574	14150	14327	14150
query12	130	87	86	86
query13	1616	411	430	411
query14	10992	10350	10746	10350
query15	264	198	194	194
query16	8146	271	260	260
query17	1935	576	545	545
query18	2075	296	279	279
query19	231	160	167	160
query20	94	90	84	84
query21	201	126	127	126
query22	4685	4412	4373	4373
query23	31600	31087	31282	31087
query24	10753	2810	2809	2809
query25	622	386	386	386
query26	1583	152	157	152
query27	3116	347	338	338
query28	8168	1915	1882	1882
query29	960	653	623	623
query30	304	146	144	144
query31	977	716	744	716
query32	99	61	55	55
query33	760	258	244	244
query34	1091	493	483	483
query35	821	606	608	606
query36	990	857	892	857
query37	131	75	75	75
query38	3535	3427	3447	3427
query39	1418	1367	1370	1367
query40	249	115	112	112
query41	51	51	46	46
query42	110	94	97	94
query43	499	444	435	435
query44	1270	721	701	701
query45	260	272	263	263
query46	1113	682	684	682
query47	1685	1610	1640	1610
query48	433	360	356	356
query49	1189	349	346	346
query50	774	369	367	367
query51	6772	6762	6627	6627
query52	106	96	97	96
query53	350	269	273	269
query54	310	256	251	251
query55	81	80	77	77
query56	240	236	248	236
query57	1106	1005	1007	1005
query58	244	205	208	205
query59	2699	2556	2651	2556
query60	271	248	257	248
query61	127	115	115	115
query62	594	406	391	391
query63	301	278	267	267
query64	6163	3858	3840	3840
query65	3063	2994	2993	2993
query66	1041	342	333	333
query67	14839	14261	14370	14261
query68	6999	515	516	515
query69	622	372	368	368
query70	1262	1176	1147	1147
query71	510	288	270	270
query72	6871	2690	2477	2477
query73	727	310	315	310
query74	8048	6582	6575	6575
query75	4608	2864	2860	2860
query76	4941	915	963	915
query77	688	255	253	253
query78	10203	9845	9679	9679
query79	7867	531	526	526
query80	1403	384	386	384
query81	516	226	213	213
query82	903	199	202	199
query83	207	145	140	140
query84	287	86	84	84
query85	1502	338	333	333
query86	471	308	305	305
query87	3782	3546	3573	3546
query88	4861	2285	2294	2285
query89	537	369	368	368
query90	1967	183	179	179
query91	158	131	129	129
query92	58	48	54	48
query93	6062	504	485	485
query94	1135	188	182	182
query95	429	340	339	339
query96	622	277	270	270
query97	3021	2872	2880	2872
query98	222	219	209	209
query99	1228	766	763	763
Total cold run time: 306872 ms
Total hot run time: 181049 ms

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 21, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38154 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 85e188d66efc6626b9b307956ee50214d18eca70, data reload: false

------ Round 1 ----------------------------------
q1	17693	5351	4178	4178
q2	2023	153	149	149
q3	10808	1165	1245	1165
q4	11068	787	848	787
q5	7590	3097	3068	3068
q6	209	129	125	125
q7	1078	608	599	599
q8	10169	2048	2040	2040
q9	7273	6669	6610	6610
q10	9307	3346	3468	3346
q11	427	214	214	214
q12	359	195	194	194
q13	17829	2845	2875	2845
q14	249	202	203	202
q15	508	460	466	460
q16	457	365	354	354
q17	965	576	561	561
q18	7359	6565	6425	6425
q19	1581	1458	1524	1458
q20	540	257	246	246
q21	3536	2938	2840	2840
q22	362	320	288	288
Total cold run time: 111390 ms
Total hot run time: 38154 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4164	4106	4083	4083
q2	318	227	223	223
q3	2964	2852	2822	2822
q4	1869	1588	1560	1560
q5	5264	5298	5306	5298
q6	195	116	120	116
q7	2232	1861	1819	1819
q8	3180	3317	3310	3310
q9	8573	8589	8551	8551
q10	3685	3732	3702	3702
q11	548	444	441	441
q12	718	556	551	551
q13	16875	2991	2979	2979
q14	279	260	263	260
q15	486	463	460	460
q16	462	433	446	433
q17	1795	1503	1510	1503
q18	7584	7373	7113	7113
q19	1653	1525	1540	1525
q20	1910	1729	1708	1708
q21	4909	4739	4673	4673
q22	534	444	447	444
Total cold run time: 70197 ms
Total hot run time: 53574 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181240 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 85e188d66efc6626b9b307956ee50214d18eca70, data reload: false

query1	918	359	347	347
query2	7329	2057	2050	2050
query3	6702	213	209	209
query4	31167	20618	20632	20618
query5	4311	499	404	404
query6	282	187	173	173
query7	4632	282	285	282
query8	222	163	174	163
query9	9976	2273	2266	2266
query10	469	240	251	240
query11	15533	14291	14225	14225
query12	135	88	87	87
query13	1639	429	416	416
query14	11694	11056	11069	11056
query15	264	203	192	192
query16	8059	262	259	259
query17	1937	567	545	545
query18	2062	306	283	283
query19	260	160	163	160
query20	95	101	84	84
query21	200	127	136	127
query22	4710	4452	4493	4452
query23	31873	31123	30679	30679
query24	11814	2808	2814	2808
query25	654	387	386	386
query26	1848	152	154	152
query27	3143	346	347	346
query28	8125	1852	1896	1852
query29	1068	647	631	631
query30	310	145	144	144
query31	977	734	708	708
query32	96	57	57	57
query33	767	261	339	261
query34	1052	484	485	484
query35	869	603	605	603
query36	996	886	856	856
query37	266	79	78	78
query38	3588	3445	3404	3404
query39	1421	1364	1373	1364
query40	296	113	114	113
query41	49	46	47	46
query42	102	96	96	96
query43	493	439	452	439
query44	1322	712	722	712
query45	286	259	238	238
query46	1078	705	696	696
query47	1663	1600	1602	1600
query48	442	351	356	351
query49	1230	342	337	337
query50	767	367	365	365
query51	6604	6580	6564	6564
query52	105	89	89	89
query53	347	274	272	272
query54	337	239	258	239
query55	84	79	81	79
query56	255	232	230	230
query57	1112	1020	1013	1013
query58	231	218	212	212
query59	2801	2542	2602	2542
query60	284	255	272	255
query61	129	128	115	115
query62	623	404	423	404
query63	299	269	271	269
query64	6440	3847	3794	3794
query65	3059	3001	2998	2998
query66	1412	344	337	337
query67	15107	14419	14521	14419
query68	10177	517	533	517
query69	672	391	375	375
query70	1357	1136	1062	1062
query71	522	278	279	278
query72	7106	2674	2492	2492
query73	1588	317	316	316
query74	8066	6582	6658	6582
query75	5120	2829	2885	2829
query76	5858	998	960	960
query77	641	253	262	253
query78	10459	9653	9621	9621
query79	11430	523	517	517
query80	1974	384	370	370
query81	472	219	211	211
query82	328	200	194	194
query83	212	145	137	137
query84	279	81	78	78
query85	1184	334	320	320
query86	359	284	314	284
query87	3754	3530	3585	3530
query88	5408	2297	2276	2276
query89	488	359	368	359
query90	2050	173	172	172
query91	165	128	157	128
query92	59	45	46	45
query93	6242	497	484	484
query94	1322	176	180	176
query95	432	327	329	327
query96	601	267	275	267
query97	3027	2881	2868	2868
query98	220	203	215	203
query99	983	738	734	734
Total cold run time: 320975 ms
Total hot run time: 181240 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 85e188d66efc6626b9b307956ee50214d18eca70 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.2 seconds inserted 10000000 Rows, about 450K ops/s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.26% (8730/24756)
Line Coverage: 27.08% (71483/264009)
Region Coverage: 26.30% (37083/140985)
Branch Coverage: 23.21% (18962/81702)
Coverage Report: http://coverage.selectdb-in.cc/coverage/85e188d66efc6626b9b307956ee50214d18eca70_85e188d66efc6626b9b307956ee50214d18eca70/report/index.html

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 21, 2024

run feut

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 22, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38056 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 78f2e96e38b1e0ce20a43f5b7df6baa326b2c369, data reload: false

------ Round 1 ----------------------------------
q1	17652	4285	4275	4275
q2	2025	154	144	144
q3	10721	1163	1231	1163
q4	10396	816	795	795
q5	7464	3010	2978	2978
q6	203	126	122	122
q7	1030	602	602	602
q8	9868	2052	2074	2052
q9	7165	6622	6491	6491
q10	8419	3391	3534	3391
q11	441	224	217	217
q12	388	194	191	191
q13	17813	2838	2877	2838
q14	247	200	214	200
q15	511	460	461	460
q16	476	367	363	363
q17	963	539	635	539
q18	7422	6555	6432	6432
q19	1748	1471	1382	1382
q20	539	261	245	245
q21	3689	2953	2887	2887
q22	343	289	301	289
Total cold run time: 109523 ms
Total hot run time: 38056 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4171	4084	4097	4084
q2	333	223	224	223
q3	2953	2863	2835	2835
q4	1833	1551	1557	1551
q5	5284	5306	5316	5306
q6	192	115	116	115
q7	2261	1873	1844	1844
q8	3174	3324	3314	3314
q9	8604	8575	8563	8563
q10	3745	3746	3666	3666
q11	549	456	440	440
q12	717	544	556	544
q13	16886	2867	2856	2856
q14	279	250	257	250
q15	496	452	457	452
q16	460	425	414	414
q17	1757	1489	1475	1475
q18	7518	7163	7185	7163
q19	1646	1524	1537	1524
q20	1980	1733	1701	1701
q21	4878	4671	4812	4671
q22	526	434	456	434
Total cold run time: 70242 ms
Total hot run time: 53425 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.27% (8733/24763)
Line Coverage: 27.06% (71502/264228)
Region Coverage: 26.29% (37093/141068)
Branch Coverage: 23.19% (18972/81796)
Coverage Report: http://coverage.selectdb-in.cc/coverage/78f2e96e38b1e0ce20a43f5b7df6baa326b2c369_78f2e96e38b1e0ce20a43f5b7df6baa326b2c369/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 181242 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 78f2e96e38b1e0ce20a43f5b7df6baa326b2c369, data reload: false

query1	941	374	361	361
query2	7556	2075	1957	1957
query3	6710	212	210	210
query4	31333	20630	20678	20630
query5	4256	418	413	413
query6	276	179	174	174
query7	4633	300	303	300
query8	238	168	192	168
query9	9239	2320	2295	2295
query10	467	246	263	246
query11	14651	14237	14273	14237
query12	136	95	93	93
query13	1635	420	418	418
query14	11899	11119	10425	10425
query15	335	209	207	207
query16	8155	270	255	255
query17	2065	564	545	545
query18	2096	287	296	287
query19	342	157	153	153
query20	99	88	93	88
query21	202	135	132	132
query22	4711	4531	4507	4507
query23	32142	31095	31220	31095
query24	10777	2882	2777	2777
query25	637	387	384	384
query26	1508	167	159	159
query27	2949	357	356	356
query28	7419	1928	1903	1903
query29	942	664	627	627
query30	302	149	146	146
query31	971	739	728	728
query32	96	59	57	57
query33	859	249	248	248
query34	984	470	485	470
query35	825	598	602	598
query36	979	844	845	844
query37	116	77	82	77
query38	3554	3410	3454	3410
query39	1420	1358	1394	1358
query40	279	115	114	114
query41	51	48	48	48
query42	109	98	93	93
query43	496	455	454	454
query44	1092	720	719	719
query45	299	264	268	264
query46	1104	680	680	680
query47	1655	1599	1633	1599
query48	447	362	357	357
query49	1166	346	336	336
query50	762	370	365	365
query51	6651	6596	6603	6596
query52	113	92	89	89
query53	337	274	272	272
query54	315	235	244	235
query55	86	81	90	81
query56	238	251	236	236
query57	1077	1015	1018	1015
query58	233	211	221	211
query59	2840	2670	2754	2670
query60	280	251	263	251
query61	116	120	117	117
query62	587	407	409	407
query63	302	273	275	273
query64	6364	3870	3837	3837
query65	3101	3027	3002	3002
query66	1436	339	342	339
query67	15171	14780	14340	14340
query68	9358	512	523	512
query69	672	381	376	376
query70	1425	1164	1145	1145
query71	513	287	282	282
query72	6917	2652	2505	2505
query73	1596	309	305	305
query74	8544	6662	6632	6632
query75	4645	2809	2776	2776
query76	5921	894	864	864
query77	648	266	258	258
query78	10358	9568	9614	9568
query79	11820	523	524	523
query80	2216	396	407	396
query81	507	213	211	211
query82	352	205	197	197
query83	235	154	140	140
query84	284	79	76	76
query85	1226	329	312	312
query86	352	300	282	282
query87	3714	3522	3481	3481
query88	5271	2270	2290	2270
query89	466	376	363	363
query90	2212	174	172	172
query91	177	136	135	135
query92	65	48	48	48
query93	7122	497	485	485
query94	1404	179	174	174
query95	447	324	323	323
query96	603	266	263	263
query97	3065	2873	2874	2873
query98	228	211	204	204
query99	966	764	753	753
Total cold run time: 318491 ms
Total hot run time: 181242 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 78f2e96e38b1e0ce20a43f5b7df6baa326b2c369 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 22, 2024

run feut

Copy link
Member

@JNSimba JNSimba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 22, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Collaborator

@LemonLiTree LemonLiTree left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zy-kkk zy-kkk merged commit d838459 into apache:master Mar 22, 2024
26 of 30 checks passed
@zy-kkk zy-kkk deleted the mysql2 branch March 22, 2024 09:41
morningman pushed a commit to morningman/doris that referenced this pull request Apr 7, 2024
@yiguolei yiguolei mentioned this pull request Apr 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.7-merged dev/2.1.2-merged reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants