Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature](Variant) support export csv format #37857

Merged
merged 1 commit into from
Jul 16, 2024

Conversation

eldenmoon
Copy link
Member

Proposed changes

Issue Number: close #xxx

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@eldenmoon
Copy link
Member Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 40160 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cbb46d7d42ad24d994c732a269c3aac06fa27f50, data reload: false

------ Round 1 ----------------------------------
q1	17652	4520	4318	4318
q2	2023	193	189	189
q3	10537	1235	1153	1153
q4	10238	787	746	746
q5	7557	2736	2693	2693
q6	222	139	135	135
q7	973	603	603	603
q8	9211	2129	2069	2069
q9	8725	6583	6625	6583
q10	8868	3813	3798	3798
q11	457	241	237	237
q12	393	217	218	217
q13	17781	2988	3007	2988
q14	274	233	239	233
q15	528	481	485	481
q16	506	378	388	378
q17	987	617	702	617
q18	8230	7649	7488	7488
q19	4816	1436	1399	1399
q20	661	325	328	325
q21	5098	3225	3920	3225
q22	353	298	285	285
Total cold run time: 116090 ms
Total hot run time: 40160 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4638	4288	4246	4246
q2	373	273	275	273
q3	3044	2923	2922	2922
q4	2057	1711	1776	1711
q5	5693	5548	5513	5513
q6	230	143	129	129
q7	2195	1918	1841	1841
q8	3285	3403	3459	3403
q9	8792	8802	8898	8802
q10	4139	3953	3831	3831
q11	605	513	518	513
q12	847	619	637	619
q13	16057	3143	3206	3143
q14	320	287	275	275
q15	531	495	492	492
q16	490	432	427	427
q17	1835	1540	1498	1498
q18	8127	7963	7771	7771
q19	1796	1615	1475	1475
q20	2115	1877	1851	1851
q21	5011	4931	4723	4723
q22	592	517	492	492
Total cold run time: 72772 ms
Total hot run time: 55950 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 174240 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cbb46d7d42ad24d994c732a269c3aac06fa27f50, data reload: false

query1	919	376	380	376
query2	6428	1928	1835	1835
query3	6644	210	222	210
query4	28261	17577	17475	17475
query5	3632	481	507	481
query6	280	195	164	164
query7	4585	300	286	286
query8	235	198	201	198
query9	8629	2432	2417	2417
query10	437	289	271	271
query11	11583	9997	9985	9985
query12	116	83	88	83
query13	1662	364	366	364
query14	8519	7947	8723	7947
query15	241	168	171	168
query16	8016	314	312	312
query17	1854	529	532	529
query18	1767	273	290	273
query19	189	145	147	145
query20	90	84	82	82
query21	204	124	127	124
query22	4297	4386	4002	4002
query23	34167	33745	33482	33482
query24	10571	2933	2870	2870
query25	576	421	380	380
query26	827	152	152	152
query27	2195	276	282	276
query28	6270	2101	2095	2095
query29	908	636	640	636
query30	263	147	149	147
query31	976	772	739	739
query32	90	54	52	52
query33	761	300	292	292
query34	1045	504	503	503
query35	689	590	591	590
query36	1120	964	997	964
query37	145	83	83	83
query38	2955	2925	2827	2827
query39	920	884	864	864
query40	216	128	128	128
query41	45	45	41	41
query42	120	98	98	98
query43	512	471	465	465
query44	1262	742	750	742
query45	186	159	163	159
query46	1092	762	730	730
query47	1879	1785	1788	1785
query48	356	296	296	296
query49	842	403	412	403
query50	788	391	394	391
query51	7028	6814	6811	6811
query52	105	94	98	94
query53	363	291	295	291
query54	917	441	437	437
query55	76	73	73	73
query56	301	260	265	260
query57	1106	1073	1066	1066
query58	256	253	263	253
query59	2771	2564	2710	2564
query60	316	278	272	272
query61	97	100	94	94
query62	784	661	661	661
query63	324	291	293	291
query64	9123	2226	1676	1676
query65	3164	3158	3137	3137
query66	763	327	328	327
query67	15659	14980	14882	14882
query68	4406	526	536	526
query69	518	386	349	349
query70	1172	1120	1138	1120
query71	366	273	275	273
query72	6740	5686	5712	5686
query73	759	323	321	321
query74	6020	5710	5704	5704
query75	3397	2692	2731	2692
query76	2232	902	920	902
query77	447	303	296	296
query78	9675	9070	9237	9070
query79	2602	516	523	516
query80	1816	468	471	468
query81	606	221	222	221
query82	1426	144	134	134
query83	263	174	173	173
query84	277	87	95	87
query85	1446	321	304	304
query86	468	328	326	326
query87	3278	3107	3118	3107
query88	4226	2398	2413	2398
query89	464	381	377	377
query90	1758	193	194	193
query91	129	98	100	98
query92	60	49	48	48
query93	2323	489	498	489
query94	1154	212	209	209
query95	402	318	324	318
query96	601	275	277	275
query97	3199	3023	3020	3020
query98	221	203	191	191
query99	1550	1243	1274	1243
Total cold run time: 277518 ms
Total hot run time: 174240 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.1 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cbb46d7d42ad24d994c732a269c3aac06fa27f50, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.06	0.06
query4	1.66	0.07	0.08
query5	0.47	0.47	0.48
query6	1.14	0.72	0.77
query7	0.02	0.01	0.01
query8	0.04	0.05	0.05
query9	0.56	0.49	0.49
query10	0.55	0.54	0.54
query11	0.15	0.12	0.11
query12	0.15	0.12	0.13
query13	0.60	0.59	0.58
query14	0.77	0.78	0.78
query15	0.86	0.82	0.81
query16	0.38	0.35	0.36
query17	0.98	0.97	0.99
query18	0.22	0.21	0.21
query19	1.77	1.67	1.70
query20	0.01	0.01	0.01
query21	15.39	0.75	0.68
query22	4.12	7.79	2.28
query23	18.30	1.44	1.30
query24	2.09	0.24	0.23
query25	0.17	0.10	0.08
query26	0.30	0.22	0.21
query27	0.45	0.24	0.23
query28	13.28	1.04	1.00
query29	12.61	3.32	3.31
query30	0.26	0.06	0.06
query31	2.87	0.40	0.39
query32	3.25	0.48	0.47
query33	2.86	2.92	2.91
query34	17.06	4.41	4.37
query35	4.45	4.43	4.42
query36	0.65	0.46	0.46
query37	0.19	0.16	0.16
query38	0.16	0.15	0.15
query39	0.05	0.04	0.04
query40	0.14	0.12	0.13
query41	0.09	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.52 s
Total hot run time: 31.1 s

Copy link
Contributor

@qidaye qidaye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 16, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@lxr599 lxr599 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@eldenmoon eldenmoon merged commit 189801c into apache:master Jul 16, 2024
39 of 43 checks passed
eldenmoon added a commit to eldenmoon/incubator-doris that referenced this pull request Jul 16, 2024
eldenmoon added a commit to eldenmoon/incubator-doris that referenced this pull request Jul 16, 2024
seawinde pushed a commit to seawinde/doris that referenced this pull request Jul 17, 2024
@yiguolei yiguolei mentioned this pull request Jul 19, 2024
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.5-merged dev/3.0.0-merged reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants