Skip to content

[Fix](Test)Reduce the Sleep time and ensure that the corresponding thread resources are released after the case is executed. #32665

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
CalvinKirs merged 4 commits into from
Mar 22, 2024
Merged

[Fix](Test)Reduce the Sleep time and ensure that the corresponding thread resources are released after the case is executed. #32665

CalvinKirs merged 4 commits into from
Mar 22, 2024

Conversation

@CalvinKirs
Copy link
Member

@CalvinKirs CalvinKirs commented Mar 22, 2024 •
edited
Loading

@CalvinKirs
[Fix](Test)Reduce the Sleep time and ensure that the corresponding th…
962b3ca 
…read resources are released after the case is executed.
@doris-robot
Copy link

doris-robot commented Mar 22, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@CalvinKirs
Merge remote-tracking branch 'upstream/master' into sleep-case
374b76a 
# Conflicts:
#	regression-test/suites/job_p0/test_base_insert_job.groovy
@CalvinKirs
set case sleep time to 5 seconds
fa1bcb4
@Gabriel39
Copy link
Contributor

Gabriel39 commented Mar 22, 2024

run buildall

@CalvinKirs
Copy link
Member Author

CalvinKirs commented Mar 22, 2024

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 22, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Mar 22, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 22, 2024

PR approved by anyone and no changes requested.

@doris-robot
Copy link

doris-robot commented Mar 22, 2024

TPC-H: Total hot run time: 37923 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit daaa7fe005dac93ace2da95cd8be6ed76e9ff48a, data reload: false

------ Round 1 ----------------------------------
q1	17625	4539	4138	4138
q2	2107	155	149	149
q3	10605	1183	1270	1183
q4	10362	768	828	768
q5	7560	3045	3014	3014
q6	203	129	133	129
q7	1059	582	589	582
q8	9348	2033	2040	2033
q9	7073	6465	6502	6465
q10	8401	3325	3548	3325
q11	439	228	215	215
q12	370	209	202	202
q13	17797	2861	2876	2861
q14	246	200	199	199
q15	519	462	456	456
q16	485	368	371	368
q17	983	525	624	525
q18	7278	6586	6432	6432
q19	2417	1455	1377	1377
q20	544	262	255	255
q21	3613	2969	2946	2946
q22	371	301	302	301
Total cold run time: 109405 ms
Total hot run time: 37923 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4173	4116	4111	4111
q2	331	244	236	236
q3	2939	2863	2810	2810
q4	1836	1561	1594	1561
q5	5241	5287	5261	5261
q6	195	117	120	117
q7	2224	1868	1835	1835
q8	3194	3327	3318	3318
q9	8597	8580	8588	8580
q10	3718	3682	3685	3682
q11	565	443	440	440
q12	721	532	570	532
q13	16890	2853	2851	2851
q14	276	255	259	255
q15	510	459	454	454
q16	475	457	418	418
q17	1751	1472	1458	1458
q18	7550	7240	7210	7210
q19	1644	1539	1514	1514
q20	1908	1740	1713	1713
q21	4856	4716	4610	4610
q22	542	475	459	459
Total cold run time: 70136 ms
Total hot run time: 53425 ms

@doris-robot
Copy link

doris-robot commented Mar 22, 2024

TPC-DS: Total hot run time: 181868 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit daaa7fe005dac93ace2da95cd8be6ed76e9ff48a, data reload: false

query1	931	374	365	365
query2	7384	1988	2066	1988
query3	6712	209	215	209
query4	31359	20547	20897	20547
query5	4323	410	408	408
query6	280	176	180	176
query7	4627	295	297	295
query8	224	172	170	170
query9	9536	2362	2336	2336
query10	587	253	262	253
query11	14730	14164	14205	14164
query12	137	87	93	87
query13	1629	415	420	415
query14	11595	11022	10968	10968
query15	302	195	196	195
query16	8161	271	266	266
query17	1963	596	564	564
query18	1934	291	292	291
query19	368	155	156	155
query20	98	91	94	91
query21	205	126	132	126
query22	4620	4474	4420	4420
query23	31900	31003	30942	30942
query24	10678	2814	2806	2806
query25	598	379	370	370
query26	1312	157	158	157
query27	2921	345	347	345
query28	7483	1933	1900	1900
query29	867	631	617	617
query30	307	153	151	151
query31	942	735	730	730
query32	94	59	54	54
query33	768	245	249	245
query34	1039	466	480	466
query35	814	600	615	600
query36	1016	845	890	845
query37	126	75	73	73
query38	3588	3411	3434	3411
query39	1399	1376	1354	1354
query40	206	118	110	110
query41	54	45	46	45
query42	106	99	96	96
query43	487	459	452	452
query44	1166	724	721	721
query45	265	250	259	250
query46	1105	693	690	690
query47	1668	1596	1608	1596
query48	494	361	367	361
query49	1113	345	334	334
query50	775	389	377	377
query51	6620	6482	6659	6482
query52	99	95	86	86
query53	343	282	281	281
query54	309	249	252	249
query55	90	81	81	81
query56	253	248	236	236
query57	1086	995	1014	995
query58	246	211	214	211
query59	2797	2601	2585	2585
query60	270	266	249	249
query61	118	116	118	116
query62	595	401	450	401
query63	311	275	276	275
query64	5653	3978	3914	3914
query65	3124	3013	3020	3013
query66	1431	367	362	362
query67	14905	14708	14392	14392
query68	5787	531	540	531
query69	610	383	373	373
query70	1246	1199	1169	1169
query71	449	291	284	284
query72	6936	2790	2493	2493
query73	729	335	316	316
query74	7224	6581	6627	6581
query75	3716	2933	2891	2891
query76	4221	893	850	850
query77	599	274	263	263
query78	10444	9733	9750	9733
query79	10327	530	523	523
query80	1959	395	383	383
query81	528	214	212	212
query82	1511	198	207	198
query83	227	144	148	144
query84	283	79	80	79
query85	1564	328	327	327
query86	482	285	296	285
query87	3773	3553	3545	3545
query88	5090	2374	2356	2356
query89	502	364	370	364
query90	1998	176	171	171
query91	169	137	138	137
query92	59	47	48	47
query93	7219	512	499	499
query94	1261	183	177	177
query95	438	337	332	332
query96	632	278	274	274
query97	3074	2852	2910	2852
query98	230	212	214	212
query99	1249	801	752	752
Total cold run time: 307782 ms
Total hot run time: 181868 ms

@doris-robot
Copy link

doris-robot commented Mar 22, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit daaa7fe005dac93ace2da95cd8be6ed76e9ff48a with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@CalvinKirs CalvinKirs merged commit 57f25c1 into apache:master Mar 22, 2024
@CalvinKirs CalvinKirs deleted the sleep-case branch March 22, 2024 12:14
yiguolei pushed a commit that referenced this pull request Mar 24, 2024
@CalvinKirs @Doris-Extras
[Fix](Test)Reduce the Sleep time and ensure that the corresponding th…
c223d9e 
…read resources are released after the case is executed. (#32665)

* [Fix](Test)Reduce the Sleep time and ensure that the corresponding thread resources are released after the case is executed.
* Fix load job id error
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morningman morningman morningman approved these changes

@zy-kkk zy-kkk zy-kkk approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.1 reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@CalvinKirs @doris-robot @Gabriel39 @morningman @zy-kkk