Skip to content

[pipelineX](bug) Fix scan dependency timeout#27696

Merged
Gabriel39 merged 3 commits intoapache:masterfrom
Gabriel39:fix_ppx
Nov 28, 2023
Merged

[pipelineX](bug) Fix scan dependency timeout#27696
Gabriel39 merged 3 commits intoapache:masterfrom
Gabriel39:fix_ppx

Conversation

@Gabriel39
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@Gabriel39
Copy link
Contributor Author

run buildall

@Gabriel39 Gabriel39 marked this pull request as draft November 28, 2023 07:57
@Gabriel39
Copy link
Contributor Author

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@Gabriel39
Copy link
Contributor Author

run buildall

@Gabriel39 Gabriel39 changed the title test pipelineX [pipelineX](bug) Fix scan dependency timeout Nov 28, 2023
@Gabriel39 Gabriel39 marked this pull request as ready for review November 28, 2023 09:09
@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 28, 2023
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.89 seconds
stream load tsv: 564 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 26 seconds loaded 2358488459 Bytes, about 86 MB/s
stream load orc: 72 seconds loaded 1101869774 Bytes, about 14 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.0 seconds inserted 10000000 Rows, about 344K ops/s
storage size: 17100813693 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit 49a5dd9dc0b20b4413d812cd87652d45f5044a8a, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4892	4657	4631	4631
q2	358	141	141	141
q3	2049	1947	2008	1947
q4	1407	1279	1263	1263
q5	3986	3953	4022	3953
q6	259	135	133	133
q7	1349	879	850	850
q8	2842	2801	2784	2784
q9	9823	9627	9450	9450
q10	3467	3545	3531	3531
q11	389	242	252	242
q12	442	303	299	299
q13	4596	3794	3812	3794
q14	318	294	298	294
q15	594	531	528	528
q16	508	455	454	454
q17	1146	977	916	916
q18	7898	7413	7568	7413
q19	1658	1678	1676	1676
q20	560	313	322	313
q21	4460	4028	4028	4028
q22	489	372	386	372
Total cold run time: 53490 ms
Total hot run time: 49012 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4597	4615	4581	4581
q2	329	231	268	231
q3	4041	4013	4020	4013
q4	2719	2698	2711	2698
q5	9618	9567	9599	9567
q6	251	122	122	122
q7	2958	2466	2560	2466
q8	4466	4476	4490	4476
q9	12918	12878	12783	12783
q10	4077	4144	4166	4144
q11	747	641	658	641
q12	966	828	805	805
q13	4299	3556	3600	3556
q14	383	354	353	353
q15	579	518	517	517
q16	637	566	562	562
q17	3872	3983	3887	3887
q18	9702	9033	9060	9033
q19	1834	1793	1789	1789
q20	2393	2082	2029	2029
q21	8850	8693	8555	8555
q22	940	780	783	780
Total cold run time: 81176 ms
Total hot run time: 77588 ms

@Gabriel39 Gabriel39 merged commit 38d30f2 into apache:master Nov 28, 2023
XuJianxu pushed a commit to XuJianxu/doris that referenced this pull request Dec 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants