Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Jul 5, 2024

This branch was missed in the PR #37196

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented Jul 5, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39721 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dabbdb16a317ad502b7cfeb53265107e98c9d6b8, data reload: false

------ Round 1 ----------------------------------
q1	17613	4360	4264	4264
q2	2008	191	183	183
q3	10457	1223	1123	1123
q4	10189	825	795	795
q5	7558	2642	2630	2630
q6	218	135	136	135
q7	946	602	600	600
q8	9228	2072	2084	2072
q9	9054	6516	6477	6477
q10	8978	3661	3735	3661
q11	487	247	234	234
q12	485	235	224	224
q13	18853	2950	2955	2950
q14	257	231	225	225
q15	533	479	477	477
q16	490	371	384	371
q17	959	726	635	635
q18	7965	7416	7497	7416
q19	4007	1459	1514	1459
q20	657	330	329	329
q21	4897	3129	3191	3129
q22	387	337	332	332
Total cold run time: 116226 ms
Total hot run time: 39721 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4401	4217	4210	4210
q2	382	259	257	257
q3	2931	2724	2876	2724
q4	1958	1694	1720	1694
q5	5616	5597	5460	5460
q6	238	142	131	131
q7	2156	1822	1806	1806
q8	3291	3409	3406	3406
q9	8695	8707	8771	8707
q10	4024	3854	3835	3835
q11	609	480	490	480
q12	762	609	663	609
q13	16263	3150	3169	3150
q14	301	281	292	281
q15	538	489	463	463
q16	504	452	423	423
q17	1798	1529	1484	1484
q18	7983	7883	7773	7773
q19	1752	1612	1616	1612
q20	2176	1880	1861	1861
q21	8656	4904	4812	4812
q22	628	536	553	536
Total cold run time: 75662 ms
Total hot run time: 55714 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173804 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dabbdb16a317ad502b7cfeb53265107e98c9d6b8, data reload: false

query1	911	375	373	373
query2	6453	2515	2439	2439
query3	6632	223	221	221
query4	25901	17400	17177	17177
query5	3587	477	471	471
query6	283	175	180	175
query7	4593	287	287	287
query8	332	319	287	287
query9	8502	2317	2323	2317
query10	568	295	291	291
query11	10450	10095	10170	10095
query12	116	89	82	82
query13	1642	366	359	359
query14	10174	8131	7812	7812
query15	239	191	190	190
query16	7611	300	316	300
query17	1379	559	538	538
query18	1868	284	283	283
query19	203	153	157	153
query20	92	84	84	84
query21	213	131	128	128
query22	4351	4147	4098	4098
query23	33874	33652	33523	33523
query24	10964	2906	2843	2843
query25	628	388	421	388
query26	729	162	159	159
query27	2299	322	323	322
query28	6238	2096	2079	2079
query29	921	669	674	669
query30	252	158	161	158
query31	969	760	773	760
query32	108	57	62	57
query33	679	332	306	306
query34	897	511	494	494
query35	754	653	640	640
query36	1177	957	964	957
query37	141	85	84	84
query38	2996	2789	2823	2789
query39	913	789	797	789
query40	208	131	127	127
query41	58	54	57	54
query42	131	104	103	103
query43	566	524	544	524
query44	1107	731	735	731
query45	191	163	161	161
query46	1078	728	708	708
query47	1892	1746	1778	1746
query48	383	308	304	304
query49	855	421	428	421
query50	777	394	393	393
query51	6872	6729	6750	6729
query52	107	92	106	92
query53	358	290	298	290
query54	887	451	456	451
query55	79	77	75	75
query56	306	278	282	278
query57	1107	1042	1083	1042
query58	260	259	271	259
query59	3333	3188	3596	3188
query60	319	380	286	286
query61	92	94	94	94
query62	591	427	449	427
query63	334	295	298	295
query64	8530	2256	1738	1738
query65	3149	3088	3056	3056
query66	719	329	360	329
query67	15773	15200	14877	14877
query68	8660	534	555	534
query69	736	427	370	370
query70	1403	1078	1086	1078
query71	539	274	274	274
query72	9162	5562	5241	5241
query73	2329	331	328	328
query74	5891	5516	5482	5482
query75	5254	2653	2702	2653
query76	5237	971	962	962
query77	778	294	294	294
query78	9726	9185	8886	8886
query79	9993	521	516	516
query80	1128	468	470	468
query81	574	218	226	218
query82	515	110	104	104
query83	329	180	165	165
query84	275	86	87	86
query85	971	301	293	293
query86	370	309	327	309
query87	3326	3096	3090	3090
query88	4465	2461	2452	2452
query89	535	378	373	373
query90	2161	196	191	191
query91	134	101	101	101
query92	63	49	48	48
query93	6858	495	494	494
query94	1447	211	208	208
query95	400	317	320	317
query96	612	270	271	270
query97	3179	2999	3008	2999
query98	214	202	194	194
query99	1160	851	860	851
Total cold run time: 299125 ms
Total hot run time: 173804 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.96 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dabbdb16a317ad502b7cfeb53265107e98c9d6b8, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.04
query3	0.23	0.05	0.06
query4	1.68	0.08	0.07
query5	0.51	0.48	0.48
query6	1.13	0.73	0.73
query7	0.02	0.02	0.02
query8	0.06	0.04	0.04
query9	0.55	0.49	0.49
query10	0.55	0.56	0.55
query11	0.15	0.11	0.12
query12	0.16	0.12	0.13
query13	0.59	0.59	0.58
query14	0.75	0.79	0.79
query15	0.85	0.82	0.80
query16	0.38	0.37	0.37
query17	1.02	1.00	1.03
query18	0.23	0.24	0.22
query19	1.80	1.77	1.84
query20	0.01	0.01	0.01
query21	15.39	0.80	0.66
query22	4.10	7.14	2.21
query23	18.31	1.32	1.30
query24	2.07	0.22	0.24
query25	0.15	0.08	0.08
query26	0.29	0.22	0.20
query27	0.44	0.22	0.22
query28	13.22	1.01	1.00
query29	12.64	3.27	3.30
query30	0.26	0.06	0.05
query31	2.88	0.37	0.38
query32	3.29	0.47	0.47
query33	2.87	2.92	2.93
query34	17.10	4.30	4.34
query35	4.37	4.44	4.37
query36	0.65	0.48	0.47
query37	0.18	0.15	0.16
query38	0.15	0.14	0.14
query39	0.05	0.03	0.03
query40	0.14	0.12	0.13
query41	0.10	0.05	0.05
query42	0.05	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.53 s
Total hot run time: 30.96 s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 5, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Jul 5, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Jul 5, 2024

PR approved by anyone and no changes requested.

@dataroaring dataroaring merged commit f5c18ee into apache:master Jul 5, 2024
@w41ter w41ter deleted the fix_missed_gc_branch branch July 5, 2024 08:24
dataroaring pushed a commit that referenced this pull request Jul 15, 2024
dataroaring pushed a commit that referenced this pull request Jul 17, 2024
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 18, 2024
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 18, 2024
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 18, 2024
dataroaring pushed a commit that referenced this pull request Jul 18, 2024
Cherry-pick #37196, #37326.

The CCR syncer needs to know the distribution of tables, partitions,
indexes, and replicas when synchronizing binlogs. If a partition is
deleted before the binlog synchronization is complete, the CCR syncer
cannot continue synchronizing. This PR will record the deleted
partitions and include them in the get meta response, allowing the CCR
syncer to filter out the binlogs that belong to these partitions.

The CCR syncer part PR is selectdb/ccr-syncer#117.
dataroaring pushed a commit that referenced this pull request Jul 18, 2024
Cherry-pick #37196, #37326.

The CCR syncer needs to know the distribution of tables, partitions,
indexes, and replicas when synchronizing binlogs. If a partition is
deleted before the binlog synchronization is complete, the CCR syncer
cannot continue synchronizing. This PR will record the deleted
partitions and include them in the get meta response, allowing the CCR
syncer to filter out the binlogs that belong to these partitions.

The CCR syncer part PR is selectdb/ccr-syncer#117.
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Cherry-pick apache#37196, apache#37326.

The CCR syncer needs to know the distribution of tables, partitions,
indexes, and replicas when synchronizing binlogs. If a partition is
deleted before the binlog synchronization is complete, the CCR syncer
cannot continue synchronizing. This PR will record the deleted
partitions and include them in the get meta response, allowing the CCR
syncer to filter out the binlogs that belong to these partitions.

The CCR syncer part PR is selectdb/ccr-syncer#117.
@gavinchou gavinchou mentioned this pull request Aug 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants