Skip to content

[fix](fe) CloudPartition returns cached version in the checkpoint thread#36933

Merged
dataroaring merged 1 commit into
apache:masterfrom
w41ter:cloud_partition_version_in_ckpt
Jun 27, 2024
Merged

[fix](fe) CloudPartition returns cached version in the checkpoint thread#36933
dataroaring merged 1 commit into
apache:masterfrom
w41ter:cloud_partition_version_in_ckpt

Conversation

@w41ter
Copy link
Copy Markdown
Contributor

@w41ter w41ter commented Jun 27, 2024

No description provided.

@doris-robot
Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Copy Markdown
Contributor Author

w41ter commented Jun 27, 2024

run buildall

Copy link
Copy Markdown
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Jun 27, 2024
@github-actions
Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 40019 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6d6464e2fff29573676fc5560e2fb92d34a09ada, data reload: false

------ Round 1 ----------------------------------
q1	17893	4342	4275	4275
q2	2021	191	192	191
q3	11224	1161	1171	1161
q4	10540	800	734	734
q5	8128	2673	2655	2655
q6	223	138	134	134
q7	955	595	617	595
q8	9602	2105	2091	2091
q9	9133	6612	6629	6612
q10	9218	3719	3687	3687
q11	452	239	237	237
q12	473	227	227	227
q13	18712	2960	2980	2960
q14	264	219	205	205
q15	540	464	473	464
q16	507	382	378	378
q17	954	696	758	696
q18	8099	7562	7419	7419
q19	5650	1474	1468	1468
q20	659	327	322	322
q21	4874	3174	3846	3174
q22	383	341	334	334
Total cold run time: 120504 ms
Total hot run time: 40019 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4357	4205	4215	4205
q2	360	261	269	261
q3	3132	2931	2974	2931
q4	2027	1729	1704	1704
q5	5469	5460	5488	5460
q6	232	141	127	127
q7	2274	1904	1894	1894
q8	3238	3414	3415	3414
q9	8510	8621	8741	8621
q10	4058	3812	3835	3812
q11	598	546	503	503
q12	809	645	623	623
q13	16475	3240	3201	3201
q14	302	288	278	278
q15	536	498	481	481
q16	487	441	436	436
q17	1786	1535	1513	1513
q18	8225	7975	7733	7733
q19	1802	1658	1618	1618
q20	2063	1814	1858	1814
q21	5025	4965	4899	4899
q22	628	589	564	564
Total cold run time: 72393 ms
Total hot run time: 56092 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 173838 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6d6464e2fff29573676fc5560e2fb92d34a09ada, data reload: false

query1	903	380	371	371
query2	6324	2568	2482	2482
query3	6642	209	218	209
query4	19005	17433	17185	17185
query5	3774	490	459	459
query6	269	171	171	171
query7	4597	290	283	283
query8	301	281	286	281
query9	8704	2327	2327	2327
query10	551	287	266	266
query11	10611	9978	10063	9978
query12	130	94	84	84
query13	1635	352	365	352
query14	9927	7627	6870	6870
query15	235	185	186	185
query16	7741	267	266	266
query17	1906	576	506	506
query18	1907	281	262	262
query19	193	151	148	148
query20	88	88	79	79
query21	204	124	125	124
query22	4271	4066	4013	4013
query23	33921	33812	33760	33760
query24	11804	2908	2922	2908
query25	713	408	390	390
query26	1733	155	164	155
query27	2972	320	314	314
query28	7672	2075	2072	2072
query29	1092	629	633	629
query30	270	168	167	167
query31	987	784	755	755
query32	99	55	56	55
query33	794	312	293	293
query34	1014	475	479	475
query35	755	687	658	658
query36	1136	984	971	971
query37	215	74	71	71
query38	2949	2886	2836	2836
query39	898	825	843	825
query40	273	130	135	130
query41	56	56	53	53
query42	121	98	101	98
query43	580	561	573	561
query44	1193	746	731	731
query45	196	166	170	166
query46	1073	730	716	716
query47	1865	1779	1833	1779
query48	386	311	303	303
query49	934	414	415	414
query50	765	383	382	382
query51	6858	6833	6613	6613
query52	99	93	92	92
query53	373	297	284	284
query54	895	447	447	447
query55	76	75	75	75
query56	308	272	279	272
query57	1127	1072	1028	1028
query58	263	255	245	245
query59	3363	3462	3111	3111
query60	315	294	291	291
query61	113	110	110	110
query62	608	434	429	429
query63	312	288	293	288
query64	9838	2397	1712	1712
query65	3215	3089	3089	3089
query66	1265	323	322	322
query67	15840	15174	15007	15007
query68	8648	536	545	536
query69	748	467	426	426
query70	1248	1155	1134	1134
query71	505	273	267	267
query72	9076	5519	5504	5504
query73	2049	333	328	328
query74	5937	5623	5531	5531
query75	5163	2635	2651	2635
query76	4806	927	889	889
query77	779	298	291	291
query78	10373	9907	9703	9703
query79	7357	498	509	498
query80	2026	465	522	465
query81	556	235	221	221
query82	269	99	107	99
query83	307	167	167	167
query84	271	86	89	86
query85	959	288	265	265
query86	339	308	320	308
query87	3257	3086	3059	3059
query88	4079	2441	2442	2441
query89	494	372	375	372
query90	2003	194	183	183
query91	125	98	99	98
query92	59	47	48	47
query93	4828	504	496	496
query94	1301	184	186	184
query95	404	309	317	309
query96	608	270	261	261
query97	3207	3031	3022	3022
query98	220	248	190	190
query99	1104	863	840	840
Total cold run time: 294357 ms
Total hot run time: 173838 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 30.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6d6464e2fff29573676fc5560e2fb92d34a09ada, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.04	0.06
query4	1.68	0.07	0.06
query5	0.51	0.47	0.49
query6	1.13	0.74	0.73
query7	0.02	0.01	0.02
query8	0.06	0.05	0.05
query9	0.56	0.52	0.48
query10	0.53	0.54	0.52
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.59	0.58	0.60
query14	0.78	0.78	0.78
query15	0.84	0.81	0.80
query16	0.36	0.35	0.37
query17	1.02	0.98	1.00
query18	0.22	0.26	0.23
query19	1.78	1.74	1.66
query20	0.01	0.01	0.01
query21	15.45	0.76	0.68
query22	4.55	7.58	1.82
query23	18.32	1.29	1.26
query24	2.09	0.22	0.21
query25	0.15	0.09	0.08
query26	0.25	0.18	0.18
query27	0.08	0.07	0.08
query28	13.28	1.02	1.00
query29	12.61	3.31	3.27
query30	0.26	0.06	0.06
query31	2.88	0.38	0.38
query32	3.31	0.47	0.47
query33	2.87	2.88	2.88
query34	17.28	4.43	4.41
query35	4.54	4.52	4.63
query36	0.69	0.47	0.47
query37	0.19	0.15	0.16
query38	0.15	0.15	0.14
query39	0.04	0.03	0.04
query40	0.18	0.14	0.15
query41	0.09	0.05	0.05
query42	0.06	0.04	0.04
query43	0.05	0.04	0.04
Total cold run time: 110.12 s
Total hot run time: 30.4 s

@dataroaring dataroaring merged commit d921f9b into apache:master Jun 27, 2024
@w41ter w41ter deleted the cloud_partition_version_in_ckpt branch June 28, 2024 01:47
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants