Skip to content

Conversation

@xinyiZzz
Copy link
Contributor

@xinyiZzz xinyiZzz commented Apr 28, 2024

Proposed changes

  1. BE all available physical memory = min(system physical memory, cgroup mem limit)
  2. BE real-time available physical memory = min(system available memory, cgroup mem limit - cgroup usage memory)
  3. refresh system memory info and cgroup memory info every 100ms.

reproduction steps:

cgcreate -t zxy:zxy -g memory:test
cgset -r memory.limit_in_bytes=10000 /sys/fs/cgroup/memory/test
sudo sh -c "echo 5000M > memory.limit_in_bytes"
cat memory.limit_in_bytes
cat memory.usage_in_bytes

sudo sh -c "echo $$ >> cgroup.procs"

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@xinyiZzz
Copy link
Contributor Author

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@xinyiZzz
Copy link
Contributor Author

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.51% (8931/25148)
Line Coverage: 27.21% (73668/270742)
Region Coverage: 26.40% (38055/144175)
Branch Coverage: 23.19% (19397/83632)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a884604ea9a50c077bef6a88db651b40b2f54bc8_a884604ea9a50c077bef6a88db651b40b2f54bc8/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 41565 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a884604ea9a50c077bef6a88db651b40b2f54bc8, data reload: false

------ Round 1 ----------------------------------
q1	17893	5479	4298	4298
q2	2018	197	194	194
q3	10544	1185	1248	1185
q4	10239	795	792	792
q5	7538	2724	2732	2724
q6	224	140	137	137
q7	1073	652	610	610
q8	9211	2122	2123	2122
q9	9145	6865	6825	6825
q10	9385	3885	3902	3885
q11	452	245	238	238
q12	495	246	239	239
q13	17422	3251	3194	3194
q14	272	227	226	226
q15	505	480	480	480
q16	504	408	402	402
q17	986	743	717	717
q18	8415	7779	7706	7706
q19	4256	1610	1575	1575
q20	656	316	314	314
q21	5308	3422	4246	3422
q22	357	284	280	280
Total cold run time: 116898 ms
Total hot run time: 41565 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4524	4504	4383	4383
q2	378	265	288	265
q3	3202	2932	2906	2906
q4	2007	1586	1632	1586
q5	5360	5554	5471	5471
q6	220	129	126	126
q7	2329	2050	1978	1978
q8	3265	3419	3378	3378
q9	8862	8844	8896	8844
q10	4138	3819	3745	3745
q11	586	489	475	475
q12	798	653	624	624
q13	16303	3088	3120	3088
q14	310	279	283	279
q15	525	483	480	480
q16	479	428	447	428
q17	1824	1523	1515	1515
q18	7878	7657	7513	7513
q19	1657	1520	1565	1520
q20	1963	1804	1783	1783
q21	8676	4799	4739	4739
q22	579	512	498	498
Total cold run time: 75863 ms
Total hot run time: 55624 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185866 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a884604ea9a50c077bef6a88db651b40b2f54bc8, data reload: false

query1	915	359	348	348
query2	6455	2396	2302	2302
query3	6884	208	212	208
query4	23060	21231	21322	21231
query5	4181	414	426	414
query6	264	183	182	182
query7	4586	290	288	288
query8	242	193	182	182
query9	8645	2281	2273	2273
query10	428	245	243	243
query11	14825	14066	14138	14066
query12	139	86	83	83
query13	1645	372	374	372
query14	10381	8322	7018	7018
query15	256	167	166	166
query16	8067	255	269	255
query17	1699	588	564	564
query18	2116	284	287	284
query19	227	153	152	152
query20	92	86	87	86
query21	204	128	132	128
query22	5095	4839	4860	4839
query23	33738	33199	33123	33123
query24	11416	2998	2972	2972
query25	645	393	387	387
query26	1637	155	155	155
query27	2944	321	338	321
query28	7486	1994	2005	1994
query29	1000	629	621	621
query30	251	148	158	148
query31	976	753	756	753
query32	93	52	55	52
query33	747	260	258	258
query34	1009	489	489	489
query35	808	687	670	670
query36	1047	939	889	889
query37	272	67	74	67
query38	3183	3025	3030	3025
query39	1586	1517	1534	1517
query40	259	131	129	129
query41	47	42	42	42
query42	105	98	99	98
query43	572	524	530	524
query44	1299	747	762	747
query45	280	270	263	263
query46	1091	709	726	709
query47	1946	1813	1835	1813
query48	375	303	300	300
query49	996	406	410	406
query50	782	398	390	390
query51	6838	6723	6775	6723
query52	103	90	95	90
query53	353	283	284	283
query54	323	253	253	253
query55	82	76	72	72
query56	258	229	230	229
query57	1246	1117	1146	1117
query58	230	199	205	199
query59	3363	3258	3249	3249
query60	266	247	243	243
query61	173	86	86	86
query62	634	447	435	435
query63	311	282	290	282
query64	9409	7258	7185	7185
query65	3103	3012	3030	3012
query66	1331	335	361	335
query67	15706	15218	14944	14944
query68	9734	574	556	556
query69	577	297	302	297
query70	1378	1145	1050	1050
query71	503	273	270	270
query72	8223	2647	2447	2447
query73	1556	320	330	320
query74	6618	6039	6076	6039
query75	4537	2700	2686	2686
query76	5732	972	988	972
query77	671	270	270	270
query78	10976	10293	10246	10246
query79	10282	510	518	510
query80	1595	423	422	422
query81	498	232	223	223
query82	241	89	95	89
query83	204	165	208	165
query84	261	83	84	83
query85	1092	275	255	255
query86	348	296	326	296
query87	3290	3041	3047	3041
query88	4862	2418	2413	2413
query89	505	375	375	375
query90	2354	186	190	186
query91	123	96	96	96
query92	65	47	48	47
query93	5743	520	493	493
query94	1664	180	177	177
query95	392	305	299	299
query96	614	273	272	272
query97	3153	2931	2916	2916
query98	233	219	217	217
query99	1096	855	875	855
Total cold run time: 309845 ms
Total hot run time: 185866 ms

@doris-robot
Copy link

TPC-H: Total hot run time: 40791 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a884604ea9a50c077bef6a88db651b40b2f54bc8, data reload: false

------ Round 1 ----------------------------------
q1	17731	4378	4260	4260
q2	2010	193	183	183
q3	10465	1162	1121	1121
q4	10201	764	825	764
q5	7529	2675	2703	2675
q6	218	140	133	133
q7	1059	626	600	600
q8	9206	2084	2088	2084
q9	9300	6745	6805	6745
q10	8913	3893	3914	3893
q11	468	243	243	243
q12	457	224	233	224
q13	18303	3250	3218	3218
q14	281	240	246	240
q15	529	479	483	479
q16	528	402	389	389
q17	947	645	722	645
q18	8361	7759	7584	7584
q19	5861	1530	1521	1521
q20	651	311	315	311
q21	5209	3204	3233	3204
q22	336	275	285	275
Total cold run time: 118563 ms
Total hot run time: 40791 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4560	4373	4426	4373
q2	362	269	274	269
q3	3191	2900	2857	2857
q4	1910	1693	1689	1689
q5	5471	5387	5520	5387
q6	215	124	124	124
q7	2322	1967	1947	1947
q8	3250	3409	3368	3368
q9	8828	8784	8827	8784
q10	4050	3874	3838	3838
q11	581	488	490	488
q12	762	608	590	590
q13	15991	3067	3156	3067
q14	311	273	285	273
q15	524	495	475	475
q16	484	440	425	425
q17	1794	1546	1507	1507
q18	8203	7570	7446	7446
q19	1633	1500	1545	1500
q20	1973	1761	1736	1736
q21	8632	4794	4728	4728
q22	567	493	504	493
Total cold run time: 75614 ms
Total hot run time: 55364 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185781 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a884604ea9a50c077bef6a88db651b40b2f54bc8, data reload: false

query1	902	359	353	353
query2	6426	2348	2284	2284
query3	6641	206	205	205
query4	23465	21197	21197	21197
query5	4112	419	427	419
query6	275	183	182	182
query7	4584	281	288	281
query8	249	199	196	196
query9	8497	2284	2252	2252
query10	430	251	241	241
query11	14692	14100	14229	14100
query12	142	89	85	85
query13	1669	354	354	354
query14	10083	7468	7427	7427
query15	217	173	174	173
query16	7719	248	248	248
query17	1766	550	539	539
query18	1943	275	275	275
query19	203	147	149	147
query20	93	85	85	85
query21	194	126	124	124
query22	4997	4830	4906	4830
query23	34054	33205	33159	33159
query24	6613	2965	2926	2926
query25	550	382	363	363
query26	706	150	144	144
query27	1966	312	307	307
query28	3799	1987	1972	1972
query29	829	596	583	583
query30	245	156	153	153
query31	949	727	743	727
query32	87	55	58	55
query33	485	244	241	241
query34	879	466	477	466
query35	749	668	664	664
query36	1064	886	854	854
query37	103	63	66	63
query38	3222	3011	3008	3008
query39	1591	1544	1526	1526
query40	196	124	122	122
query41	40	40	39	39
query42	102	94	97	94
query43	540	543	552	543
query44	1052	721	745	721
query45	278	271	267	267
query46	1050	693	702	693
query47	1940	1893	1871	1871
query48	367	298	293	293
query49	751	390	395	390
query50	770	378	369	369
query51	6894	6954	6811	6811
query52	105	87	89	87
query53	347	277	284	277
query54	265	261	244	244
query55	81	72	73	72
query56	240	219	220	219
query57	1234	1158	1148	1148
query58	222	196	200	196
query59	3522	3307	3085	3085
query60	263	229	233	229
query61	89	87	85	85
query62	548	459	422	422
query63	299	270	273	270
query64	8034	7127	7117	7117
query65	3061	3035	3052	3035
query66	784	337	337	337
query67	15341	14869	15204	14869
query68	5223	528	514	514
query69	480	304	310	304
query70	1223	1127	1147	1127
query71	373	280	279	279
query72	7282	2719	2436	2436
query73	701	318	316	316
query74	6530	6095	6124	6095
query75	3302	2694	2685	2685
query76	2593	1056	1001	1001
query77	376	258	266	258
query78	10796	10462	10207	10207
query79	7742	501	512	501
query80	1983	430	422	422
query81	494	223	226	223
query82	1519	90	92	90
query83	254	167	161	161
query84	258	85	85	85
query85	1187	275	268	268
query86	456	297	292	292
query87	3279	3128	3096	3096
query88	5135	2396	2395	2395
query89	532	371	362	362
query90	2142	177	176	176
query91	122	96	98	96
query92	62	49	46	46
query93	6319	497	492	492
query94	1122	183	182	182
query95	390	296	289	289
query96	612	293	269	269
query97	3151	2945	2930	2930
query98	238	226	217	217
query99	1223	854	856	854
Total cold run time: 282704 ms
Total hot run time: 185781 ms

if (_s_physical_mem == -1) {
LOG(WARNING) << "Could not determine amount of physical memory on this machine.";
// 2. if physical_mem changed, refresh mem limit and gc size.
if (_s_physical_mem.load(std::memory_order_relaxed) != physical_mem) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should check physical_mem > 0.
Because if it == -1, then the following logic after 410 is wrong.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

@xinyiZzz xinyiZzz force-pushed the 20240424_fix_cgroup_mem branch from a884604 to 074297d Compare May 6, 2024 08:51
@xinyiZzz
Copy link
Contributor Author

xinyiZzz commented May 6, 2024

run buildall

@github-actions
Copy link
Contributor

github-actions bot commented May 6, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-DS: Total hot run time: 189242 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 074297d07e49c976575ff8951c328fefbae3156b, data reload: false

query1	921	363	346	346
query2	6444	2296	2340	2296
query3	6636	210	215	210
query4	23095	21853	21901	21853
query5	3735	439	442	439
query6	260	176	173	173
query7	4534	305	298	298
query8	250	191	191	191
query9	8727	2470	2479	2470
query10	422	264	273	264
query11	15219	14858	14786	14786
query12	129	91	89	89
query13	1629	378	379	378
query14	10437	8381	7569	7569
query15	243	179	170	170
query16	8157	255	252	252
query17	1794	552	547	547
query18	2073	287	271	271
query19	333	166	153	153
query20	89	85	81	81
query21	202	129	132	129
query22	5155	4978	4975	4975
query23	34005	33553	33428	33428
query24	10741	2883	2942	2883
query25	597	365	356	356
query26	1112	153	153	153
query27	2366	313	308	308
query28	7264	2068	2056	2056
query29	859	599	589	589
query30	236	148	152	148
query31	964	711	733	711
query32	92	51	50	50
query33	728	250	250	250
query34	1017	478	487	478
query35	785	686	668	668
query36	1075	883	915	883
query37	127	67	62	62
query38	3173	3024	3100	3024
query39	1586	1545	1542	1542
query40	209	123	125	123
query41	42	38	41	38
query42	105	98	93	93
query43	576	538	532	532
query44	1221	726	737	726
query45	268	246	268	246
query46	1086	722	723	722
query47	1981	1865	1897	1865
query48	369	302	301	301
query49	848	426	382	382
query50	768	388	379	379
query51	6723	6683	6655	6655
query52	98	88	93	88
query53	354	288	290	288
query54	307	226	241	226
query55	77	75	78	75
query56	245	220	220	220
query57	1198	1138	1146	1138
query58	222	199	201	199
query59	3347	3169	3097	3097
query60	259	248	235	235
query61	92	89	86	86
query62	668	484	458	458
query63	303	283	276	276
query64	8639	7235	7204	7204
query65	3094	3041	3027	3027
query66	834	342	330	330
query67	15512	15169	15096	15096
query68	5221	525	521	521
query69	490	303	305	303
query70	1187	1097	1143	1097
query71	424	267	279	267
query72	7255	2556	2356	2356
query73	712	316	314	314
query74	6528	6184	6121	6121
query75	3492	2633	2662	2633
query76	3203	927	1059	927
query77	380	266	266	266
query78	10813	10453	10455	10453
query79	5880	528	525	525
query80	2188	431	446	431
query81	540	273	218	218
query82	912	96	86	86
query83	316	167	187	167
query84	262	92	82	82
query85	1998	281	270	270
query86	485	311	292	292
query87	3310	3140	3154	3140
query88	4849	2319	2317	2317
query89	476	381	368	368
query90	2018	182	177	177
query91	124	98	96	96
query92	64	47	47	47
query93	5277	518	513	513
query94	1188	189	204	189
query95	1113	1097	1095	1095
query96	601	265	268	265
query97	3144	2971	2970	2970
query98	243	220	223	220
query99	1234	882	890	882
Total cold run time: 292583 ms
Total hot run time: 189242 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.62% (8968/25180)
Line Coverage: 27.25% (74007/271566)
Region Coverage: 26.48% (38236/144421)
Branch Coverage: 23.23% (19470/83820)
Coverage Report: http://coverage.selectdb-in.cc/coverage/074297d07e49c976575ff8951c328fefbae3156b_074297d07e49c976575ff8951c328fefbae3156b/report/index.html

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label May 6, 2024
@github-actions
Copy link
Contributor

github-actions bot commented May 6, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented May 6, 2024

PR approved by anyone and no changes requested.

@yiguolei yiguolei merged commit 74f6240 into apache:master May 6, 2024
@geoffreytran
Copy link

geoffreytran commented May 9, 2024

When testing out this change, we're getting the following errors on Mac OS Docker.

doris-be-01  | W20240509 16:40:22.803295  2643 status.h:380] meet error status: [NOT_FOUND]Could not find subsystem memory in /proc/self/cgroup
doris-be-01  | 
doris-be-01  |  0#  doris::CGroupUtil::find_global_cgroup(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  1#  doris::CGroupUtil::find_abs_cgroup_path(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  2#  doris::CGroupUtil::find_cgroup_mem_limit(long*)
doris-be-01  |  3#  doris::MemInfo::refresh_proc_meminfo()
doris-be-01  |  4#  doris::Daemon::memory_maintenance_thread()
doris-be-01  |  5#  doris::Thread::supervise_thread(void*)
doris-be-01  |  6#  ?
doris-be-01  |  7#  ?
doris-be-01  | W20240509 16:40:22.804112  2643 status.h:380] meet error status: [NOT_FOUND]Could not find subsystem memory in /proc/self/cgroup
doris-be-01  | 
doris-be-01  |  0#  doris::CGroupUtil::find_global_cgroup(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  1#  doris::CGroupUtil::find_abs_cgroup_path(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  2#  doris::CGroupUtil::find_cgroup_mem_usage(long*)
doris-be-01  |  3#  doris::MemInfo::refresh_proc_meminfo()
doris-be-01  |  4#  doris::Daemon::memory_maintenance_thread()
doris-be-01  |  5#  doris::Thread::supervise_thread(void*)
doris-be-01  |  6#  ?
doris-be-01  |  7#  ?
doris-be-01  | W20240509 16:40:22.905403  2643 status.h:380] meet error status: [NOT_FOUND]Could not find subsystem memory in /proc/self/cgroup
doris-be-01  | 
doris-be-01  |  0#  doris::CGroupUtil::find_global_cgroup(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  1#  doris::CGroupUtil::find_abs_cgroup_path(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  2#  doris::CGroupUtil::find_cgroup_mem_limit(long*)
doris-be-01  |  3#  doris::MemInfo::refresh_proc_meminfo()
doris-be-01  |  4#  doris::Daemon::memory_maintenance_thread()
doris-be-01  |  5#  doris::Thread::supervise_thread(void*)
doris-be-01  |  6#  ?
doris-be-01  |  7#  ?
doris-be-01  | W20240509 16:40:22.906523  2643 status.h:380] meet error status: [NOT_FOUND]Could not find subsystem memory in /proc/self/cgroup
doris-be-01  | 
doris-be-01  |  0#  doris::CGroupUtil::find_global_cgroup(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  1#  doris::CGroupUtil::find_abs_cgroup_path(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  2#  doris::CGroupUtil::find_cgroup_mem_usage(long*)
doris-be-01  |  3#  doris::MemInfo::refresh_proc_meminfo()
doris-be-01  |  4#  doris::Daemon::memory_maintenance_thread()
doris-be-01  |  5#  doris::Thread::supervise_thread(void*)
doris-be-01  |  6#  ?
doris-be-01  |  7#  ?
root@be-01:/# cat /proc/self/cgroup
0::/

ByteYue pushed a commit to ByteYue/doris that referenced this pull request May 15, 2024
@xinyiZzz
Copy link
Contributor Author

When testing out this change, we're getting the following errors on Mac OS Docker.

doris-be-01  | W20240509 16:40:22.803295  2643 status.h:380] meet error status: [NOT_FOUND]Could not find subsystem memory in /proc/self/cgroup
doris-be-01  | 
doris-be-01  |  0#  doris::CGroupUtil::find_global_cgroup(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  1#  doris::CGroupUtil::find_abs_cgroup_path(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  2#  doris::CGroupUtil::find_cgroup_mem_limit(long*)
doris-be-01  |  3#  doris::MemInfo::refresh_proc_meminfo()
doris-be-01  |  4#  doris::Daemon::memory_maintenance_thread()
doris-be-01  |  5#  doris::Thread::supervise_thread(void*)
doris-be-01  |  6#  ?
doris-be-01  |  7#  ?
doris-be-01  | W20240509 16:40:22.804112  2643 status.h:380] meet error status: [NOT_FOUND]Could not find subsystem memory in /proc/self/cgroup
doris-be-01  | 
doris-be-01  |  0#  doris::CGroupUtil::find_global_cgroup(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  1#  doris::CGroupUtil::find_abs_cgroup_path(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  2#  doris::CGroupUtil::find_cgroup_mem_usage(long*)
doris-be-01  |  3#  doris::MemInfo::refresh_proc_meminfo()
doris-be-01  |  4#  doris::Daemon::memory_maintenance_thread()
doris-be-01  |  5#  doris::Thread::supervise_thread(void*)
doris-be-01  |  6#  ?
doris-be-01  |  7#  ?
doris-be-01  | W20240509 16:40:22.905403  2643 status.h:380] meet error status: [NOT_FOUND]Could not find subsystem memory in /proc/self/cgroup
doris-be-01  | 
doris-be-01  |  0#  doris::CGroupUtil::find_global_cgroup(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  1#  doris::CGroupUtil::find_abs_cgroup_path(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  2#  doris::CGroupUtil::find_cgroup_mem_limit(long*)
doris-be-01  |  3#  doris::MemInfo::refresh_proc_meminfo()
doris-be-01  |  4#  doris::Daemon::memory_maintenance_thread()
doris-be-01  |  5#  doris::Thread::supervise_thread(void*)
doris-be-01  |  6#  ?
doris-be-01  |  7#  ?
doris-be-01  | W20240509 16:40:22.906523  2643 status.h:380] meet error status: [NOT_FOUND]Could not find subsystem memory in /proc/self/cgroup
doris-be-01  | 
doris-be-01  |  0#  doris::CGroupUtil::find_global_cgroup(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  1#  doris::CGroupUtil::find_abs_cgroup_path(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)
doris-be-01  |  2#  doris::CGroupUtil::find_cgroup_mem_usage(long*)
doris-be-01  |  3#  doris::MemInfo::refresh_proc_meminfo()
doris-be-01  |  4#  doris::Daemon::memory_maintenance_thread()
doris-be-01  |  5#  doris::Thread::supervise_thread(void*)
doris-be-01  |  6#  ?
doris-be-01  |  7#  ?
root@be-01:/# cat /proc/self/cgroup
0::/

Hi @geoffreytran, i found this problem, will fix it soon

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.3-merged dev/3.0.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants