Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ERROR: could not resize shared memory segment #15034

Closed
heww opened this issue Jun 1, 2021 · 2 comments · Fixed by #15049
Closed

ERROR: could not resize shared memory segment #15034

heww opened this issue Jun 1, 2021 · 2 comments · Fixed by #15049
Assignees
@wy65701436 @heww
Labels
area/database area/performance target/2.3.0
Milestone
Sprint 113

Comments

@heww
Copy link
Contributor

heww commented Jun 1, 2021

Preparing data is failed when run perf for the harbor, there are many errors in postgres.

Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.233 UTC [250] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.242 UTC [192] ERROR:  could not resize shared memory segment "/PostgreSQL.76109999" to 183488 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.242 UTC [192] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.243 UTC [529] ERROR:  could not resize shared memory segment "/PostgreSQL.6573358" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.243 UTC [529] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.244 UTC [78] ERROR:  could not resize shared memory segment "/PostgreSQL.1188897147" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.244 UTC [78] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.247 UTC [376] ERROR:  could not resize shared memory segment "/PostgreSQL.1788363220" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.247 UTC [376] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.267 UTC [78] ERROR:  could not resize shared memory segment "/PostgreSQL.443848237" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.267 UTC [78] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.268 UTC [157] ERROR:  could not resize shared memory segment "/PostgreSQL.1735626446" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.268 UTC [157] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.268 UTC [421] ERROR:  could not resize shared memory segment "/PostgreSQL.59572807" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.268 UTC [421] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.268 UTC [163] ERROR:  could not resize shared memory segment "/PostgreSQL.1349358301" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.268 UTC [163] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.271 UTC [373] ERROR:  could not resize shared memory segment "/PostgreSQL.198624446" to 183552 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.271 UTC [373] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.274 UTC [451] ERROR:  could not resize shared memory segment "/PostgreSQL.1693316062" to 183456 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.274 UTC [451] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.274 UTC [176] ERROR:  could not resize shared memory segment "/PostgreSQL.57565733" to 183488 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.274 UTC [176] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.274 UTC [161] ERROR:  could not resize shared memory segment "/PostgreSQL.1205902833" to 183456 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.274 UTC [161] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.275 UTC [86] ERROR:  could not resize shared memory segment "/PostgreSQL.1889834448" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.275 UTC [86] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.277 UTC [473] ERROR:  could not resize shared memory segment "/PostgreSQL.603071093" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.277 UTC [473] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.281 UTC [665] ERROR:  could not resize shared memory segment "/PostgreSQL.1667834621" to 183360 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.281 UTC [665] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.282 UTC [119] ERROR:  could not resize shared memory segment "/PostgreSQL.1084321425" to 183360 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.282 UTC [119] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.282 UTC [533] ERROR:  could not resize shared memory segment "/PostgreSQL.676107313" to 183488 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.282 UTC [533] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.284 UTC [81] ERROR:  could not resize shared memory segment "/PostgreSQL.421451855" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.284 UTC [81] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.285 UTC [658] ERROR:  could not resize shared memory segment "/PostgreSQL.828506711" to 183456 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.285 UTC [658] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.286 UTC [333] ERROR:  could not resize shared memory segment "/PostgreSQL.2128819237" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.286 UTC [333] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.298 UTC [217] ERROR:  could not resize shared memory segment "/PostgreSQL.2084545344" to 183360 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.298 UTC [217] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.368 UTC [269] ERROR:  could not resize shared memory segment "/PostgreSQL.1578961490" to 183360 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.368 UTC [269] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.373 UTC [494] ERROR:  could not resize shared memory segment "/PostgreSQL.1501854229" to 183456 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.373 UTC [494] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.473 UTC [415] ERROR:  could not resize shared memory segment "/PostgreSQL.385268041" to 183360 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.473 UTC [415] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.473 UTC [468] ERROR:  could not resize shared memory segment "/PostgreSQL.782293344" to 183360 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.473 UTC [468] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.473 UTC [287] ERROR:  could not resize shared memory segment "/PostgreSQL.89395579" to 183360 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.473 UTC [287] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.473 UTC [101] ERROR:  could not resize shared memory segment "/PostgreSQL.1645813213" to 183360 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.473 UTC [101] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.473 UTC [340] ERROR:  could not resize shared memory segment "/PostgreSQL.1767612635" to 183552 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.473 UTC [340] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.474 UTC [140] ERROR:  could not resize shared memory segment "/PostgreSQL.1996445492" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.474 UTC [140] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.475 UTC [162] ERROR:  could not resize shared memory segment "/PostgreSQL.2102091300" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.475 UTC [162] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.476 UTC [384] ERROR:  could not resize shared memory segment "/PostgreSQL.1373418637" to 183552 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.476 UTC [384] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.477 UTC [517] ERROR:  could not resize shared memory segment "/PostgreSQL.2072860096" to 183552 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.477 UTC [517] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.478 UTC [553] ERROR:  could not resize shared memory segment "/PostgreSQL.1863093670" to 183552 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.478 UTC [553] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.479 UTC [400] ERROR:  could not resize shared memory segment "/PostgreSQL.2139261189" to 196736 bytes: No space left on device
Jun  1 06:43:28 192.168.224.1 postgresql[9262]: 2021-06-01 06:43:28.479 UTC [400] STATEMENT:  SELECT SUM(size) FROM blob JOIN project_blob ON blob.id = project_blob.blob_id AND project_id = $1 AND content_type NOT IN ($2)
@heww
Copy link
Contributor Author

heww commented Jun 1, 2021 •
edited

Increasing the shm size for the harbor-db container or disable the max_parallel_workers may resolve this problem.

https://dba.stackexchange.com/questions/275378/dev-shm-size-recommendation-for-postgres-database-in-docker

https://postgresqlco.nf/doc/en/param/max_parallel_workers/

https://postgrespro.com/list/thread-id/2448119

@wy65701436
Copy link
Contributor

just increase the shm_size of pg

@yanji09 yanji09 added this to the Sprint 113 milestone Jun 1, 2021
wy65701436 added a commit to wy65701436/harbor that referenced this issue Jun 2, 2021
@wy65701436
set shm size of postgres
d6c3456 
Fixed goharbor#15034, as for postgres 13, the default shm size 64MB, set to 1gb to avoid could not resize shared memory segment error.

Signed-off-by: Wang Yan <wangyan@vmware.com>
wy65701436 added a commit to wy65701436/harbor that referenced this issue Jun 2, 2021
@wy65701436
set shm size of postgres
0eaae0d 
Fixed goharbor#15034, as for postgres 13, the default shm size is 64MB, set to 1gb to avoid could not resize shared memory segment error.

Signed-off-by: Wang Yan <wangyan@vmware.com>
@wy65701436 wy65701436 mentioned this issue Jun 2, 2021
Merged
wy65701436 added a commit to wy65701436/harbor that referenced this issue Jun 3, 2021
@wy65701436
set shm size of postgres
eec9893 
Fixed goharbor#15034, as for postgres 13, the default shm size is 64MB, set to 1gb to avoid could not resize shared memory segment error.

Signed-off-by: Wang Yan <wangyan@vmware.com>
Vad1mo pushed a commit to container-registry/harbor that referenced this issue Jun 26, 2021
@wy65701436 @Vad1mo
set shm size of postgres
a23dd54 
Fixed goharbor#15034, as for postgres 13, the default shm size is 64MB, set to 1gb to avoid could not resize shared memory segment error.

Signed-off-by: Wang Yan <wangyan@vmware.com>
Signed-off-by: Vadim Bauer <vb@container-registry.com>
yunkunrao pushed a commit to yunkunrao/harbor that referenced this issue Aug 19, 2021
@wy65701436 @yunkunrao
set shm size of postgres
6b668a2 
Fixed goharbor#15034, as for postgres 13, the default shm size is 64MB, set to 1gb to avoid could not resize shared memory segment error.

Signed-off-by: Wang Yan <wangyan@vmware.com>
prahaladdarkin pushed a commit to prahaladdarkin/harbor that referenced this issue Nov 12, 2021
@wy65701436 @prahaladdarkin
set shm size of postgres
8928342 
Fixed goharbor#15034, as for postgres 13, the default shm size is 64MB, set to 1gb to avoid could not resize shared memory segment error.

Signed-off-by: Wang Yan <wangyan@vmware.com>
This was referenced Dec 14, 2021
Closed
Closed
@aidewn aidewn mentioned this issue Dec 20, 2021
Closed
@AiDaShi AiDaShi mentioned this issue Jun 13, 2022
Closed
@lxh-015 lxh-015 mentioned this issue Nov 20, 2022
Closed
@Noisia0800 Noisia0800 mentioned this issue Mar 25, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@wy65701436 wy65701436

@heww heww

Labels
area/database area/performance target/2.3.0
Projects
None yet
Milestone
Sprint 113
Development

Successfully merging a pull request may close this issue.

set shm size of postgres wy65701436/harbor
3 participants
@wy65701436 @heww @yanji09