Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow setting the shared memory (shm) size for TaskAPI #2115

Closed
sevro opened this issue Apr 24, 2021 · 1 comment · Fixed by #2132
Closed

Allow setting the shared memory (shm) size for TaskAPI #2115

sevro opened this issue Apr 24, 2021 · 1 comment · Fixed by #2132
Assignees
Labels
enhancement New feature or request TaskAPI Something related to the TaskAPI kind
Milestone

Comments

@sevro
Copy link

sevro commented Apr 24, 2021

Description

Allow setting shared memory for TaskAPI similar to other inference APIs.

Motivation

Currently it is not possible to use more than one PyTorch dataloader to train a model because of the shared memory limits, they fail with the error:

ERROR: Unexpected bus error encountered in worker. This might be caused by insufficient shared memory (shm).

Additional context

This was previously discussed in "Allow setting the shared memory (shm) size for the API container" #1638.

@sevro sevro added the enhancement New feature or request label Apr 24, 2021
@miguelvr miguelvr added the TaskAPI Something related to the TaskAPI kind label Apr 24, 2021
@miguelvr
Copy link
Collaborator

this one should be easy, thanks for reporting!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request TaskAPI Something related to the TaskAPI kind
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants