Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mounting GS storage bucket inside containers #36

Open
priyakasimbeg opened this issue May 18, 2023 · 0 comments
Open

Mounting GS storage bucket inside containers #36

priyakasimbeg opened this issue May 18, 2023 · 0 comments

Comments

@priyakasimbeg
Copy link

I am trying to launch experiments locally with mounted data stored on GCS. Eventually I would like to run the experiments remotely on Kubernetes/VertexAI so I'd like the container to mount the data itself instead of mounting the data on the host machine manually.
I am using prebuilt containers by passing in the image path to the Container executable type. My entrypoint script mounts the GS data buckets with gcsfuse and runs the python training script. However, when running my containers through the xmanager launch script the gcsfuse operation exits with code 1. Running the containers manually with the --privileged option seemed to resolve the issue. However, there currently doesn't exist a xmanager DockerOption to specify --privileged mode.
Is it possible to add such an option? Or is there a different recommended way to mount the data?

@priyakasimbeg priyakasimbeg changed the title Mounting GS storage bucket to containers Mounting GS storage bucket inside containers May 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant