New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add S3 bucket connectivity or integration into SageMaker Studio Lab #178
Comments
@taureandyernv , thank you for the feedback! I understood to evacuate existing conda environment and dataset and back these after the operation is painful. I felt "mount S3 to Studio Lab" experience will be what you need. Does |
@taureandyernv, as your ML experiments get too big for Studio Lab you may want to consider launching your notebooks in Sagemaker Studio. We tried to make this easy to do with a new feature called Notebook jobs (just released last December 22). With Notebook jobs, you can work on your notebook in Studio Lab but then schedule it to run in SageMaker (you will need an AWS account). The job will kick off and shut down when complete. Yes, there will be some cost, but depending on the instance type you select it may be negligible. |
Are there any plans to allow mounting of external drives such as S3 in Studio Lab? |
@fkunn1326 thank you for the comment. For now, we have not had the specific plan to mount the S3. You aren't allowed to use SageMaker in your school AWS account? |
I think installing Mountpoint S3 to Studio Lab will work (it requires |
Is your feature request related to a problem? Please describe.
I'd like to be able to temporarily connect different S3 buckets to SageMaker Studio Lab (SMSL) for either extra library storage or dataset storage. I'm currently having trouble installing the latest RAPIDS version on SMSL due to running out of space, and have resorted to deleting datasets that take a long time to download. I even have to delete the zip files. The downloads, conda environment recreation, and failed installs take up precious GPU time that is already hard to come by.
Describe the solution you'd like
I'd like to be able to connect an s3 bucket to SMSL with the conda envs and data ready to go.
Describe alternatives you've considered
Additional context
Some additional libraries for GPU deep learning and machine learning take up a bit of room when downloading and expanding using conda.
The text was updated successfully, but these errors were encountered: