Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training crashes on local compute_target #21580

Closed
buggooo opened this issue Jan 3, 2019 — with docs.microsoft.com · 3 comments
Closed

Training crashes on local compute_target #21580

buggooo opened this issue Jan 3, 2019 — with docs.microsoft.com · 3 comments

Comments

Copy link

buggooo commented Jan 3, 2019

When reproducing the tutorial only to use 'local' as training_target (with docker installed locally) and data moved to the source directory, so that it is visible to script, I got the following error after the conda environment was built, as a part of the first docker run execution:

Logging experiment running status in history service.
Running: ['docker', 'run', '--name', 'sklearn-mnist_154...b', ...
...
/azureml-envs/azureml_088...6/bin/python: can't open file 'azureml-setup/run_script.py': [Errno 2] No such file or directory


Document Details

Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

@YutongTie-MSFT
Copy link
Contributor

@buggooo
Thanks for the feedback! We are currently investigating and will update you shortly.

@buggooo
Copy link
Author

buggooo commented Jan 4, 2019

Just some additional clarification: I'm running on Windows (Docker for Windows). It seems that the C:\Users...\AppData\Local\Temp\azureml_runs\sklearn-mnist_1546526644_ad63ddfb folder is mounted into \azureml-run but is empty inside the docker image

@buggooo
Copy link
Author

buggooo commented Jan 4, 2019

Problem solved. It had to do with some strange behavior on Docker for Windows, with restrictions to your user password. See more here docker/for-win#25 (comment)

@buggooo buggooo closed this as completed Jan 4, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants