hcsshim::ImportLayer failed in Win32: The system cannot find the path specified. (0x3)

[dhirschfeld]

When trying to build a docker container for a Python data-science environment I'm getting the mentioned error right at the end of the build. Unfortunately it doesn't appear to happen on less complicated builds.

Error message at end of docker build

re-exec error: exit status 1: output: time="2017-04-26T15:58:20+10:00" level=error msg="hcsshim::ImportLayer failed in Win32: The system cannot find the path specified. (0x3) layerId=\\\\?\\C:\\ProgramData\\docker\\windowsfilter\\846463084a548600306c3f05fd185b7b46f04695bae40908f6485d3989b5e291 flavour=1 folder=C:\\Windows\\TEMP\\hcs235647079"
hcsshim::ImportLayer failed in Win32: The system cannot find the path specified. (0x3) layerId=\\?\C:\ProgramData\docker\windowsfilter\846463084a548600306c3f05fd185b7b46f04695bae40908f6485d3989b5e291 flavour=1 folder=C:\Windows\TEMP\hcs235647079

Output of docker version:

Client:
 Version:      17.06.0-dev
 API version:  1.30
 Go version:   go1.7.5
 Git commit:   d4fb626
 Built:        Wed Apr 26 03:46:47 2017
 OS/Arch:      windows/amd64

Server:
 Version:      17.06.0-dev
 API version:  1.30 (minimum version 1.24)
 Go version:   go1.7.5
 Git commit:   d4fb626
 Built:        Wed Apr 26 03:46:47 2017
 OS/Arch:      windows/amd64
 Experimental: true

Output of docker info:

Containers: 1
 Running: 0
 Paused: 0
 Stopped: 1
Images: 13
Server Version: 17.06.0-dev
Storage Driver: windowsfilter
 Windows:
Logging Driver: json-file
Plugins:
 Volume: local
 Network: l2bridge l2tunnel nat null overlay transparent
Swarm: inactive
Default Isolation: process
Kernel Version: 10.0 14393 (14393.1066.amd64fre.rs1_release_sec.170327-1835)
Operating System: Windows Server 2016 Standard
OSType: windows
Architecture: x86_64
CPUs: 4
Total Memory: 16GiB
Name: *******
ID: <redacted>
Docker Root Dir: C:\ProgramData\docker
Debug Mode (client): false
Debug Mode (server): false
Http Proxy: <redacted>
Https Proxy: <redacted>
Registry: https://index.docker.io/v1/
Experimental: true
Insecure Registries:
 127.0.0.0/8
Live Restore Enabled: false

Additional environment details:
This is on a Windows Server 2016 VM running on vSphere

[dhirschfeld]

The Dockerfile for the build was:

FROM dhirschfeld/nano-miniconda

SHELL ["powershell", "-Command", "$ErrorActionPreference='Stop'; $ProgressPreference='SilentlyContinue';"]

ADD testenv.yml C:/

RUN Start-Process conda -ArgumentList 'config','--set','channel_priority','false' -NoNewWindow -Wait; \
    Start-Process conda -ArgumentList 'config','--append','channels','conda-forge' -NoNewWindow -Wait; \
    Start-Process conda -ArgumentList 'update','--yes','--all'  -NoNewWindow -Wait; \
    Start-Process conda -ArgumentList 'env','update','--file','C:/testenv.yml'  -NoNewWindow -Wait; \
    Start-Process conda -ArgumentList 'clean','-tips' -NoNewWindow -Wait; \
    Remove-Item -Force C:/testenv.yml;

CMD ["cmd.exe"]

The miniconda container is available from my DockerHub account:
https://hub.docker.com/r/dhirschfeld/nano-miniconda/

And the required testenv.yml is available at:
https://gist.github.com/dhirschfeld/9ef0398fa8ba757e51dc0ef3b1c4fe37

[dhirschfeld]

Just a note to mention that if I run the nano-miniconda container then install the Python testenv manually everything seems to work fine but I get the same hcsshim::ImportLayer error if I try to commit the container.

[dhirschfeld]

I can also confirm that I'm seeing the same error on a new Azure VM so at least it should be reproducible.

[dhirschfeld]

...and as a further data point, it also fails with the same error message on Win10 Pro Version 1703 build 1506.250.

[thaJeztah]

ping @friism @johnstep PTAL

[thaJeztah]

(is this still an issue for you @dhirschfeld ?)

[dhirschfeld]

Yes. I worked around it but then it later keeps cropping up. I update the container then can't commit it.