[UE5-Preview-1] There is not enough space on the disk.

[CanisHelix]

Output of the ue4-docker info command:

ue4-docker version:         0.0.96 (latest available version is 0.0.96)
Operating system:           Windows Server 2019 Standard (Build 17763.1935)
Docker daemon version:      20.10.5
NVIDIA Docker supported:    No
Maximum image size:         1024GB
Available disk space:       1017.18 GiB
Total system memory:        16 GiB physical, 36 GiB virtual
CPU:                        9 physical, 18 logical (Intel64 Family 6 Model 85 Stepping 4, GenuineIntel)

<none>                                 <none>                            2d3a76c29479   32 minutes ago   488GB
adamrehn/ue4-source                    5.0.0-preview-1                   c9bbb25dfd8a   9 hours ago      77.4GB
adamrehn/ue4-source                    5.0.0-preview-1-ltsc2019-vs2019   c9bbb25dfd8a   9 hours ago      77.4GB
adamrehn/ue4-build-prerequisites       ltsc2019-vs2019                   676e1d2ed391   10 hours ago     14.4GB
mcr.microsoft.com/windows              1809                              1773691e1aba   3 weeks ago      15.1GB
mcr.microsoft.com/windows/servercore   ltsc2019                          c703d4d60533   3 weeks ago      5.75GB

Additional details:

• Are you accessing the network through a proxy server? No

Failed to build due to space errors, despite logs showing enough space still remains. The docker image of 488GB is still below the 1024GB limit I have set. Suspected a new 8GB+ file exists and is breaking the copy process as normal.

ue4-docker build custom:5.0.0-preview-1 --visual-studio=2019 --no-engine --exclude debug --exclude templates --exclude ddc --monitor --opt disable-labels --opt enable-dso-patch --opt buildgraph-args="-set:WithClient=true -set:WithServer=true" -username <REDACTED> -password <REDACTED> -repo=https://github.com/EpicGames/UnrealEngine.git -branch="5.0.0-preview-1"

Removing intermediate container 100990aa5311
 ---> 554975b11077
Step 18/23 : COPY fix-targets.py C:\fix-targets.py
[ue4-docker build] [2022-02-28 14:57:44] [Available disk: 1017.24 GiB] [Available memory: 13.96 GiB physical, 33.74 GiB virtual] [CPU usage: 4.60%]
 ---> 4edefdb37bc0
Step 19/23 : RUN python C:\fix-targets.py C:\UnrealEngine\LocalBuilds\Engine\Windows\Engine\Config\BaseEngine.ini && echo. && echo.RUN directive complete. Docker will now commit the filesystem layer to disk. && echo.Note that for large filesystem layers this can take quite some time. && echo.Performing filesystem layer commit... && echo.
 ---> Running in 346f4fcd65b2

RUN directive complete. Docker will now commit the filesystem layer to disk.
Note that for large filesystem layers this can take quite some time.
Performing filesystem layer commit...

Removing intermediate container 346f4fcd65b2
 ---> 55e5f471aea0
Step 20/23 : ARG NAMESPACE
 ---> Running in dff7db130b13
Removing intermediate container dff7db130b13
 ---> 2d3a76c29479
Step 21/23 : FROM ${NAMESPACE}/ue4-build-prerequisites:${PREREQS_TAG}
 ---> 676e1d2ed391
Step 22/23 : COPY --from=builder C:\UnrealEngine\LocalBuilds\Engine\Windows C:\UnrealEngine
[ue4-docker build] [2022-02-28 14:58:04] [Available disk: 1017.15 GiB] [Available memory: 14.13 GiB physical, 33.75 GiB virtual] [CPU usage: 3.20%]
[ue4-docker build] [2022-02-28 14:58:24] [Available disk: 1017.12 GiB] [Available memory: 14.10 GiB physical, 33.73 GiB virtual] [CPU usage: 4.70%]
[ue4-docker build] [2022-02-28 14:58:44] [Available disk: 1017.12 GiB] [Available memory: 14.02 GiB physical, 33.64 GiB virtual] [CPU usage: 4.90%]
[ue4-docker build] [2022-02-28 14:59:04] [Available disk: 1017.09 GiB] [Available memory: 13.81 GiB physical, 33.47 GiB virtual] [CPU usage: 5.20%]
[ue4-docker build] [2022-02-28 14:59:24] [Available disk: 1017.09 GiB] [Available memory: 13.71 GiB physical, 33.36 GiB virtual] [CPU usage: 4.60%]
[ue4-docker build] [2022-02-28 14:59:44] [Available disk: 1017.06 GiB] [Available memory: 13.59 GiB physical, 33.27 GiB virtual] [CPU usage: 4.60%]
[ue4-docker build] [2022-02-28 15:00:04] [Available disk: 1017.06 GiB] [Available memory: 13.47 GiB physical, 33.16 GiB virtual] [CPU usage: 4.60%]
[ue4-docker build] [2022-02-28 15:00:24] [Available disk: 1017.02 GiB] [Available memory: 13.27 GiB physical, 33.02 GiB virtual] [CPU usage: 4.60%]
[ue4-docker build] [2022-02-28 15:00:44] [Available disk: 1017.02 GiB] [Available memory: 13.16 GiB physical, 32.88 GiB virtual] [CPU usage: 4.80%]
[ue4-docker build] [2022-02-28 15:01:04] [Available disk: 1016.99 GiB] [Available memory: 13.18 GiB physical, 32.89 GiB virtual] [CPU usage: 6.20%]
[ue4-docker build] [2022-02-28 15:01:24] [Available disk: 1016.99 GiB] [Available memory: 13.37 GiB physical, 33.06 GiB virtual] [CPU usage: 6.30%]
[ue4-docker build] [2022-02-28 15:01:44] [Available disk: 1016.99 GiB] [Available memory: 13.39 GiB physical, 33.07 GiB virtual] [CPU usage: 5.70%]
[ue4-docker build] [2022-02-28 15:02:04] [Available disk: 1016.96 GiB] [Available memory: 13.38 GiB physical, 33.08 GiB virtual] [CPU usage: 4.90%]
[ue4-docker build] [2022-02-28 15:02:24] [Available disk: 1016.96 GiB] [Available memory: 13.36 GiB physical, 33.07 GiB virtual] [CPU usage: 4.90%]
[ue4-docker build] [2022-02-28 15:02:44] [Available disk: 1016.93 GiB] [Available memory: 13.31 GiB physical, 33.04 GiB virtual] [CPU usage: 4.80%]
[ue4-docker build] [2022-02-28 15:03:04] [Available disk: 1016.93 GiB] [Available memory: 13.26 GiB physical, 32.99 GiB virtual] [CPU usage: 4.60%]
[ue4-docker build] [2022-02-28 15:03:24] [Available disk: 1016.90 GiB] [Available memory: 13.20 GiB physical, 33.01 GiB virtual] [CPU usage: 4.60%]
[ue4-docker build] [2022-02-28 15:03:44] [Available disk: 1016.87 GiB] [Available memory: 13.02 GiB physical, 32.86 GiB virtual] [CPU usage: 4.80%]
[ue4-docker build] [2022-02-28 15:04:04] [Available disk: 1016.87 GiB] [Available memory: 12.85 GiB physical, 32.70 GiB virtual] [CPU usage: 4.50%]
[ue4-docker build] [2022-02-28 15:04:24] [Available disk: 1015.99 GiB] [Available memory: 12.26 GiB physical, 32.52 GiB virtual] [CPU usage: 6.70%]
[ue4-docker build] [2022-02-28 15:04:44] [Available disk: 1014.21 GiB] [Available memory: 11.33 GiB physical, 32.53 GiB virtual] [CPU usage: 5.10%]
[ue4-docker build] [2022-02-28 15:05:04] [Available disk: 1012.68 GiB] [Available memory: 12.03 GiB physical, 32.27 GiB virtual] [CPU usage: 8.00%]
[ue4-docker build] [2022-02-28 15:05:24] [Available disk: 1011.74 GiB] [Available memory: 11.66 GiB physical, 32.17 GiB virtual] [CPU usage: 8.20%]
[ue4-docker build] [2022-02-28 15:05:44] [Available disk: 1010.30 GiB] [Available memory: 11.49 GiB physical, 32.11 GiB virtual] [CPU usage: 5.80%]
[ue4-docker build] [2022-02-28 15:06:04] [Available disk: 1008.99 GiB] [Available memory: 11.18 GiB physical, 32.04 GiB virtual] [CPU usage: 6.60%]
[ue4-docker build] [2022-02-28 15:06:24] [Available disk: 1007.36 GiB] [Available memory: 11.14 GiB physical, 32.00 GiB virtual] [CPU usage: 5.50%]
[ue4-docker build] [2022-02-28 15:06:44] [Available disk: 1006.08 GiB] [Available memory: 11.36 GiB physical, 31.88 GiB virtual] [CPU usage: 7.30%]
[ue4-docker build] [2022-02-28 15:07:04] [Available disk: 1005.18 GiB] [Available memory: 11.18 GiB physical, 31.83 GiB virtual] [CPU usage: 6.80%]
[ue4-docker build] [2022-02-28 15:07:24] [Available disk: 1004.05 GiB] [Available memory: 11.15 GiB physical, 31.71 GiB virtual] [CPU usage: 8.30%]
[ue4-docker build] [2022-02-28 15:07:44] [Available disk: 1001.61 GiB] [Available memory: 10.16 GiB physical, 31.72 GiB virtual] [CPU usage: 5.20%]
[ue4-docker build] [2022-02-28 15:08:04] [Available disk: 999.30 GiB] [Available memory: 10.71 GiB physical, 31.68 GiB virtual] [CPU usage: 6.50%]
[ue4-docker build] [2022-02-28 15:08:24] [Available disk: 1016.87 GiB] [Available memory: 11.72 GiB physical, 31.64 GiB virtual] [CPU usage: 6.30%]
failed to copy files: failed to copy directory: write \\?\Volume{548e5305-98c7-11ec-8522-b1f9a761ed0e}\UnrealEngine\Engine\Plugins\Experimental\PythonFoundationPackages\Content\Python\Lib\Win64\site-packages\torch\lib\cusolver64_11.dll: There is not enough space on the disk.
[ue4-docker build] Error: failed to build image "adamrehn/ue4-minimal:5.0.0-preview-1-ltsc2019-vs2019".
PS C:\Users\Administrator>

[TBBle]

This failed on COPY, so I would guess it's the 20GB limit on that, as described in #99 (comment).

From the monitoring output, the COPY had used up at least 18GB before failing, so I assume that the issue is that even with debug and templates excluded, the build in UE5 is now larger than 20GB, and we so we need explore a new workaround, e.g., something like #99 (comment), until Docker 21.xx (with the fix) becomes an option.

You can probably check this by running a container with the intermediate image (2d3a76c29479 in the logs here) and checking how big C:\UnrealEngine\LocalBuilds\Engine\Windows is, i.e. something like

docker run --rm -it 2d3a76c29479 PowerShell /C "Get-ChildItem C:\UnrealEngine\LocalBuilds\Engine\Windows | Measure-Object -Property Length -sum"

(I haven't tested that command-line, so you may need to fiddle with it a bit)

In the meantime, if you're in a position to upgrade your Docker daemon to, e.g. windows/x86_64/dockerd.exe from https://master.dockerproject.org/, that should avoid this issue. It's only a problem when building the image, so you don't need to do this on machines where you merely use the image.

[slonopotamus]

Confirming, I also hit this issue with 5.0.0-preview-1.

Duplicate of #99.

[CanisHelix]

@TBBle I can confirm the updated dockerd.exe from https://master.dockerproject.org/ worked in order to build the preview.