Backend
VL (Velox)
Bug description
It's probably the cached images layers are out-of-date.
We'd improve the dockerfile to make it more stable for environment changes.
Spark version
None
Spark configurations
No response
System information
No response
Relevant logs
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 DONE 0.0s
#2 [internal] load build definition from dockerfile-buildenv
#2 transferring dockerfile: 5.93kB done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/ubuntu:20.04
#3 DONE 5.1s
#4 [internal] load build context
#4 transferring context: 1.89kB done
#4 DONE 0.0s
#5 [ 1/36] FROM docker.io/library/ubuntu:20.04@sha256:33a5cc25d22c45900796a1aca487ad7a7cb09f09ea00b779e3b2026b4fc2faba
#5 resolve docker.io/library/ubuntu:20.04@sha256:33a5cc25d22c45900796a1aca487ad7a7cb09f09ea00b779e3b2026b4fc2faba done
#5 sha256:33a5cc25d22c45900796a1aca487ad7a7cb09f09ea00b779e3b2026b4fc2faba 1.13kB / 1.13kB done
#5 sha256:324[65](https://github.com/oap-project/gluten/actions/runs/5900463328/job/16052636199?pr=2802#step:3:66)18d9735254519e1b2ff35f95686e4a5011c90c85344c1f38df7bae9dd37 424B / 424B done
#5 sha256:6df89402372646d400cf092016c280[66](https://github.com/oap-project/gluten/actions/runs/5900463328/job/16052636199?pr=2802#step:3:67)391a26f5d46c00b1153e75003465484d 2.30kB / 2.30kB done
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f[68](https://github.com/oap-project/gluten/actions/runs/5900463328/job/16052636199?pr=2802#step:3:69) 0B / 27.51MB 0.1s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 2.10MB / 27.51MB 1.9s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 5.24MB / 27.51MB 2.2s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 8.39MB / 27.51MB 2.4s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 10.49MB / 27.51MB 2.5s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 13.63MB / 27.51MB 2.7s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 15.73MB / 27.51MB 2.9s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 18.87MB / 27.51MB 3.1s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 20.97MB / 27.51MB 3.3s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 24.12MB / 27.51MB 3.5s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 26.21MB / 27.51MB 3.7s
#5 sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 27.51MB / 27.51MB 3.9s done
#5 extracting sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 0.1s
#5 extracting sha256:edaedc954fb53f42a7754a6e2d1b57f091bc9b11063bc445c2e325ea448f8f68 1.4s done
#5 ERROR: failed to register layer: rename /docker_data_root/docker/image/overlay2/layerdb/tmp/write-set-224[70](https://github.com/oap-project/gluten/actions/runs/5900463328/job/16052636199?pr=2802#step:3:71)06164 /docker_data_root/docker/image/overlay2/layerdb/sha256/954c82bdeb5fcc80094317528fa3fcbb1026aeff64f8[72](https://github.com/oap-project/gluten/actions/runs/5900463328/job/16052636199?pr=2802#step:3:73)527d35ec9b4343b84d: file exists
------
> [ 1/36] FROM docker.io/library/ubuntu:20.04@sha256:33a5cc25d22c45900796a1aca487ad7a7cb09f09ea00b779e3b2026b4fc2faba:
------
dockerfile-buildenv:3
--------------------
1 | ARG OS_IMAGE
2 |
3 | >>> FROM $OS_IMAGE AS gluten-buildenv
4 | MAINTAINER Hongze Zhang<hongze.zhang@intel.com>
5 |
--------------------
ERROR: failed to solve: failed to register layer: rename /docker_data_root/docker/image/overlay2/layerdb/tmp/write-set-2247006164 /docker_data_root/docker/image/overlay2/layerdb/sha256/954c82bdeb5fcc8009431[75](https://github.com/oap-project/gluten/actions/runs/5900463328/job/16052636199?pr=2802#step:3:76)28fa3fcbb1026aeff64f872527d35ec9b4343b[84](https://github.com/oap-project/gluten/actions/runs/5900463328/job/16052636199?pr=2802#step:3:85)d: file exists
Error: Process completed with exit code 1.
Backend
VL (Velox)
Bug description
It's probably the cached images layers are out-of-date.
We'd improve the dockerfile to make it more stable for environment changes.
Spark version
None
Spark configurations
No response
System information
No response
Relevant logs