Error: build failed: cannot check base image exists

[jgallucci32]

Describe the bug

When using a Dockerfile in your .gitpod.yml configuration while Gitpod is configured for an external Docker registry the following error appears:

Error: build failed: rpc error: code = Internal desc = cannot check base image exists: Error response from daemon: errors: denied: requested access to the resource is denied unauthorized: authentication required

This issue occurs if the custom Docker registry does not have the repositories workspace-images and base-images created prior. This was tested against Docker Trusted Registry specifically.

Steps to reproduce

1. Deploy Gitpod self-hosted and configure for external Docker registry as follows:

  components:
    imageBuilder:
      registryCerts: []
      registry:
        name: registry.domain.local/gitpod
        secretName: external-registry-auth

2. Launch Gitpod workspace

Expected behavior

Workspace is expected to build the image and launch the workspace.

Additional information

Red Hat Enterprise Linux 7.8
Docker CE 19.03.13
Gitpod 0.5.0

Fix

Create the workspace-images and base-images repositories in Docker Trusted Registry

Recommendation

Add this to the documentation as a dependency for external registries.

[jgallucci32]

In case these are needed, here are the detailed logs from the image-builder pod:

{"buildRef":"registry.domain.local/gitpod/workspace-images:916dd604bdd22241ddfb4f465acc7521f0ad0e96602ff6b93780626502f1e5b2","message":"registering build","serviceContext":{"service":"image-builder","version":""},"severity":"info","time":"2020-10-22T17:07:02Z"}
{"buildRef":"registry.domain.local/gitpod/workspace-images:916dd604bdd22241ddfb4f465acc7521f0ad0e96602ff6b93780626502f1e5b2","message":"started listening to build logs","serviceContext":{"service":"image-builder","version":""},"severity":"info","time":"2020-10-22T17:07:02Z"}
{"baserefstr":"registry.domain.local/gitpod/base-images:efbd684c36732546cf58d15772f7c9c4f45bc2480324081d4c238ad6e6eefb57","buildRef":"registry.domain.local/gitpod/workspace-images:916dd604bdd22241ddfb4f465acc7521f0ad0e96602ff6b93780626502f1e5b2","message":"checking if base image exists","serviceContext":{"service":"image-builder","version":""},"severity":"debug","time":"2020-10-22T17:07:02Z"}
{"@type":"type.googleapis.com/google.devtools.clouderrorreporting.v1beta1.ReportedErrorEvent","buildRef":"registry.domain.local/gitpod/workspace-images:916dd604bdd22241ddfb4f465acc7521f0ad0e96602ff6b93780626502f1e5b2","error":"rpc error: code = Internal desc = cannot check base image exists: Error response from daemon: errors:
denied: requested access to the resource is denied
unauthorized: authentication required","message":"build failed","serviceContext":{"service":"image-builder","version":""},"severity":"warning","time":"2020-10-22T17:07:02Z"}
{"buildRef":"registry.domain.local/gitpod/workspace-images:916dd604bdd22241ddfb4f465acc7521f0ad0e96602ff6b93780626502f1e5b2","message":"deregistering build","serviceContext":{"service":"image-builder","version":""},"severity":"info","status":"done_failure","time":"2020-10-22T17:07:02Z"}
{"message":"build was closed but not successful","serviceContext":{"service":"image-builder","version":""},"severity":"info","status":3,"time":"2020-10-22T17:07:02Z"}
{"message":"closing build listener","serviceContext":{"service":"image-builder","version":""},"severity":"debug","time":"2020-10-22T17:07:02Z"}

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.