DDEV in CI broken in DDEV-1.24.8+

[ergonlogic]

Preliminary checklist

• I am using the latest stable version of DDEV (see upgrade guide)
• I have searched existing issues
• I have checked the troubleshooting guide
• I have run ddev utility test or at least ddev utility diagnose to include output below

Output of ddev utility test or ddev utility diagnose

Expand `ddev utility test` diagnostic information

Docker error: Error response from daemon: Client sent an HTTP request to an HTTPS server.

Expected Behavior

First off, thank you for all of your efforts. DDEV is amazing, and we rely on it across many projects.

In some more complex projects (eg. Rugged TUF Server) we use DDEV inside of our Gitlab CI, using Docker-in-Docker (dind). This has worked very well for us for several years.

Actual Behavior

However, starting with 1.24.8, DDEV no longer works in a Gitlab CI environment. Instead, we get:

Docker error: Error response from daemon: Client sent an HTTP request to an HTTPS server.

This same behaviour can be observed with 1.24.10 and 1.25.0, as well.

Steps To Reproduce

To demonstrate this regression, I put together a minimalist project. It shows that dind works fine with DDEV 1.24.7, but fails on 1.24.8+.

Specific instructions can be found in the README.

Anything else?

FWIW, it looks like some major refactoring of how Docker gets called in DDEV happended in #7587 , which I believe landed in 1.24.8.

[rfay]

Thanks for the effort to pin it down with a demo project, that's so helpful!

Please improve the README of the project explaining how to manually demonstrate the problem.

We don't use Gitlab and don't have a lot of experience with it.

But lots of people are using https://github.com/ddev/ddev-gitlab-ci successfully. Could you please see if that solves your problem?

[rfay]

I removed the "Regression" from the title because DDEV never claimed to support Gitlab CI and doesn't have related automated tests. A significant PR to add automated tests and arrange Gitlab infrastructure would be welcome, but I think it would be a heavy lift.

[stasadev]

Thank you very much @ergonlogic, it was so easy to recreate and test the fix:

• fix(docker): handle TLS, improve ddev utility dockercheck, fixes #8111 #8115

[ergonlogic]

lots of people are using https://github.com/ddev/ddev-gitlab-ci successfully. Could you please see if that solves your problem?

Thanks for pointing out that project. It works around the issue by calling Docker-in-Docker without TLS. However, this is insecure and deprecated. We tested using the image from ddev-gitlab-ci with TLS, and see the same failure.

A significant PR to add automated tests and arrange Gitlab infrastructure would be welcome, but I think it would be a heavy lift.

I think this could be accomplished by (roughly):

1. Creating mirrors of ddev/ddev and ddev/ddev-gitlab-ci on gitlab.com
2. Adding a .gitlab-ci.yml to ddev/ddev-gitlab-ci that runs tests similar to what we posted in ddev-in-ci
3. Configuring CI in the mirror of ddev/ddev-gitlab-ci to subscribe to tags in ddev/ddev

We're relying on this functionality quite a bit. So we'd be happy to undertake that, if you agree that it'd be worthwhile.