Reorganize Makefile to build ARM binaries for ddev and stop using build-tools, fixes #2507, for #2338, fixes #2322

[rfay]

The Problem/Issue/Bug:

This builds linux_amd64, linux_arm, windows_arm.

We can't build darwin_arm64 yet, and windows_arm64 is not on the tool list. (go tool dist list)

See checklist in #2507

How this PR Solves The Problem:

Manual Testing Instructions:

Automated Testing Overview:

Related Issue Link(s):

Release/Deployment notes:

[rfay]

Artifacts from first successful build are at https://app.circleci.com/pipelines/github/drud/ddev/2658/workflows/787666d9-925e-45a0-b8ff-e0897de7a97b/jobs/27164/artifacts

[rfay]

Probably the best path forward for now, especially this week is to manually build versions of this. You can set the images+tags used in pkg/version/version.go, and that's the only way to change ddev-ssh-agent and ddev-router.

https://github.com/drud/ddev/blob/6f01a2d65449da1fedc37aeb4cdc52c547c57419/pkg/version/version.go#L47-L70

Build ddev binaries with make linux_arm64 or make windows_arm (windows/arm64 is not supported by the golang toolchain at this point, not sure why).

[rfay]

I updated this to temporarily use @dennisameling 's images in version.go, so it will start to work (without db container at this point).

Artifacts are at https://app.circleci.com/pipelines/github/drud/ddev/2683/workflows/ce711e0e-e277-41d0-ac43-ba94bc27216e/jobs/27268/artifacts

[rfay]

https://twitter.com/randyfay/status/1300570109166010368 - It's WORKING!

[rfay]

@dennisameling one thing I note that I hope won't discourage you. windows/arm64 is not listed as a target in go tool dist list, although windows/arm is there. Compiling for windows/arm isn't hard, but results in 32-bit AFAICT, see https://medium.com/@tux0010/compile-golang-for-arm64-on-an-arm64-machine-7a86c133430e

Also, https://build.golang.org/ does not show windows/arm as a currently built version. golang/go#26148 (comment) questions whether it has been abandoned, with no response.

Important resources for building:

• gist with variety of build options
• go tool dist list
• golang Port to windows/arm64 issue
• Use of GOARM to target various ARM families (more complexity!) (It looks like GOARM is only necessary where GOARCH=arm (32-bit) so if we stick with arm64, it's not relevant. windows/arm is explicitly not listed as supported here)

[dennisameling]

@rfay I don't think a DDEV executable for Windows arm64 should be a priority right now, as I expect most users to be working in WSL2 which uses arm64 Linux executables anyway. Windows arm64 can also run 32-bit applications, so if we could somehow get a x86 or ARM32 executable, that'd suffice for now :)

[rfay]

Ah, glad to hear it! Thanks @dennisameling

[rfay]

@dennisameling I think all the boxes are checked now. In some ways it's better than it's ever been, but in other ways it has so far to go.

[dennisameling]

I have the feeling that windows-arm won't work (at least it didn't work with mkcert, application crashed). Could we do windows-386 (32-bit) for the time being until go supports arm64? 32-bit works through emulation on Windows arm64 :)

[dennisameling]

windows-arm is not part of the 1.4.4 release: https://github.com/drud/mkcert/releases. I tried with windows-arm but it doesn't seem to work on arm64. i386 (32-bit) does work however (32-bit emulation on arm64). So please:

• Update mkcert version to v1.4.6 (just released)
• use -windows-386.exe on windows-arm :)

[rfay]

So you want windows/386 (See go tool dist list) ? I wonder if that will work without building 32-bit versions of the images? It may not be worth fighting this, of course. I was hoping that the windows-arm would work on your machine.

I agree about pull windows/arm out of there. But do you think it's useful to have windows/i386?

[dennisameling]

That would be windows/386 indeed. Thing is, Windows arm64 doesn't even have the ability to run Docker Desktop (docker/roadmap#91), so it's actually a waste of effort for now. Users of Windows arm64 will need to be doing everything from within WSL2, so they'll be using DDEV Linux arm64 binaries in that case. Let's just remove windows_arm and reconsider in a few months 👍

[rfay]

Oh, I guess I didn't understand how you're running docker on your surface device. You must be running Linux docker inside WSL2?

I've removed windows/arm

[dennisameling]

Yes, correct :) no other way to run Docker currently on arm64 Windows devices 😊

[rfay]

I sure hear another blog post coming! :)

[dennisameling]

Haha, so much to blog about after this whole experience! Def will write something soon 🚀

[rfay]

We may want to collaborate on a single blog that explains windows/arm64, linux/arm64, raspberry pi/arm64, raspberry pi/arm. /cc @ekl1773

[dennisameling]

Yes sounds good!

[rfay]

Doggone it @dennisameling I just now discovered that the library/mariadb upstream images have no arm/v7 builds.

[dennisameling]

That's a shame regarding MariaDB :( hope they'll add such image soon!