Build CLI for arm64 Linux (and Alpine)

[Steven Gagniere (sgagniere)]

Checklist

1. [CRUCIAL] Is the change for CP or CCloud functionalities that are already live in prod?
   • yes: ok

What

Modified the build and release scripts + makefiles to support Linux (using glibc) and Alpine (using musl libc) arm64 versions.

• Alpine arm64 can now be built using: GOOS=linux GOARCH=arm64 make cross-build.
  • The appropriate cross-compile toolchain must be installed first: brew install filosottile/musl-cross/musl-cross --with-aarch64 (or reinstall if you've already installed the non-aarch64 version; this command installs both)
• Linux (glibc) arm64 is built in a docker container with an image stored in a prod ECR repo.
• Since the new version v1.9.3-RC3 of confluent-kafka-go already contains all library files that we need, the make targets switch-librdkafka-arm64 and restore-librdkafka-amd64 have been removed.

References

https://confluentinc.atlassian.net/browse/INIT-1251

Test & Review

• Checked that the following (cross-)builds work:
  • make
  • GOARCH=arm64 make cross-build
  • GOOS=linux make cross-build
  • GOOS=linux GOARCH=arm64 make cross-build
  • GOOS=windows make cross-build
• Built both of the glibc linux versions using an updated build_linux_glibc.sh script.
• Ran confluent kafka topic produce and confluent kafka topic consume commands in CentOS and Alpine arm64 image to test the new supported versions.

[MuweiHe]

https://confluentinc.atlassian.net/wiki/spaces/Foundations/pages/2610299218/How+to+Build+the+CLI+with+confluent-kafka-go+for+All+Platforms
let's update this one pager after merging this one!

[Brian Strauch (brianstrauch)]

Do these changes still make the release significantly slower? If yes, about how much?

[Steven Gagniere (sgagniere)]

Do these changes still make the release significantly slower? If yes, about how much?

Nope. Aside from the unavoidable slowness of having to upload and release 2 additional binaries, compiling linux glibc arm64 version is now down to about the same time as the rest (so anywhere from a few seconds to a minute depending on your luck), down from 12+ minutes in the last iteration.

[Brian Strauch (brianstrauch)]

Do you mind explaining why this was changed?

[Steven Gagniere (sgagniere)]

Originally I did this because I had issues getting my github credentials to work on the arm64 image, but I went back and updated this amd64 file too because it feels slightly cleaner.

This way, we download all the dependencies before we copy into the image instead of downloading them in the image, and that way we don't need to copy our netrc into the cli directory and into the image.