Support Docker v25 for remote image caching

[JacobEvelyn]

Is your feature request related to a problem? Please describe.
We use Buildkite to push docker images to AWS ECR (using https://github.com/buildkite-plugins/ecr-buildkite-plugin) and would like to be able to do something like this to take advantage of remote caching and minimize docker build times. My understanding is that this is available in docker v25.0, but when I try those changes with v6.14.0 of this stack I get:

ERROR: Cache export is not supported for the docker driver.
Switch to a different driver, or turn on the containerd image store, and try again.
Learn more at https://docs.docker.com/go/build-cache-backends/

Describe the solution you'd like
I'd like to be able to use this feature to speed up our Buildkite builds! My hope is all that's required is a bump to Docker v25.0+.

Describe alternatives you've considered
I've tried searching the Buildkite plugin ecosystem for similar functionality. This feature seems to be available with https://github.com/buildkite-plugins/docker-compose-buildkite-plugin but I'd like to be able to use it with native docker, not docker compose. I also found https://github.com/seek-oss/docker-ecr-cache-buildkite-plugin but don't understand why this should require a third-party plugin.

Additional context
I couldn't find a lot of documentation on this so it's very possible I simply misconfigured something!

[triarius]

Hi @JacobEvelyn we follow the version of Docker in the base Amazon Linux AMI. The latest elastic stack (v6.14.0) is based off Amazon Linux 2023.3.20240122.0, which appears to be the latest version at the time of writing.

I've raised an issue in the Amazon Linux repository, so we should be able to update to the latest version of Amazon Linux when they release it.

As for the remote caching, maybe you might have some luck using the other tool mentioned in the announcement, finch. You should be able to install it in a Bootstrap script, which you can upload to S3 and point the BootstrapScriptUrl parameter at.

[JacobEvelyn]

Hi @triarius ! It looks like the other issue you raised is resolved—is there a timeline for when this stack might be updated to take advantage of that update?

[triarius]

Stacks launched from the main template will have v25 now. We are working on releasing it soon.

[triarius]

@JacobEvelyn v6.17.0 is out and should have Docker 25 in it.