Skip to content

Files

Latest commit

21e9e96 · Mar 9, 2022

History

History
This branch is 323 commits behind moby/buildkit:master.

consistenthash

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Oct 16, 2019
Mar 9, 2022
Oct 16, 2019

Distributed Build with Consistent Hashing

Demo for efficiently using BuildKit daemon-local cache with multi-node cluster

Deploy

$ kubectl apply -f ../statefulset.rootless.yaml
$ kubectl scale --replicas=10 statefulset/buildkitd

Consistent hashing

Define the key string for consistent hashing.

For example, the key can be defined as <REPO NAME>:<CONTEXT PATH>, e.g. github.com/example/project:some/directory.

Then determine the pod that corresponds to the key:

$ go build -o consistenthash .
$ pod=$(./show-running-pods.sh | consistenthash $key)

You can connect to the pod using export BUILDKIT_HOST=kube-pod://$pod.