Reduce memory footprint of build

[tgraf]

The build currently requires between 3-4GB of memory which is completely insane.

[aanm]

What is the OS?
I'm able to build in our vagrant box with 2GB (1GB Free):

vagrant@cilium-k8s-master:~/go/src/github.com/cilium/cilium$ make clean
...
vagrant@cilium-k8s-master:~/go/src/github.com/cilium/cilium$ free -m
              total        used        free      shared  buff/cache   available
Mem:           2000         613         947          24         438        1163
Swap:             0           0           0
vagrant@cilium-k8s-master:~/go/src/github.com/cilium/cilium$ make
if [ "go1.7.4" = "go1.8" ]; then \
        echo "golang 1.8 is currently not supported, please downgrade to a lower version"; \
        exit 1; \
fi
make[1]: Entering directory '/home/vagrant/go/src/github.com/cilium/cilium/plugins'
make[2]: Entering directory '/home/vagrant/go/src/github.com/cilium/cilium/plugins/cilium-docker'
go build  -ldflags "-X "github.com/cilium/cilium/common".Version=0.1.0.dev" -o cilium-docker
make[2]: Leaving directory '/home/vagrant/go/src/github.com/cilium/cilium/plugins/cilium-docker'
make[2]: Entering directory '/home/vagrant/go/src/github.com/cilium/cilium/plugins/cilium-cni'
go build  -o cilium-cni ./cilium-cni.go
make[2]: Leaving directory '/home/vagrant/go/src/github.com/cilium/cilium/plugins/cilium-cni'
make[1]: Leaving directory '/home/vagrant/go/src/github.com/cilium/cilium/plugins'
make[1]: Entering directory '/home/vagrant/go/src/github.com/cilium/cilium/bpf'
clang -Iinclude -D__NR_CPUS__=2 -O2 -target bpf -I. -Wall -Werror -Wno-address-of-packed-member -Wno-unknown-warning-option -c bpf_lxc.c -o bpf_lxc.o
clang -Iinclude -D__NR_CPUS__=2 -O2 -target bpf -I. -Wall -Werror -Wno-address-of-packed-member -Wno-unknown-warning-option -c bpf_netdev.c -o bpf_netdev.o
clang -Iinclude -D__NR_CPUS__=2 -O2 -target bpf -I. -Wall -Werror -Wno-address-of-packed-member -Wno-unknown-warning-option -c bpf_overlay.c -o bpf_overlay.o
clang -DLB_L3 -Iinclude -D__NR_CPUS__=2 -O2 -target bpf -I. -Wall -Werror -Wno-address-of-packed-member -Wno-unknown-warning-option -c bpf_lb.c -o bpf_lb.o;  clang -DLB_L4 -Iinclude -D__NR_CPUS__=2 -O2 -target bpf -I. -Wall -Werror -Wno-address-of-packed-member -Wno-unknown-warning-option -c bpf_lb.c -o bpf_lb.o;  clang -DLB_L3 -Iinclude -D__NR_CPUS__=2 -O2 -target bpf -I. -Wall -Werror -Wno-address-of-packed-member -Wno-unknown-warning-option -c bpf_lb.c -o bpf_lb.o;  clang -DLB_L4 -Iinclude -D__NR_CPUS__=2 -O2 -target bpf -I. -Wall -Werror -Wno-address-of-packed-member -Wno-unknown-warning-option -c bpf_lb.c -o bpf_lb.o;
make[1]: Leaving directory '/home/vagrant/go/src/github.com/cilium/cilium/bpf'
make[1]: Entering directory '/home/vagrant/go/src/github.com/cilium/cilium/cilium'
go build  -ldflags "-X "github.com/cilium/cilium/common".Version=0.1.0.dev" -o cilium
make[1]: Leaving directory '/home/vagrant/go/src/github.com/cilium/cilium/cilium'
make[1]: Entering directory '/home/vagrant/go/src/github.com/cilium/cilium/daemon'
go build  -ldflags "-X "github.com/cilium/cilium/common".Version=0.1.0.dev" -o cilium-agent
make[1]: Leaving directory '/home/vagrant/go/src/github.com/cilium/cilium/daemon'
vagrant@cilium-k8s-master:~/go/src/github.com/cilium/cilium$ free -m
              total        used        free      shared  buff/cache   available
Mem:           2000         612         916          24         470        1164
Swap:             0           0           0

[tgraf]

I'm using go version go1.7.5 linux/amd64 on FC25. The build only quickly peaks at using > 2G mem when linking cilium-agent. Running free -m afterwards will not show the real footprint. I'm sometimes crossing 3G limit when building with the vulcand dependencies for the HTTP stuff.

[tgraf]

Based on some research, one of the main reasons is the linking to the kubernetes go-client which pulls in a huge dependency chain.

[tgraf]

This is no longer a big issue, closing.