As agreed with @dmitshur and Michael K, add GOMAXPROCS to try reducing the load average on the builder machine.