Skip to content

cmd/compile: too many open files #21621

@caglar10ur

Description

@caglar10ur

What version of Go are you using (go version)?

1.9

Does this issue reproduce with the latest release?

Yes

What operating system and processor architecture are you using (go env)?

GOARCH="amd64"
GOBIN=""
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="/opt/go"
GORACE=""
GOROOT="/usr/local/go"
GOTOOLDIR="/usr/local/go/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build185756508=/tmp/go-build -gno-record-gcc-switches"
CXX="g++"
CGO_ENABLED="1"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"

What did you do?

  • clone github.com/caglar10ur/vic
  • since the original repository is under vmware org., rename the parent directory as vmware (mv $GOPATH/src/github.com/caglar10ur $GOPATH/src/github.com/vmware)
  • switch to go19 branch
  • run sudo -E make docker-engine-api

Please note the make target install swagger binary on your $GOPATH/bin so if you don't want that please use a vm/container or a temporary GOPATH

What did you expect to see?

No errors

What did you see instead?

Build fails with "too many open files", system uses default limits provided by ubuntu 16.04.

Our build step contains huge number of autogenerated files. Example; https://10ur.org/golang19.txt

[vagrant@devbox:/opt/go/src/github.com/vmware/vic(go19)] sudo -E make docker-engine-api
Generating dependency set for cmd/imagec/
Generating dependency set for cmd/vic-machine/
Generating dependency set for cmd/vicadmin/
Generating dependency set for cmd/port-layer-server/
Generating dependency set for cmd/vic-dns/
Generating dependency set for cmd/tether/
Generating dependency set for cmd/vic-ui/
Generating dependency set for cmd/docker/
Generating dependency set for cmd/vic-init/
Generating dependency set for cmd/rpctool/
Generating dependency set for cmd/gandalf/
regenerating swagger models and operations for Portlayer API client...
done regenerating swagger models and operations for Portlayer API client...
regenerating swagger models and operations for Admiral API client...
done regenerating swagger models and operations for Admiral API client...
Building docker-engine-api server...
# github.com/vmware/vic/lib/config/dynamic/admiral/client/operations
lib/config/dynamic/admiral/client/operations/patch_resources_container_control_loop_id_parameters.go:0:0: open lib/config/dynamic/admiral/client/operations/patch_resources_container_control_loop_id_parameters.go: too many open files
Makefile:316: recipe for target 'bin/docker-engine-server' failed
make: *** [bin/docker-engine-server] Error 2

[vagrant@devbox:/opt/go/src/github.com/vmware/vic(go19)] ulimit -n
1024

Bumping the number of open files limit to 2048 makes error go away.

[vagrant@devbox:/opt/go/src/github.com/vmware/vic(go19)] ulimit -n 2048

[vagrant@devbox:/opt/go/src/github.com/vmware/vic(go19)] ulimit -n
2048
[vagrant@devbox:/opt/go/src/github.com/vmware/vic(go19)] sudo -E make docker-engine-api
Generating dependency set for cmd/imagec/
Generating dependency set for cmd/vic-machine/
Generating dependency set for cmd/vicadmin/
Generating dependency set for cmd/port-layer-server/
Generating dependency set for cmd/vic-dns/
Generating dependency set for cmd/tether/
Generating dependency set for cmd/vic-ui/
Generating dependency set for cmd/docker/
Generating dependency set for cmd/vic-init/
Generating dependency set for cmd/rpctool/
Generating dependency set for cmd/gandalf/
regenerating swagger models and operations for Portlayer API client...
done regenerating swagger models and operations for Portlayer API client...
regenerating swagger models and operations for Admiral API client...
done regenerating swagger models and operations for Admiral API client...
Building docker-engine-api server...
[vagrant@devbox:/opt/go/src/github.com/vmware/vic(go19)]

It works fine with go1.8

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions