Virtual memory exhausted building in docker - update instructions?

[alexanderkjeldaas]

There might be some docker-tuning that needs to be mentioned in README.md.

        ... 179 more jobs
____[1,760 / 2,373] Compiling tensorflow/core/kernels/matching_files_op.cc
ERROR: /tensorflow/tensorflow/core/kernels/BUILD:76:1: C++ compilation of rule '//tensorflow/core/kernels:strided_slice_op' failed: gcc failed: error executing command /usr/bin/gcc -U_FORTIFY_SOURCE '-D_FORTIFY_SOURCE=1' -fstack-protector -Wall -Wl,-z,-relro,-z,now -B/usr/bin -B/usr/bin -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-canonical-system-headers ... (remaining 106 argument(s) skipped): com.google.devtools.build.lib.shell.BadExitStatusException: Process exited with status 1.
virtual memory exhausted: Cannot allocate memory
____Building complete.
Target //tensorflow:libtensorflow_c.so failed to build
Use --verbose_failures to see the command lines of failed build steps.
____Elapsed time: 974.415s, Critical Path: 907.05s

[alexanderkjeldaas]

Average server with 16G memory.

[irhawks]

Hi, I met the same problem in compiling TensorFlow in docker environment and I solved this with

bazel --batch build -c opt '//tensorflow:libtensorflow_c.so' --jobs=1

All in one, adding --jobs=1 (bazel's default is 200) when invoking bazel. (in docker/Dockerfile)

[mikeronayne]

@irhawks

Hi, I met the same problem in compiling TensorFlow in docker environment and I solved this with

bazel --batch build -c opt '//tensorflow:libtensorflow_c.so' --jobs=1
All in one, adding --jobs=1 (bazel's default is 200) when invoking bazel. (in docker/Dockerfile)

Hi, I also exhausted my virtual memory when trying to install SyntaxNet from this Dockerfile using the Docker Toolbox. I received this message when compiling the Dockerfile:

ERROR: /root/.cache/bazel/_bazel_root/5b21cea144c0077ae150bf0330ff61a0/external/org_tensorflow/tensorflow/core/kernels/BUILD:1921:1: C++ compilation of rule '@org_tensorflow//tensorflow/core/kernels:svd_op' failed: gcc failed: error executing command /usr/bin/gcc -U_FORTIFY_SOURCE '-D_FORTIFY_SOURCE=1' -fstack-protector -Wall -Wl,-z,-relro,-z,now -B/usr/bin -B/usr/bin -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-canonical-system-headers ... (remaining 115 argument(s) skipped): com.google.devtools.build.lib.shell.BadExitStatusException: Process exited with status 1. virtual memory exhausted: Cannot allocate memory ____Building complete. ____Elapsed time: 8548.364s, Critical Path: 8051.91s

Where should I be changing Bazel's default jobs limit?

[blackgnezdo]

Could you file an issue in tensorflow/models? I think it is unrelated to the issue people observed with building Haskell bindings.

…

On Mon, Feb 27, 2017, 10:14 mikeronayne ***@***.***> wrote: Hi, I also exhausted my virtual memory when trying to install SyntaxNet <https://github.com/tensorflow/models/tree/master/syntaxnet> from this Dockerfile <https://github.com/tensorflow/models/blob/master/syntaxnet/Dockerfile> using the Docker Toolbox. I received this message when compiling the Dockerfile: ERROR: /root/.cache/bazel/_bazel_root/5b21cea144c0077ae150bf0330ff61a0/external/org_tensorflow/tensorflow/core/kernels/BUILD:1921:1: C++ compilation of rule ***@***.***_tensorflow//tensorflow/core/kernels:svd_op' failed: gcc failed: error executing command /usr/bin/gcc -U_FORTIFY_SOURCE '-D_FORTIFY_SOURCE=1' -fstack-protector -Wall -Wl,-z,-relro,-z,now -B/usr/bin -B/usr/bin -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-canonical-system-headers ... (remaining 115 argument(s) skipped): com.google.devtools.build.lib.shell.BadExitStatusException: Process exited with status 1. virtual memory exhausted: Cannot allocate memory ____Building complete. ____Elapsed time: 8548.364s, Critical Path: 8051.91s Where should I be changing Bazel's default jobs limit? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#54 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AIXNMnuXUGTqtEYqVdZk1MvSrAHaWe9tks5rgxKXgaJpZM4LVCu8> .

[akkiagrawal94]

Hi I tried to install tensor flow serving using docker
After running this bazel build -c opt tensorflow_serving/... got an error

Please help me out with this

[blackgnezdo]

You should ask for help on this in tensorflow/serving.