Errors_impl - NotFoundError - stringpiece

[MircoT]

What related GitHub issues or StackOverflow threads have you found by searching the web for your problem?

None.

Environment info

Operating System: Ubuntu 16.04.1 LTS

Installed version of CUDA and cuDNN: None

Binary pip package info:

1. A link to the pip package you installed: https://storage.googleapis.com/tensorflow/linux/cpu/tensorflow-0.12.0rc0-cp35-cp35m-linux_x86_64.whl
2. The output from python -c "import tensorflow; print(tensorflow.__version__)": 0.12.0

The error comes from the binary packages indicated above. I had no problems with the package builded from source.

Source info:

1. The commit hash (git rev-parse HEAD): 48fb73a
2. The output of bazel version:

Build label: 0.4.1
Build target: bazel-out/local-fastbuild/bin/src/main/java/com/google/devtools/build/lib/bazel/BazelServer_deploy.jar
Build time: Wed Nov 30 09:13:36 2016 (1480497216)
Build timestamp: 1480497216
Build timestamp as int: 1480497216

If possible, provide a minimal reproducible example (We usually don't have time to read hundreds of lines of your code)

I guess seeing the problem is that I use inside a new Op some functions from this part of the core:

#include "tensorflow/core/lib/core/stringpiece.h"

What other attempted solutions have you tried?

This thing is strange because as I said with the package created from the source code I have no error during the execution of the script, but with the binary package provided from the official website I had the runtime error below.

Logs or other output that would be helpful

tensorflow.python.framework.errors_impl.NotFoundError: /.../newop.so: undefined symbol: _ZN10tensorflow9LogMemory21RecordRawDeallocationERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEExPvPNS_9AllocatorEb

[MircoT]

No more problems with new version 0.12 on MacOS.

[MircoT]

The problem still in Linux as said above. I want to add another information:

to compile the plugin correctly on Linux I had to add libprotobuf and libprotobuf_lite as dependencies. I took the libraries from the compiled directory after bazel build execution.

[aselle]

@jart, could you take a look at this issue?

[jart]

So you're writing a custom op. Can you post your Bazel build configuration?

[MircoT]

I'm sorry but what do you mean as build configuration?

By the way I was working on a clean system with Ubuntu 16.04. The fresh installation has only the base things to build tensorflow, I followed the instructions from the main website and for bazel I used the repo installation.

The system was previously configured with Cuda framework with the proper video driver and toolkit, also complete with cudnn.

To compile the tensorflow library I added avx instructions set.

To build the custom op I'm using gcc as described in the tutorial and so I don't have a project with bazel for the custom op.

Hope these information could be useful for the moment. If you need more specific info I will try to respond as soon as I can.

Thank you for the support.

[jart]

Thank you for the support.

I'm glad to be of service. But please note for future reference that support is community-driven on StackOverflow. That is a more appropriate venue for issues like these. We try to keep this issue tracker limited to bugs and feature requests.

That said, you're most likely forgetting to link one of the TensorFlow shared objects into your program. Wild guess but try saying from tensorflow.python import pywrap_tensorflow before you call tf.load_op_library.

Also, I strongly recommend using Bazel. I don't know why the documentation says to use gcc. Basically there's a directory called tensorflow/user_ops that shows you how to do what you want to do. You can customize that directory to your heart's content.

If this doesn't solve your issue, let me know and I'll reopen this.

[MircoT]

I will switch to bazel but basically I followed these instructions :

https://www.tensorflow.org/versions/r0.11/how_tos/adding_an_op/#building_the_op_library

I wrote here because the problem happens only with the binary package provided on the official website and I didn't have any problems with the package compiled from source. For future similar cases I will use stackoverflow.

Thank you for the response.

[jart]

Thank you for clarifying. So this only happens if you try to use something in stringpiece.h with the binary release, but compiling TensorFlow from source on your computer works fine. So maybe this is an ABI compatibility type issue. Maybe you're using a different version of GCC than what we used to build the release.

Hey @mrry would we consider something like this to be a bug? Does undefined symbol: _ZN10tensorflow9LogMemory21RecordRawDeallocationERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEExPvPNS_9AllocatorEb mean anything to you?