-
Notifications
You must be signed in to change notification settings - Fork 174
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] tf-lite custom support #3713
Comments
cibot: Thank you for posting issue #3713. The person in charge will reply soon. |
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Apr 14, 2022
Support tf-lite custom binaries. Expected usage: ... ! tensor_filter framework=tensorflow-lite-custom model=/home/mzx/tflite_custom_x.so,/home/mzx/modelfile.tflite ! ... This is "PLAN A" of nnstreamer#3713 Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Apr 14, 2022
This addresses plan B of nnstreamer#3713 Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Apr 15, 2022
This addresses plan B of nnstreamer#3713 $ ldd build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow2-lite-custom.so linux-vdso.so.1 (0x00007fffe21f2000) libnnstreamer-single.so => /source/AutoDrv/NNStreamer/build/ext/nnstreamer/tensor_filter/../../../gst/nnstreamer/libnnstreamer-single.so (0x00007f08b5bba000) /source/AutoDrv/NNStreamer/ext/nnstreamer/tensor_filter/libtensorflow2-lite-custom.so (0x00007f08b50a5000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08b4ea1000) libglib-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f08b4b8a000) libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f08b477d000) libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f08b4565000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08b4174000) libgmodule-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0 (0x00007f08b3f70000) libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f08b3d1c000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08b3afd000) /lib64/ld-linux-x86-64.so.2 (0x00007f08b5ff8000) libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f08b388b000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f08b34ed000) libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f08b32e5000) After this, we need the following commits. 1. a manual how to use tflite2-custom. (at /ext/nnstreamer/tensor-filter?) 2. a test case for tflite2-custom. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Apr 15, 2022
For nnstreamer#3713, add a usage manual because it may be not too trivial for non-system-sw developers. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Apr 15, 2022
This addresses plan B of nnstreamer#3713 $ ldd build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow2-lite-custom.so linux-vdso.so.1 (0x00007fffe21f2000) libnnstreamer-single.so => /source/AutoDrv/NNStreamer/build/ext/nnstreamer/tensor_filter/../../../gst/nnstreamer/libnnstreamer-single.so (0x00007f08b5bba000) /source/AutoDrv/NNStreamer/ext/nnstreamer/tensor_filter/libtensorflow2-lite-custom.so (0x00007f08b50a5000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08b4ea1000) libglib-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f08b4b8a000) libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f08b477d000) libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f08b4565000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08b4174000) libgmodule-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0 (0x00007f08b3f70000) libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f08b3d1c000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08b3afd000) /lib64/ld-linux-x86-64.so.2 (0x00007f08b5ff8000) libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f08b388b000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f08b34ed000) libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f08b32e5000) After this, we need the following commits. 1. a manual how to use tflite2-custom. (at /ext/nnstreamer/tensor-filter?) 2. a test case for tflite2-custom. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Apr 15, 2022
This addresses plan B of nnstreamer#3713 $ ldd build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow2-lite-custom.so linux-vdso.so.1 (0x00007fffe21f2000) libnnstreamer-single.so => /source/AutoDrv/NNStreamer/build/ext/nnstreamer/tensor_filter/../../../gst/nnstreamer/libnnstreamer-single.so (0x00007f08b5bba000) /source/AutoDrv/NNStreamer/ext/nnstreamer/tensor_filter/libtensorflow2-lite-custom.so (0x00007f08b50a5000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08b4ea1000) libglib-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f08b4b8a000) libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f08b477d000) libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f08b4565000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08b4174000) libgmodule-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0 (0x00007f08b3f70000) libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f08b3d1c000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08b3afd000) /lib64/ld-linux-x86-64.so.2 (0x00007f08b5ff8000) libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f08b388b000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f08b34ed000) libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f08b32e5000) After this, we need the following commits. 1. a manual how to use tflite2-custom. (at /ext/nnstreamer/tensor-filter?) 2. a test case for tflite2-custom. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Apr 17, 2022
This addresses plan B of nnstreamer#3713 $ ldd build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow2-lite-custom.so linux-vdso.so.1 (0x00007fffe21f2000) libnnstreamer-single.so => /source/AutoDrv/NNStreamer/build/ext/nnstreamer/tensor_filter/../../../gst/nnstreamer/libnnstreamer-single.so (0x00007f08b5bba000) /source/AutoDrv/NNStreamer/ext/nnstreamer/tensor_filter/libtensorflow2-lite-custom.so (0x00007f08b50a5000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08b4ea1000) libglib-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f08b4b8a000) libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f08b477d000) libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f08b4565000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08b4174000) libgmodule-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0 (0x00007f08b3f70000) libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f08b3d1c000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08b3afd000) /lib64/ld-linux-x86-64.so.2 (0x00007f08b5ff8000) libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f08b388b000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f08b34ed000) libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f08b32e5000) After this, we need the following commits. 1. a manual how to use tflite2-custom. (at /ext/nnstreamer/tensor-filter?) 2. a test case for tflite2-custom. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
Plan B Issue: when libtensorflow-lite-custom.so is not available at the pipeline construction (tensor-filter loading), we need to generate proper (not killing the app) error! |
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Apr 18, 2022
This addresses plan B of nnstreamer#3713 $ ldd build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow2-lite-custom.so linux-vdso.so.1 (0x00007fffe21f2000) libnnstreamer-single.so => /source/AutoDrv/NNStreamer/build/ext/nnstreamer/tensor_filter/../../../gst/nnstreamer/libnnstreamer-single.so (0x00007f08b5bba000) /source/AutoDrv/NNStreamer/ext/nnstreamer/tensor_filter/libtensorflow2-lite-custom.so (0x00007f08b50a5000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08b4ea1000) libglib-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f08b4b8a000) libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f08b477d000) libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f08b4565000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08b4174000) libgmodule-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0 (0x00007f08b3f70000) libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f08b3d1c000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08b3afd000) /lib64/ld-linux-x86-64.so.2 (0x00007f08b5ff8000) libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f08b388b000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f08b34ed000) libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f08b32e5000) After this, we need the following commits. 1. a manual how to use tflite2-custom. (at /ext/nnstreamer/tensor-filter?) 2. a test case for tflite2-custom. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Jun 2, 2022
This addresses plan B of nnstreamer#3713 $ ldd build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow2-lite-custom.so linux-vdso.so.1 (0x00007fffe21f2000) libnnstreamer-single.so => /source/AutoDrv/NNStreamer/build/ext/nnstreamer/tensor_filter/../../../gst/nnstreamer/libnnstreamer-single.so (0x00007f08b5bba000) /source/AutoDrv/NNStreamer/ext/nnstreamer/tensor_filter/libtensorflow2-lite-custom.so (0x00007f08b50a5000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08b4ea1000) libglib-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f08b4b8a000) libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f08b477d000) libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f08b4565000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08b4174000) libgmodule-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0 (0x00007f08b3f70000) libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f08b3d1c000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08b3afd000) /lib64/ld-linux-x86-64.so.2 (0x00007f08b5ff8000) libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f08b388b000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f08b34ed000) libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f08b32e5000) After this, we need the following commits. 1. a manual how to use tflite2-custom. (at /ext/nnstreamer/tensor-filter?) 2. a test case for tflite2-custom. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Jun 2, 2022
For nnstreamer#3713, add a usage manual because it may be not too trivial for non-system-sw developers. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
jaeyun-jung
pushed a commit
that referenced
this issue
Jun 7, 2022
For #3713, add a usage manual because it may be not too trivial for non-system-sw developers. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Jun 8, 2022
This addresses plan B of nnstreamer#3713 $ ldd build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow2-lite-custom.so linux-vdso.so.1 (0x00007fffe21f2000) libnnstreamer-single.so => /source/AutoDrv/NNStreamer/build/ext/nnstreamer/tensor_filter/../../../gst/nnstreamer/libnnstreamer-single.so (0x00007f08b5bba000) /source/AutoDrv/NNStreamer/ext/nnstreamer/tensor_filter/libtensorflow2-lite-custom.so (0x00007f08b50a5000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08b4ea1000) libglib-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f08b4b8a000) libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f08b477d000) libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f08b4565000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08b4174000) libgmodule-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0 (0x00007f08b3f70000) libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f08b3d1c000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08b3afd000) /lib64/ld-linux-x86-64.so.2 (0x00007f08b5ff8000) libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f08b388b000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f08b34ed000) libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f08b32e5000) After this, we need the following commits. 1. a manual how to use tflite2-custom. (at /ext/nnstreamer/tensor-filter?) 2. a test case for tflite2-custom. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
to myungjoo/nnstreamer
that referenced
this issue
Jun 9, 2022
This addresses plan B of nnstreamer#3713 $ ldd build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow2-lite-custom.so linux-vdso.so.1 (0x00007fffe21f2000) libnnstreamer-single.so => /source/AutoDrv/NNStreamer/build/ext/nnstreamer/tensor_filter/../../../gst/nnstreamer/libnnstreamer-single.so (0x00007f08b5bba000) /source/AutoDrv/NNStreamer/ext/nnstreamer/tensor_filter/libtensorflow2-lite-custom.so (0x00007f08b50a5000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08b4ea1000) libglib-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f08b4b8a000) libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f08b477d000) libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f08b4565000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08b4174000) libgmodule-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0 (0x00007f08b3f70000) libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f08b3d1c000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08b3afd000) /lib64/ld-linux-x86-64.so.2 (0x00007f08b5ff8000) libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f08b388b000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f08b34ed000) libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f08b32e5000) After this, we need the following commits. 1. a manual how to use tflite2-custom. (at /ext/nnstreamer/tensor-filter?) 2. a test case for tflite2-custom. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
myungjoo
added a commit
that referenced
this issue
Jun 10, 2022
This addresses plan B of #3713 $ ldd build/ext/nnstreamer/tensor_filter/libnnstreamer_filter_tensorflow2-lite-custom.so linux-vdso.so.1 (0x00007fffe21f2000) libnnstreamer-single.so => /source/AutoDrv/NNStreamer/build/ext/nnstreamer/tensor_filter/../../../gst/nnstreamer/libnnstreamer-single.so (0x00007f08b5bba000) /source/AutoDrv/NNStreamer/ext/nnstreamer/tensor_filter/libtensorflow2-lite-custom.so (0x00007f08b50a5000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f08b4ea1000) libglib-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f08b4b8a000) libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f08b477d000) libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f08b4565000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f08b4174000) libgmodule-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0 (0x00007f08b3f70000) libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f08b3d1c000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f08b3afd000) /lib64/ld-linux-x86-64.so.2 (0x00007f08b5ff8000) libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f08b388b000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f08b34ed000) libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f08b32e5000) After this, we need the following commits. 1. a manual how to use tflite2-custom. (at /ext/nnstreamer/tensor-filter?) 2. a test case for tflite2-custom. Signed-off-by: MyungJoo Ham <myungjoo.ham@samsung.com>
#4268 will complete this. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Supposed Usage Example
Timeline: no specific due date, but let's try to release w/ Tizen 7.0 M2 (priority is lower than other established PLM/RELEASE tasks)
Plan A: use dlopen. get class instances of required tflite features.
Findings:
Plan B: let it be linked to "libtensorflow2-lite-custom.so" and user defines LD path in launch-time. This limits functionality a bit (cannot have multiple different custom tflite custom binaries for a given app.), but it will work. By default, let it try to load it from the "current" path of the app.
The text was updated successfully, but these errors were encountered: