Error while running of Red Hat- DotProductAVX can't be used on Android

[AzkaGilani]

I have used tesseract in my project. The project has been deployed on Red Hat server. It comiples fines on ubuntu and when i compile the same program in Red Hat it gives run time error: "DotProductAVX can't be used on Android." I have found other issues relating on internet similar to this, but the problem is that i can't update tesseract version or can not even rebuild it.
Is there any other solution by which i can solve this??
Should i make some change in my C++ code?

tesseract --version gives the following output:
`tesseract 0afd593
leptonica-1.74
libjpeg 8d (libjpeg-turbo 1.4.2) : libpng 1.2.54 : libtiff 4.0.6 : zlib 1.2.8

Found AVX
Found SSE
`

[stweil]

So the build process did not add the code needed for AVX => arch/dotproductavx.cpp was compiled without __AVX__ being defined => The compiler was called without -mavx for that file. As you did not tell us more about your build, you are currently the only one who can solve that problem. A full build log (commands used, output from configure / make) would help.

[stweil]

The Tesseract version in the output from tesseract --version looks strange. Which code did you compile?

[AzkaGilani]

I have compiled tesseract from source.
Build is tesseract-4.0Alpha while (0afd593) is commit number on this build.

[AzkaGilani]

I used following commands to build the project. It is working fine on ubuntu 16.04 but fails on Red Hat when tesseract function is called.

`sudo apt-get install autoconf automake libtool
sudo apt-get install autoconf-archive
sudo apt-get install pkg-config
sudo apt-get install libpng12-dev
sudo apt-get install libjpeg8-dev
sudo apt-get install libtiff5-dev
sudo apt-get install zlib1g-dev

wget http://www.leptonica.org/source/leptonica-1.74.tar.gz

tar -zxvf leptonica-1.74.tar.gz
cd leptonica-1.74
./configure
make
sudo make install

git clone git@gitlab.com:VisionX/core/libs/extern/tesseract.git
cd tesseract
git fetch origin
git branch -v -a
git checkout -b tesseract-4.0Alpha origin/tesseract-4.0Alpha
git pull origin tesseract-4.0Alpha
./autogen.sh
./configure --enable-debug
LDFLAGS="-L/usr/local/lib" CFLAGS="-I/usr/local/include" make
sudo make install
sudo ldconfig`

[stweil]

Could you please also add the output from the Tesseract configure / make?

[AzkaGilani]

~/tesseract$ ./configure --enable-debug
checking for g++... g++
checking whether the C++ compiler works... yes
checking for C++ compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C++ compiler... yes
checking whether g++ accepts -g... yes
Using git revision: 0afd593
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... /bin/mkdir -p
checking for gawk... no
checking for mawk... mawk
checking whether make sets $(MAKE)... yes
checking for style of include used by make... GNU
checking whether make supports nested variables... yes
checking dependency style of g++... gcc3
checking whether to enable maintainer-specific portions of Makefiles... no
checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking whether C++ compiler accepts -mavx... yes
checking whether C++ compiler accepts -msse4.1... yes
checking --enable-graphics argument... yes
checking --enable-embedded argument... no
checking for g++ option to support OpenMP... -fopenmp
checking --enable-opencl argument... no
checking how to run the C++ preprocessor... g++ -E
checking for grep that handles long lines and -e... /bin/grep
checking for egrep... /bin/grep -E
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking CL/cl.h usability... no
checking CL/cl.h presence... no
checking for CL/cl.h... no
checking OpenCL/cl.h usability... no
checking OpenCL/cl.h presence... no
checking for OpenCL/cl.h... no
checking tiffio.h usability... yes
checking tiffio.h presence... yes
checking for tiffio.h... yes
checking for clGetPlatformIDs in -lOpenCL... no
checking --enable-visibility argument... no
checking --enable-multiple-libraries argument... no
checking whether to use tessdata-prefix... yes
checking whether to enable debugging... yes
checking how to print strings... printf
checking for gcc... gcc
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking whether gcc understands -c and -o together... yes
checking dependency style of gcc... gcc3
checking for a sed that does not truncate output... /bin/sed
checking for fgrep... /bin/grep -F
checking for ld used by gcc... /usr/bin/ld
checking if the linker (/usr/bin/ld) is GNU ld... yes
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B
checking the name lister (/usr/bin/nm -B) interface... BSD nm
checking whether ln -s works... yes
checking the maximum length of command line arguments... 1572864
checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop
checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop
checking for /usr/bin/ld option to reload object files... -r
checking for objdump... objdump
checking how to recognize dependent libraries... pass_all
checking for dlltool... no
checking how to associate runtime and link libraries... printf %s\n
checking for ar... ar
checking for archiver @file support... @
checking for strip... strip
checking for ranlib... ranlib
checking command to parse /usr/bin/nm -B output from gcc object... ok
checking for sysroot... no
checking for a working dd... /bin/dd
checking how to truncate binary pipes... /bin/dd bs=4096 count=1
checking for mt... mt
checking if mt is a manifest tool... no
checking for dlfcn.h... yes
checking for objdir... .libs
checking if gcc supports -fno-rtti -fno-exceptions... no
checking for gcc option to produce PIC... -fPIC -DPIC
checking if gcc PIC flag -fPIC -DPIC works... yes
checking if gcc static flag -static works... yes
checking if gcc supports -c -o file.o... yes
checking if gcc supports -c -o file.o... (cached) yes
checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes
checking whether -lc should be explicitly linked in... no
checking dynamic linker characteristics... GNU/Linux ld.so
checking how to hardcode library paths into programs... immediate
checking whether stripping libraries is possible... yes
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... yes
checking whether to build static libraries... yes
checking how to run the C++ preprocessor... g++ -E
checking for ld used by g++... /usr/bin/ld -m elf_x86_64
checking if the linker (/usr/bin/ld -m elf_x86_64) is GNU ld... yes
checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes
checking for g++ option to produce PIC... -fPIC -DPIC
checking if g++ PIC flag -fPIC -DPIC works... yes
checking if g++ static flag -static works... yes
checking if g++ supports -c -o file.o... yes
checking if g++ supports -c -o file.o... (cached) yes
checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes
checking dynamic linker characteristics... (cached) GNU/Linux ld.so
checking how to hardcode library paths into programs... immediate
checking whether byte ordering is bigendian... no
checking if compiling with clang... no
checking whether compiler supports C++11... yes
checking for snprintf... yes
checking for library containing sem_init... -lpthread
checking for ANSI C header files... (cached) yes
checking whether time.h and sys/time.h may both be included... yes
checking for sys/wait.h that is POSIX.1 compatible... yes
checking sys/ipc.h usability... yes
checking sys/ipc.h presence... yes
checking for sys/ipc.h... yes
checking sys/shm.h usability... yes
checking sys/shm.h presence... yes
checking for sys/shm.h... yes
checking limits.h usability... yes
checking limits.h presence... yes
checking for limits.h... yes
checking malloc.h usability... yes
checking malloc.h presence... yes
checking for malloc.h... yes
checking for stdbool.h that conforms to C99... no
checking for _Bool... no
checking whether #! works in shell scripts... yes
checking for special C compiler options needed for large files... no
checking for _FILE_OFFSET_BITS value needed for large files... no
checking for getline... yes
checking for wchar_t... yes
checking for long long int... yes
checking for off_t... yes
checking for mbstate_t... yes
checking for pkg-config... /usr/bin/pkg-config
checking pkg-config is at least version 0.9.0... yes
checking for LEPTONICA... yes
checking for ICU_UC... yes
checking for ICU_I18N... yes
checking for pango... yes
checking for cairo... yes
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating tesseract.pc
config.status: creating api/Makefile
config.status: creating arch/Makefile
config.status: creating ccmain/Makefile
config.status: creating opencl/Makefile
config.status: creating ccstruct/Makefile
config.status: creating ccutil/Makefile
config.status: creating classify/Makefile
config.status: creating cutil/Makefile
config.status: creating dict/Makefile
config.status: creating lstm/Makefile
config.status: creating textord/Makefile
config.status: creating viewer/Makefile
config.status: creating wordrec/Makefile
config.status: creating tessdata/Makefile
config.status: creating tessdata/configs/Makefile
config.status: creating tessdata/tessconfigs/Makefile
config.status: creating testing/Makefile
config.status: creating java/Makefile
config.status: creating java/com/Makefile
config.status: creating java/com/google/Makefile
config.status: creating java/com/google/scrollview/Makefile
config.status: creating java/com/google/scrollview/events/Makefile
config.status: creating java/com/google/scrollview/ui/Makefile
config.status: creating doc/Makefile
config.status: creating training/Makefile
config.status: creating config_auto.h
config.status: config_auto.h is unchanged
config.status: executing depfiles commands
config.status: executing libtool commands

Configuration is done.
You can now build and install tesseract by running:

$ make
$ sudo make install

Training tools can be build and installed (after building of tesseract) with:

$ make training
$ sudo make training-install

[stweil]

checking whether C++ compiler accepts -mavx... yes

So your compiler supports -mavx. Is it used for arch/dotproductavx.cpp (see output from make)?

[AzkaGilani]

Tesseract was built successfully. When i try to again make it, i get the following output.

~/tesseract$ LDFLAGS="-L/usr/local/lib" CFLAGS="-I/usr/local/include" make
make all-recursive
make[1]: Entering directory '/home/azka/tesseract'
Making all in arch
make[2]: Entering directory '/home/azka/tesseract/arch'
make[3]: Entering directory '/home/azka/tesseract/arch'
make[3]: Nothing to be done for 'all-am'.
make[3]: Leaving directory '/home/azka/tesseract/arch'
make[2]: Leaving directory '/home/azka/tesseract/arch'
Making all in ccutil
make[2]: Entering directory '/home/azka/tesseract/ccutil'
make[3]: Entering directory '/home/azka/tesseract/ccutil'
make[3]: Nothing to be done for 'all-am'.
make[3]: Leaving directory '/home/azka/tesseract/ccutil'
make[2]: Leaving directory '/home/azka/tesseract/ccutil'
Making all in viewer
make[2]: Entering directory '/home/azka/tesseract/viewer'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/viewer'
Making all in cutil
make[2]: Entering directory '/home/azka/tesseract/cutil'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/cutil'
Making all in opencl
make[2]: Entering directory '/home/azka/tesseract/opencl'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/opencl'
Making all in ccstruct
make[2]: Entering directory '/home/azka/tesseract/ccstruct'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/ccstruct'
Making all in dict
make[2]: Entering directory '/home/azka/tesseract/dict'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/dict'
Making all in classify
make[2]: Entering directory '/home/azka/tesseract/classify'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/classify'
Making all in wordrec
make[2]: Entering directory '/home/azka/tesseract/wordrec'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/wordrec'
Making all in textord
make[2]: Entering directory '/home/azka/tesseract/textord'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/textord'
Making all in lstm
make[2]: Entering directory '/home/azka/tesseract/lstm'
make[3]: Entering directory '/home/azka/tesseract/lstm'
make[3]: Nothing to be done for 'all-am'.
make[3]: Leaving directory '/home/azka/tesseract/lstm'
make[2]: Leaving directory '/home/azka/tesseract/lstm'
Making all in ccmain
make[2]: Entering directory '/home/azka/tesseract/ccmain'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/ccmain'
Making all in api
make[2]: Entering directory '/home/azka/tesseract/api'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/api'
Making all in .
make[2]: Entering directory '/home/azka/tesseract'
make[2]: Leaving directory '/home/azka/tesseract'
Making all in tessdata
make[2]: Entering directory '/home/azka/tesseract/tessdata'
Making all in configs
make[3]: Entering directory '/home/azka/tesseract/tessdata/configs'
make[3]: Nothing to be done for 'all'.
make[3]: Leaving directory '/home/azka/tesseract/tessdata/configs'
Making all in tessconfigs
make[3]: Entering directory '/home/azka/tesseract/tessdata/tessconfigs'
make[3]: Nothing to be done for 'all'.
make[3]: Leaving directory '/home/azka/tesseract/tessdata/tessconfigs'
make[3]: Entering directory '/home/azka/tesseract/tessdata'
make[3]: Nothing to be done for 'all-am'.
make[3]: Leaving directory '/home/azka/tesseract/tessdata'
make[2]: Leaving directory '/home/azka/tesseract/tessdata'
Making all in doc
make[2]: Entering directory '/home/azka/tesseract/doc'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/home/azka/tesseract/doc'
make[1]: Leaving directory '/home/azka/tesseract'

[stweil]

Run touch arch/dotproductavx.cpp before running make. Then that file will be compiled again.

[AzkaGilani]

Actually i debuged my code and came to know that, program is throwing this error on this particular line
api->GetUTF8Text()

Any idea about that>?

[stweil]

That's expected. Could you please try to get more information from the build (see my previous comment)?

[AzkaGilani]

Yes it is taking time. i will share the result shortly

[AzkaGilani]

TesseractBuildInformation.TXT
This is the build information.
Is there any other information that is required from my side? :)

[AzkaGilani]

Output after using
sudo make install
Tesseract-InstallOutput.TXT

[stweil]

Thank you. TesseractBuildInformation.TXT is sufficient. It shows that the compiler option -mavx was not used. That explains the problem, but it is still not clear why that option is missing.

I suggest to rebuild with latest sources from git. Don't forget to run ./autogen.sh before starting a new build.

[AzkaGilani]

Actually it is built on my client server and i don't have rights to build the Tesseract library again. Is there any other work around??

[AzkaGilani]

After runningtouch arch/dotproductavx.cpp and then making it. My program is now giving this error:

/lib64/libstdc++.so.6: version `CXXABI_1.3.8' not found (required by /usr/local/lib/libtesseract.so.4)

[zdenop]

@AzkaGilani : did you solve this?

[willus]

There is a simple fix to this whole thing. Rather than having the Tesseract code abort if AVX is detected but not compiled in, put the directives in the compiled code so that it is never detected if it is not compiled in. Not sure why the source code wasn't written this way. Here is how the simddetect.cpp module should look:

`///////////////////////////////////////////////////////////////////////
// File: simddetect.cpp
// Description: Architecture detector.
// Author: Stefan Weil (based on code from Ray Smith)
//
// (C) Copyright 2014, Google Inc.
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
// You may obtain a copy of the License at
// http://www.apache.org/licenses/LICENSE-2.0
// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.
///////////////////////////////////////////////////////////////////////

#include "simddetect.h"

#undef X86_BUILD
#if defined(x86_64) || defined(i386) || defined(_WIN32)
#if !defined(ANDROID_BUILD)
#define X86_BUILD 1
#endif // !ANDROID_BUILD
#endif // x86 target

#if defined(X86_BUILD)
#if defined(GNUC)
#include <cpuid.h>
#elif defined(_WIN32)
#include <intrin.h>
#endif
#endif

SIMDDetect SIMDDetect::detector;

// If true, then AVX has been detected.
bool SIMDDetect::avx_available_;
bool SIMDDetect::avx2_available_;
bool SIMDDetect::avx512F_available_;
bool SIMDDetect::avx512BW_available_;
// If true, then SSe4.1 has been detected.
bool SIMDDetect::sse_available_;

// Constructor.
// Tests the architecture in a system-dependent way to detect AVX, SSE and
// any other available SIMD equipment.
// GNUC is also defined by compilers that include GNU extensions such as
// clang.
SIMDDetect::SIMDDetect() {
#if defined(X86_BUILD)
#if defined(GNUC)
unsigned int eax, ebx, ecx, edx;
if (get_cpuid(1, &eax, &ebx, &ecx, &edx) != 0) {
// Note that these tests all use hex because the older compilers don't have
// the newer flags.
#ifdef SSE4_1
sse_available = (ecx & 0x00080000) != 0;
#else
sse_available = false;
#endif
#ifdef AVX
avx_available_ = (ecx & 0x10000000) != 0;
#else
avx_available_ = false;
#endif
if (avx_available_) {
// There is supposed to be a get_cpuid_count function, but this is all
// there is in my cpuid.h. It is a macro for an asm statement and cannot
// be used inside an if.
cpuid_count(7, 0, eax, ebx, ecx, edx);
#ifdef AVX2
avx2_available = (ebx & 0x00000020) != 0;
#else
avx2_available = false;
#endif
avx512F_available = (ebx & 0x00010000) != 0;
avx512BW_available = (ebx & 0x40000000) != 0;
}
}
#elif defined(WIN32)
int cpuInfo[4];
cpuid(cpuInfo, 0);
if (cpuInfo[0] >= 1) {
cpuid(cpuInfo, 1);
#ifdef SSE4_1
sse_available = (cpuInfo[2] & 0x00080000) != 0;
#else
sse_available = false;
#endif
#ifdef AVX
avx_available = (cpuInfo[2] & 0x10000000) != 0;
#else
avx_available = false;
#endif
#ifndef AVX2
avx2_available = false;
#endif
}
#else
#error "I don't know how to test for SIMD with this compiler"
#endif
#endif // X86_BUILD
}
`

[stweil]

@willus, that's correct and can be even simplified further, but needs a little bit more code to set AVX, AVX2 and SSE4_1. Would https://github.com/stweil/tesseract/tree/simdetect be fine?

[stweil]

I have now created a pull request (#2135) to address this issue.

[willus]

@stweil, thank you. I agree that it could be simplified, and I re-did my version a few minutes later almost exactly the same way. I don't know C++ well enough--do declared booleans automatically default to false? I don't see where the avx_available_ boolean, for example, is initially declared as false.

[stweil]

@AzkaGilani, I assume that the issue is solved in Git master, so I close this issue. Please report if there is still a problem.

[stweil]

do declared booleans automatically default to false?

Yes, global variables are set automatically to 0 or false if they did not get an explicit initial value.