WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory #796

cappadaan · 2022-06-04T09:29:38Z

Describe the bug

After upgrading from 4.2 to 5.0.2 the indexer shows me this warning
WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory

But the indexer works as expected.

Expected behavior
Should give me no warning or at least a human readable warning

tomatolog · 2022-06-04T14:33:05Z

you should install columnar package to get rid of this warning

sanikolaev · 2022-06-06T06:53:35Z

After upgrading from 4.2 to 5.0.2 the indexer shows me this warning

What's the operating system?
Did you use the MCL (Manticore Columnar Library) before?

cappadaan · 2022-06-06T07:46:40Z

What's the operating system?
CentOS 7
Linux 3.10.0 x86_64 GNU/Linux
Did you use the MCL (Manticore Columnar Library) before?
No

sanikolaev · 2022-06-07T09:54:03Z

@cappadaan 2 more questions:

Did you build it yourself or it's an official package?
Can you run indexer with no params and provide the output?

cappadaan · 2022-06-07T10:06:10Z

Installed via: yum install manticore

[user@sphinx user]$ indexer
Manticore 5.0.2 348514c@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

Built on Linux x86_64 by Clang 7.0.1 compiler.

Configured with these definitions: -DDISTR_BUILD=rhel7 -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DWITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmysqlclient.so.18 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTGRESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore/data -DFULL_SHARE_DIR=/usr/share/manticore

Usage: indexer [OPTIONS] [indexname1 [indexname2 [...]]]

Options are:
-h, --help display this help message
-v, --version display version information
--config read configuration from specified file
(default is manticore.conf)
--all reindex all configured indexes
--quiet be quiet, only print errors
--noprogress do not display progress
(automatically on if output is not to a tty)
--rotate send SIGHUP to searchd when indexing is over
to rotate updated indexes automatically
--sighup-each send SIGHUP to searchd after each index
(used with --rotate only)
--buildstops <output.txt>
build top N stopwords and write them to given file
--buildfreqs store words frequencies to output.txt
(used with --buildstops only)
--merge
merge 'src-index' into 'dst-index'
'dst-index' will receive merge result
'src-index' will not be modified
--merge-dst-range
filter 'dst-index' on merge, keep only those documents
where 'attr' is between 'min' and 'max' (inclusive)
--drop-src clears src index after merge
--dump-rows dump indexed rows into FILE
--print-queries print SQL queries (for debugging)
--print-rt print indexed rows as SQL insert commands and field mapping info for populating an RT index
--keep-attrs retain attributes from the old index

Examples:
indexer --quiet myidx1 reindex 'myidx1' defined in 'manticore.conf'
indexer --all reindex all indexes defined in 'manticore.conf'

klirichek · 2022-06-07T10:46:13Z

Over default there are 3 env variables which affects path of searching for columnar library.

LIB_MANTICORE_COLUMNAR might be set to full path to the library (i.e., if it set to /usr/bin/lib_manticore_columnar.so, then manticore will look the library exactly at this path and nowhere else).
If it is NOT set, then
MANTICORE_MODULES might be set to the folder where columnar (and other modules) lives (i.e. if it set to /usr/bin, then manticore will look for module named lib_manticore_columnar.so exactly at this path, and nowhere else; as far as also other modules like galera and others not-specified explicitly via env). If it is NOT set, then finally

*FULL_SHARE_DIR might be set to the generic share folder. Modules are located in $FULL_SHARE_DIR/modules, so columnar will be searched at $FULL_SHARE_DIR/modules/lib_manticore_columnar.so. But it is definitely not your case, as there is no 'modules' word in your path.

So, I suspect, first or second env can be active and affect the search. Or, if not, issue need further investigation.

Anyway, without any investigations, you can explicitly set any of mentioned variables to the known where lib is placed, and it should work.

cappadaan · 2022-06-09T08:16:17Z

Columnar is not installed, I dont even know what it is. I would then expect something like this:

WARNING: Columnar not installed on {path}, skipping

sanikolaev · 2022-06-10T13:14:45Z

I can't reproduce the issue in a clean Centos 7:

[root@d06c28705b4c /]# cat /etc/*release*|head -1
CentOS Linux release 7.8.2003 (Core)

[root@d06c28705b4c /]# sudo yum install https://repo.manticoresearch.com/manticore-repo.noarch.rpm
Loaded plugins: fastestmirror, ovl
manticore-repo.noarch.rpm                                                                                                                            | 6.7 kB  00:00:00
Examining /var/tmp/yum-root-2jZiS5/manticore-repo.noarch.rpm: manticore-repo-0.0.1-1.noarch
Marking /var/tmp/yum-root-2jZiS5/manticore-repo.noarch.rpm to be installed
Resolving Dependencies
--> Running transaction check
---> Package manticore-repo.noarch 0:0.0.1-1 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

============================================================================================================================================================================
 Package                                    Arch                               Version                             Repository                                          Size
============================================================================================================================================================================
Installing:
 manticore-repo                             noarch                             0.0.1-1                             /manticore-repo.noarch                             463

Transaction Summary
============================================================================================================================================================================
Install  1 Package

Total size: 463
Installed size: 463
Is this ok [y/d/N]: y
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : manticore-repo-0.0.1-1.noarch                                                                                                                            1/1
  Verifying  : manticore-repo-0.0.1-1.noarch                                                                                                                            1/1

Installed:
  manticore-repo.noarch 0:0.0.1-1

Complete!

[root@d06c28705b4c /]# sudo yum install manticore
...
  Installing : manticore-devel-5.0.2_220530.348514c-1.el7.centos.noarch                                                                                                 5/7
  Installing : manticore-icudata-5.0.2_220530.348514c-1.el7.centos.noarch                                                                                               6/7
  Installing : manticore-5.0.2_220530.348514c-1.el7.centos.x86_64                                                                                                       7/7
  Verifying  : manticore-icudata-5.0.2_220530.348514c-1.el7.centos.noarch                                                                                               1/7
  Verifying  : manticore-tools-5.0.2_220530.348514c-1.el7.centos.x86_64                                                                                                 2/7
  Verifying  : manticore-common-5.0.2_220530.348514c-1.el7.centos.noarch                                                                                                3/7
  Verifying  : manticore-server-5.0.2_220530.348514c-1.el7.centos.x86_64                                                                                                4/7
  Verifying  : manticore-devel-5.0.2_220530.348514c-1.el7.centos.noarch                                                                                                 5/7
  Verifying  : manticore-server-core-5.0.2_220530.348514c-1.el7.centos.x86_64                                                                                           6/7
  Verifying  : manticore-5.0.2_220530.348514c-1.el7.centos.x86_64                                                                                                       7/7

Installed:
  manticore.x86_64 0:5.0.2_220530.348514c-1.el7.centos

Dependency Installed:
  manticore-common.noarch 0:5.0.2_220530.348514c-1.el7.centos                             manticore-devel.noarch 0:5.0.2_220530.348514c-1.el7.centos
  manticore-icudata.noarch 0:5.0.2_220530.348514c-1.el7.centos                            manticore-server.x86_64 0:5.0.2_220530.348514c-1.el7.centos
  manticore-server-core.x86_64 0:5.0.2_220530.348514c-1.el7.centos                        manticore-tools.x86_64 0:5.0.2_220530.348514c-1.el7.centos

Complete!

[root@d06c28705b4c /]# indexer -v
Manticore 5.0.2 348514c@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

[root@d06c28705b4c /]# indexer
Manticore 5.0.2 348514c@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

Built on Linux x86_64 by Clang 7.0.1 compiler.

Configured with these definitions: -DDISTR_BUILD=rhel7 -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DWITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmysqlclient.so.18 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTGRESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore/data -DFULL_SHARE_DIR=/usr/share/manticore

Usage: indexer [OPTIONS] [indexname1 [indexname2 [...]]]

After upgrading from 4.2 to 5.0.2 the indexer shows me this warning

At what moment did you see the warning? According to your indexer's output there's none.

klirichek · 2022-06-10T14:33:07Z

There is no such warning by default. Only if columnar persist on the path, but not available (i.e. incompatible, or something else).
Anyway, reporting error about /usr/bin/lib_manticore_columnar.so definitely means, that you've customized MANTICORE_MODULES or LIB_MANTICORE_COLUMNAR env on your system.
Default path would be /usr/share/manticore/modules/lib_manticore_columnar.so, and never /usr/bin.

cappadaan · 2022-06-10T14:58:35Z

At what moment did you see the warning? According to your indexer's output there's none.

When I run the indexer, the warning is there.

There is no such warning by default. Only if columnar persist on the path, but not available (i.e. incompatible, or something else). Anyway, reporting error about /usr/bin/lib_manticore_columnar.so definitely means, that you've customized MANTICORE_MODULES or LIB_MANTICORE_COLUMNAR env on your system. Default path would be /usr/share/manticore/modules/lib_manticore_columnar.so, and never /usr/bin.

I never set any of these env on the system, strange

sanikolaev · 2022-06-13T10:58:55Z

@cappadaan we've discussed it and have a clue why it may be happening, but are not aure.

Can you please provide:

exact command you use to run indexer and the full output, which demonstrates the warning
ls -la /usr/bin/lib_manticore_columnar.so
find /usr/share/manticore/modules/|xargs ls -la
yum list installed|grep manticore

?

cappadaan · 2022-06-13T11:06:52Z

exact command you use to run indexer and the full output, which demonstrates the warning

indexer --rotate --all -c /path_to_my_config.conf

Manticore 5.0.2 348514c@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file '/path_to_my_config.conf'...
WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory
WARNING: skipping non-plain index 'template_index'...
indexing index 'INDEX_NAME'...

ls -la /usr/bin/lib_manticore_columnar.so

ls: cannot access /usr/bin/lib_manticore_columnar.so: No such file or directory

find /usr/share/manticore/modules/|xargs ls -la

-rwxr-xr-x 1 root root 2025408 May 30 10:04 /usr/share/manticore/modules/libgalera_manticore.so

/usr/share/manticore/modules/:
total 1988
drwxr-xr-x 2 root root 4096 Jun 4 11:06 .
drwxr-xr-x 6 root root 4096 Jun 4 11:06 ..
-rwxr-xr-x 1 root root 2025408 May 30 10:04 libgalera_manticore.so

yum list installed|grep manticore

Failed to set locale, defaulting to C
Manticore-repo.noarch 0.0.1-1 @/manticore-repo.noarch
manticore.x86_64 5.0.2_220530.348514c-1.el7.centos @Manticore
manticore-common.noarch 5.0.2_220530.348514c-1.el7.centos @Manticore
manticore-devel.noarch 5.0.2_220530.348514c-1.el7.centos @Manticore
manticore-icudata.noarch 5.0.2_220530.348514c-1.el7.centos @Manticore
manticore-server.x86_64 5.0.2_220530.348514c-1.el7.centos @Manticore
manticore-server-core.x86_64 5.0.2_220530.348514c-1.el7.centos @Manticore
manticore-tools.x86_64 5.0.2_220530.348514c-1.el7.centos @Manticore

sanikolaev · 2022-06-13T14:48:02Z

Still can't reproduce it:

[root@fac5a64ddb2c /]# indexer -c csv.conf --all
Manticore 5.0.2 348514c@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file 'csv.conf'...
WARNING: skipping non-plain index 'tpl'...
indexing index 'idx'...
collected 1 docs, 0.0 MB
creating lookup: 0.0 Kdocs, 100.0% done
sorted 0.0 Mhits, 100.0% done
total 1 docs, 3 bytes
total 0.152 sec, 19 bytes/sec, 6.57 docs/sec
total 3 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
total 15 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg

[root@fac5a64ddb2c /]# ls -la /usr/bin/lib_manticore_columnar.so
ls: cannot access /usr/bin/lib_manticore_columnar.so: No such file or directory

[root@fac5a64ddb2c /]# find /usr/share/manticore/modules/|xargs ls -la
-rwxr-xr-x 1 root root 2025408 May 30 08:04 /usr/share/manticore/modules/libgalera_manticore.so

/usr/share/manticore/modules/:
total 1988
drwxr-xr-x 2 root root    4096 Jun 13 14:42 .
drwxr-xr-x 6 root root    4096 May 22 04:12 ..
-rwxr-xr-x 1 root root 2025408 May 30 08:04 libgalera_manticore.so

[root@fac5a64ddb2c /]# yum list installed|grep manticore
manticore.x86_64                   5.0.2_220530.348514c-1.el7.centos @manticore
manticore-common.noarch            5.0.2_220530.348514c-1.el7.centos @manticore
manticore-devel.noarch             5.0.2_220530.348514c-1.el7.centos @manticore
manticore-icudata.noarch           5.0.2_220530.348514c-1.el7.centos @manticore
manticore-repo.noarch              0.0.1-1                           @/manticore-repo.noarch
manticore-server.x86_64            5.0.2_220530.348514c-1.el7.centos @manticore
manticore-server-core.x86_64       5.0.2_220530.348514c-1.el7.centos @manticore
manticore-tools.x86_64             5.0.2_220530.348514c-1.el7.centos @manticore

[root@fac5a64ddb2c /]# indexer
Manticore 5.0.2 348514c@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

Built on Linux x86_64 by Clang 7.0.1 compiler.

Configured with these definitions: -DDISTR_BUILD=rhel7 -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DWITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmysqlclient.so.18 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTGRESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore/data -DFULL_SHARE_DIR=/usr/share/manticore

Usage: indexer [OPTIONS] [indexname1 [indexname2 [...]]]
...

I.e. everything looks the same, but I don't get the warning. Can you share your configuration file?

cappadaan · 2022-06-13T14:57:32Z

I uploaded the conf to your FTP

stale · 2022-07-31T07:05:50Z

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Feel free to re-open the issue in case it becomes actual.

animetosho · 2022-09-09T03:17:04Z

Getting the exact same warning with a ~~fresh~~ install on a Debian machine.

Taking a peek at the code, it seems obvious why it's happening:

one of the first things the indexer tries to do is load the columnar plugin
the init call will try to dlopen the library
if the file doesn't exist, it'll set the error and just continue on
the sError variable name is re-used for collation errors but a successful call doesn't clear the error
so basically, if the columnar plugin fails to load, and collation_server was correctly set, it'll print the warning

Haven't bothered trying to verify this (the debug symbols in the Debian repo are only provided for 4.2.0 (manticore-dbgsym_4.2.0-211223-15e927b28_amd64.deb) not 5.0.2), but it seems plausible.

Fortunately, it doesn't actually prevent anything from working :)

sanikolaev · 2022-09-09T03:41:49Z

@animetosho

How do you reproduce it? Here's what I get in a clean Debian Bullseye:

root@1daeaedfd24d:/# sudo apt install manticore
...
root@1daeaedfd24d:/# indexer -v
Manticore 5.0.2 348514c86@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

root@1daeaedfd24d:/# searchd -v
Manticore 5.0.2 348514c86@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

root@1daeaedfd24d:/# sudo apt install manticore-columnar-lib
...
root@1daeaedfd24d:/# searchd -v
Manticore 5.0.2 348514c86@220530 dev (columnar 1.15.4 2fef34e@220522) (secondary 1.15.4 2fef34e@220522)
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

root@1daeaedfd24d:/# indexer -v
Manticore 5.0.2 348514c86@220530 dev (columnar 1.15.4 2fef34e@220522) (secondary 1.15.4 2fef34e@220522)
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

All the libraries are stored not in /usr/bin/ as the issue's title says, but in:

root@1daeaedfd24d:/# ls -la /usr/share/manticore/modules/lib*
-rw-r--r-- 1 root root 4420704 May 22 04:29 /usr/share/manticore/modules/lib_manticore_columnar.so
-rw-r--r-- 1 root root 1185360 May 22 04:29 /usr/share/manticore/modules/lib_manticore_secondary.so
-rwxr-xr-x 1 root root 2019112 May 30 08:03 /usr/share/manticore/modules/libgalera_manticore.so

the binaries should be looking for the libraries there, not in /usr/bin

You can easily install 5.0.2 debug symbols in Debian like this:

apt install manticore-server-core-dbgsym manticore-tools-dbgsym

or manually by finding the debug symbol packages on https://repo.manticoresearch.com/

There's also find-dbgsym-packages from package debian-goodies which helps finding debug symbol packages. Manticore supports it:

root@1daeaedfd24d:/# find-dbgsym-packages /usr/bin/searchd
W: No dbg package for source 'zlib'
W: Cannot find debug package for /lib/x86_64-linux-gnu/libz.so.1 (70a770d9b600208bb51e5f4d6a3bf4e344d13478)
W: No dbg package for source 'openssl'
W: Cannot find debug package for /usr/lib/x86_64-linux-gnu/libssl.so.1.1 (847f26496373ebc96c8b34eae3e12390d6c128ca)
W: No dbg package for source 'openssl'
W: Cannot find debug package for /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 (08aa8c462037f6809d07ab8b9baaeb9100ece88e)
lib32stdc++6-10-dbg libc6-dbg libstdc++6-10-dbg libx32stdc++6-10-dbg manticore-server-core-dbgsym

(see the last line)

root@1daeaedfd24d:/# find-dbgsym-packages /usr/bin/indexer
W: No dbg package for source 'zlib'
W: Cannot find debug package for /lib/x86_64-linux-gnu/libz.so.1 (70a770d9b600208bb51e5f4d6a3bf4e344d13478)
lib32stdc++6-10-dbg libc6-dbg libstdc++6-10-dbg libx32stdc++6-10-dbg manticore-tools-dbgsym

(see the last line)

animetosho · 2022-09-09T04:12:54Z

Sorry, this isn't exactly a clean install - my setup script had put my config on there; apologies for the incorrect assertion.

Thanks for the pointer on debug symbols - didn't know that the name has changed.
Looking at it in GDB, it's as I expected

(gdb) b sphWarning_impl
Breakpoint 1 at 0x4b8450: file ../src/sphinxutils.cpp, line 1641.
(gdb) r idx_main_combined
Starting program: /usr/bin/indexer idx_main_combined
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Manticore 5.0.2 348514c86@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file '/etc/manticoresearch/manticore.conf'...

Breakpoint 1, sphWarning_impl (sFmt=0xced554 "%s") at ../src/sphinxutils.cpp:1641
1641    ../src/sphinxutils.cpp: No such file or directory.
(gdb) bt
#0  sphWarning_impl (sFmt=0xced554 "%s") at ../src/sphinxutils.cpp:1641
#1  0x00000000004153e3 in main (argc=<optimized out>, argv=0x7fffffffe500) at ../src/indexer.cpp:1988

As with the original poster, I don't have the columnar plugin installed.

I'm guessing you can reproduce it with the following conditions:

not have the columnar plugin installed
have the collation_server option set under searchd { ... } config to a valid value (I have collation_server = utf8_general_ci)
run indexer on one or more index

sanikolaev · 2022-09-09T04:55:21Z

Thanks @animetosho

MRE

root@1daeaedfd24d:/# cat min.conf
searchd {
    listen = 9315:mysql41
    log = searchd.log
    pid_file = searchd.pid
    binlog_path =
    collation_server = utf8_general_ci
}

source src {
    type = csvpipe
    csvpipe_command = echo "1,abc"
    csvpipe_field = f
}

index idx {
    type = plain
    source = src
    path = idx
    stored_fields = f
}

root@1daeaedfd24d:/# indexer -c min.conf --all
Manticore 5.0.2 348514c86@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file 'min.conf'...
WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory
indexing index 'idx'...
collected 1 docs, 0.0 MB
creating lookup: 0.0 Kdocs, 100.0% done
sorted 0.0 Mhits, 100.0% done
total 1 docs, 3 bytes
total 0.124 sec, 24 bytes/sec, 8.03 docs/sec
total 3 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
total 15 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg

Same w/o collation_server:

root@1daeaedfd24d:/# indexer -c min.conf --all
Manticore 5.0.2 348514c86@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file 'min.conf'...
indexing index 'idx'...
collected 1 docs, 0.0 MB
creating lookup: 0.0 Kdocs, 100.0% done
sorted 0.0 Mhits, 100.0% done
total 1 docs, 3 bytes
total 0.256 sec, 11 bytes/sec, 3.89 docs/sec
total 3 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
total 15 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg

We can now look into this.

githubmanticore · 2023-01-19T12:37:42Z

➤ Ilya Kuznetsov commented:

Fixed in 426c47c

sanikolaev added the waiting Waiting for the original poster (in most cases) or something else label Jun 6, 2022

stale bot added the wontfix label Jul 31, 2022

sanikolaev removed waiting Waiting for the original poster (in most cases) or something else wontfix labels Aug 1, 2022

sanikolaev added the waiting Waiting for the original poster (in most cases) or something else label Sep 9, 2022

sanikolaev added bug and removed waiting Waiting for the original poster (in most cases) or something else labels Sep 9, 2022

githubmanticore closed this as completed Jan 19, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory #796

WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory #796

cappadaan commented Jun 4, 2022 •

edited by githubmanticore

Loading

tomatolog commented Jun 4, 2022

sanikolaev commented Jun 6, 2022

cappadaan commented Jun 6, 2022 •

edited

Loading

sanikolaev commented Jun 7, 2022

cappadaan commented Jun 7, 2022

klirichek commented Jun 7, 2022

cappadaan commented Jun 9, 2022

sanikolaev commented Jun 10, 2022

klirichek commented Jun 10, 2022

cappadaan commented Jun 10, 2022

sanikolaev commented Jun 13, 2022

cappadaan commented Jun 13, 2022 •

edited

Loading

sanikolaev commented Jun 13, 2022

cappadaan commented Jun 13, 2022

stale bot commented Jul 31, 2022

animetosho commented Sep 9, 2022 •

edited

Loading

sanikolaev commented Sep 9, 2022

animetosho commented Sep 9, 2022

sanikolaev commented Sep 9, 2022

githubmanticore commented Jan 19, 2023

WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory #796

WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory #796

Comments

cappadaan commented Jun 4, 2022 • edited by githubmanticore Loading

tomatolog commented Jun 4, 2022

sanikolaev commented Jun 6, 2022

cappadaan commented Jun 6, 2022 • edited Loading

sanikolaev commented Jun 7, 2022

cappadaan commented Jun 7, 2022

klirichek commented Jun 7, 2022

cappadaan commented Jun 9, 2022

sanikolaev commented Jun 10, 2022

klirichek commented Jun 10, 2022

cappadaan commented Jun 10, 2022

sanikolaev commented Jun 13, 2022

cappadaan commented Jun 13, 2022 • edited Loading

sanikolaev commented Jun 13, 2022

cappadaan commented Jun 13, 2022

stale bot commented Jul 31, 2022

animetosho commented Sep 9, 2022 • edited Loading

sanikolaev commented Sep 9, 2022

animetosho commented Sep 9, 2022

sanikolaev commented Sep 9, 2022

MRE

githubmanticore commented Jan 19, 2023

cappadaan commented Jun 4, 2022 •

edited by githubmanticore

Loading

cappadaan commented Jun 6, 2022 •

edited

Loading

cappadaan commented Jun 13, 2022 •

edited

Loading

animetosho commented Sep 9, 2022 •

edited

Loading