Using Plain table and Postgresql on MacOS (M1)

[quadlol]

Hello, I don't really understand the workflow on mac M1. I have followed this tutorial https://play.manticoresearch.com/mysql/ - however, I am using PostgreSQL in my case.

I am implementing search on my Postgresql tables. I did install everything successfully and updated my config to

searchd {
    listen = 127.0.0.1:9312
    listen = 127.0.0.1:9306:mysql
    listen = 127.0.0.1:9308:http
    log = /opt/homebrew/var/log/manticore/searchd.log
    query_log = /opt/homebrew/var/log/manticore/query.log
    pid_file = /opt/homebrew/var/run/manticore/searchd.pid
    data_dir = /opt/homebrew/var/manticore
    query_log_format = sphinxql
}

index sakila_film {
        path = /var/lib/manticore/testplain
        source = sakila_film
}

source sakila_film {
        type = pgsql
        sql_host = 127.0.0.1
        sql_user = myuser
        sql_pass = ''
        sql_db = mypostgresdatabase
        sql_query = SELECT id, name FROM people
}

$ sudo indexer sakila_film
Manticore 6.0.2 798d8e795@230213 (columnar 2.0.0 a7c703d@230130) (secondary 2.0.0 a7c703d@230130)
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2023, Manticore Software LTD (https://manticoresearch.com)

using config file '/opt/homebrew/Cellar/manticoresearch/6.0.2-2023021010-0ea6131/etc/manticoresearch/manticore.conf'...
indexing table 'sakila_film'...
collected 30 docs, 0.0 MB
creating secondary index
creating lookup: 1.1 Kdocs, 100.0% done
sorted 0.0 Mhits, 100.0% done
total 30 docs, 133 bytes
total 0.052 sec, 2523 bytes/sec, 21310.10 docs/sec
total 3 reads, 0.000 sec, 6.0 kb/call avg, 0.0 msec/call avg
total 15 writes, 0.000 sec, 3.3 kb/call avg, 0.0 msec/call avg

Until now, everything is clear, however, I don't really understand the next step - in the tutorial, you specify we need to run

searchd

This command doesn't work for me on Mac M1.

searchd
Manticore 6.0.2 798d8e795@230213 (columnar 2.0.0 a7c703d@230130) (secondary 2.0.0 a7c703d@230130)
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2023, Manticore Software LTD (https://manticoresearch.com)

[15:14.756] [62140] using config file '/opt/homebrew/Cellar/manticoresearch/6.0.2-2023021010-0ea6131/etc/manticoresearch/manticore.conf' (659 chars)...
[15:14.757] [62140] FATAL: 'data_dir' cannot be mixed with table declarations in '/opt/homebrew/Cellar/manticoresearch/6.0.2-2023021010-0ea6131/etc/manticoresearch/manticore.conf'

I tried restarting the brew service thinking maybe that could work. Well, It didn't create any table in the MySQL/Postgresql database.

Thank you

[tomatolog]

you need to use plain mode as described at our documentation https://manual.manticoresearch.com/Read_this_first#Real-time-mode-vs-plain-mode

as data_dir (RT modex) can not be mixed with plain mode index and data source definition

[quadlol]

Thanks! Removed data_dir from the conf and it has started working.

One more question - is there some sort of mode that will keep the external data in sync with the generated indexes?
I always want to perform searches on up-to-date data from an external source (Postgresql) but I think calling indexer each time I update/created/delete data in PostgreSQL will be very costly (especially cascade delete).

[tomatolog]

you could switch into RT mode and push data from you application along the push data into main DB