Replace index failed with ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))

[zepen]

Bug Description:

my replace index py code is here

import manticoresearch
from datetime import datetime

configuration = manticoresearch.Configuration(
    host="http://127.0.0.1:9308"
)
...
def update_index():
      try:
          with manticoresearch.ApiClient(configuration) as api_client:
              indexApi = manticoresearch.IndexApi(api_client)
              # print(row)
              id = row.pop("id")
              target_fields = ["x1", "x2", "x3", "x4", "x5", "x6"]
              new_row = {field: row[field] for field in target_fields if field in row}
              indexApi.replace({
                  "table": my_idx1, "id": id, "doc": new_row
              })
              target_fields = ["x1", "x2", "x3"]
              new_row = {field: row[field] for field in target_fields if field in row}
              indexApi.replace({
                  "table": my_idx2, "id": id, "doc": new_row
              })
      except Exception as e:
          print(f"[{datetime.now()}],manticore-search-error:{e}")

from dbutils.pooled_db import PooledDB
pool = PooledDB(.....)
with pool.connection() as conn:
    with conn.cursor() as cursor:
            cursor.execute(my-sql)
            for i, row in enumerate(cursor):
                  update_index()

mysql table data size: only 3k+
but log away print:
manticore-search-error:('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))

my_idx1 desc is :

+----------------+--------------+----------------+
| Field          | Type         | Properties     |
+----------------+--------------+----------------+
| id             | bigint       |                |
| x1            | text         | indexed stored |
| x2            | text         | indexed stored |
| x3            | text         | indexed stored |
| x4            | text         | indexed stored |
| x5            | text         | indexed stored |
| x6            | text         | indexed stored |
| x7            | text         | indexed stored |
| x8            | float        |                |
| x9            | string       |                |
| x10         | float_vector | knn            |
| update_time    | timestamp    |                |
+----------------+--------------+----------------+

my_idx2 desc is:

+---------------+-----------+----------------+
| Field         | Type      | Properties     |
+---------------+-----------+----------------+
| id            | bigint    |                |
| x1            | text      | indexed stored |
| x2           | text      | indexed stored |
| x3           | text      | indexed stored |
| x4         | text      | indexed stored |
| update_time   | timestamp |                |
+---------------+-----------+----------------+

And my manticore-Search conf is:

searchd {
    listen = 127.0.0.1:9312
    listen = 127.0.0.1:9306:mysql
    listen = 127.0.0.1:9308:http
    log = /var/log/manticore/searchd.log
    query_log = /var/log/manticore/query.log
    pid_file = /run/manticore/searchd.pid
    data_dir = /var/lib/manticore
    max_packet_size = 128M
    net_workers = 1024
    network_timeout = 60
    threads = 8
}

By the way, how to improve the QPS of Manticore Search? Currently, 10,000 concurrent requests are returned within 20 seconds—can it be even better?

Manticore Search Version:

Manticore 13.13.0 e5465fe44@25100704 (columnar 8.0.3 6d8ff91@25091005) (knn 8.0.3 6d8ff91@25091005) (embeddings 1.0.1)

Client Version:

10.0.0

Have you tried the latest development version of Manticore Search and the client?

None

Internal Checklist:

^{To be completed by the assignee. Check off tasks that have been completed or are not applicable.}

• Implementation completed
• Tests developed
• Documentation updated
• Documentation reviewed

[Nick-S-2018]

Blocked by manticoresoftware/manticoresearch#4004