FLUSH RAMCHUNK fails with "Too many open files" (rt_mem_limit 10GB)

[sanikolaev]

Bug Description:

flush ramchunk fails with Too many open files and a loss of the table when rt_mem_limit is 10 gigabytes.

The problem started in one of these 3 commits:

MRE

Config:

snikolaev@dev2:~$ cat configless.conf
searchd {
    listen = 9315:mysql
    listen = 9316
    log = searchd.log
    query_log = query.log
    pid_file = searchd.pid
    data_dir = data
    max_packet_size = 128M
}

Initialize the instance:

mkdir data

snikolaev@dev2:~$ searchd -c configless.conf
Manticore 6.2.13 53e7f8ad2@24051318 dev (columnar 2.2.5 0c18998@240424) (secondary 2.2.5 0c18998@240424) (knn 2.2.5 0c18998@240424)

Load data (find the archive in /home/snikolaev/name.sql.tgz on dev2), takes about a minute:

snikolaev@dev2:~$ mysql -P9315 -h0 < name.sql

snikolaev@dev2:~$ mysql -P9315 -h0 -e "flush ramchunk name"
ERROR 1064 (42000) at line 1: table 'name': FLUSH RAMCHUNK failed; TABLE UNUSABLE (error opening 'data/name/name.0.spidx.0.tmp': Too many open files)

The original table is lost:

snikolaev@dev2:~$ mysql -P9315 -h0 -e "show tables"
snikolaev@dev2:~$

Manticore Search Version:

6.2.13 068d2929a@24040513

Operating System Version:

Ubuntu Jammy (dev2)

Have you tried the latest development version?

• Yes

Internal Checklist:

^{To be completed by the assignee. Check off tasks that have been completed or are not applicable.}

• Task estimated
• Specification created, reviewed, and approved
• Implementation completed
• Tests developed
• Documentation updated
• Documentation proofread
• Changelog updated

[sanikolaev]

Done in d3e2a27 , but then reverted in fb10b87

[sanikolaev]

Done in 73ed035

[sanikolaev]

Changelog updated

No need as it's a recent issue.

[sanikolaev]

@glookka do we need a test for this functionality?

[glookka]

@glookka do we need a test for this functionality?

It would be hard to implement in our test suite. I would say we can skip it.