[BUG] OpenSIPS with large number of interfaces doesn't start

[nikbyte]

Hello OpenSIPS team,

something between 09daaa2 and 64bed63 has happened in 3.1 branch. 09daaa2 with large number of interfaces starts without any issue, but 64bed63 produces next error:

May  7 09:16:36 [3591689] DBG:core:count_module_procs: modules require 1 extra processes
May  7 09:16:36 [-1] ERROR:core:create_ipc_pipes: failed to create IPC sync pipe for process 253, err 24/Too many open files
May  7 09:16:36 [-1] ERROR:core:init_multi_proc_support: failed to create IPC pipes, aborting
May  7 09:16:36 [-1] ERROR:core:main: failed to init multi-proc support

[razvancrainea]

@nikbyte try bumping your file description limit (ulimit -n) if you're starting from your cli, or bump the LimitNOFILE in your service.

[nikbyte]

@razvancrainea its LimitNOFILE=262144

[ovidiusas]

Do you have enough memory (both shared and private) to accommodate the reactor?

-ovidiu

On Wed, May 18, 2022 at 10:46 Nick Altmann ***@***.***> wrote: @razvancrainea <https://github.com/razvancrainea> its LimitNOFILE=262144 — Reply to this email directly, view it on GitHub <#2831 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABA2XP62YVV75DRH2NB3HIDVKT7DVANCNFSM5VKFPXNA> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

-- VoIP Embedded, Inc. http://www.voipembedded.com

[razvancrainea]

After further debugging, @nikbyte figured out that the main issue was that in OpenSIPS 3.1, libmicrohttpd was using the select poll mechanism, which is limited to 1024 file descriptors. Therefore, if other logic (listeners, rtpproxy/rtpengine sockets, db connections, etc) was creating more than 1024 file descriptors, the httpd would no longer work due to this limitation.
A proper fix is to have httpd use a more flexible polling mechanism. I've made an initial patch for this here:
httpd_epoll_3.1.txt
However, this is not complete, as it will not work with older versions of microhttpd, or with systems that do not have epoll - the code would not even compile. That is why we are postponing this until we:

• run further testing for the new patch
• exclude the epoll mechanism for system that do not support it (non-linux platforms)
• disable epoll for libmicrohttpd versions that do not support it

[github-actions]

Any updates here? No progress has been made in the last 15 days, marking as stale. Will close this issue if no further updates are made in the next 30 days.

[nikbyte]

not stale

[github-actions]

Any updates here? No progress has been made in the last 15 days, marking as stale. Will close this issue if no further updates are made in the next 30 days.

[nikbyte]

not stale

[github-actions]

Any updates here? No progress has been made in the last 15 days, marking as stale. Will close this issue if no further updates are made in the next 30 days.

[nikbyte]

not stale

[nikbyte]

Attached patch works, however MI answers with significant delay with this...

[github-actions]

Any updates here? No progress has been made in the last 15 days, marking as stale. Will close this issue if no further updates are made in the next 30 days.

[nikbyte]

still actual

[github-actions]

Any updates here? No progress has been made in the last 15 days, marking as stale. Will close this issue if no further updates are made in the next 30 days.

[nikbyte]

still actual

[github-actions]

Any updates here? No progress has been made in the last 15 days, marking as stale. Will close this issue if no further updates are made in the next 30 days.

[nikbyte]

still actual