Crash on "Operating system call pthread_mutex_destroy failed. Error code 16" in log

[gerdus]

A production firebird server crashed twice over the weekend.
There is about 40 databases in use.

Error in firebird.log:
Operating system call pthread_mutex_destroy failed. Error code 16

Core dump available at https://infireal.com/github-issues/firebird-crash-2023-09-23/

Firebird version: LI-V4.0.3.2975 (binaries + debug symbols from firebird website)
OS: Ubuntu 22.04.3 LTS

[gerdus]

Crashed again today.
New core dumps available at https://infireal.com/github-issues/firebird-crash-2023-09-27/

Log:

     Wed Sep 27 12:49:49 2023
        Fatal lock manager error: Process disappeared in LockManager::acquire_shmem, errno: 0


     Wed Sep 27 12:50:25 2023
        /opt/firebird/bin/fbguard: /opt/firebird/bin/firebird terminated abnormally (-1)

     Wed Sep 27 13:45:44 2023
        Operating system call pthread_mutex_destroy failed. Error code 16


     Wed Sep 27 13:45:50 2023
        /opt/firebird/bin/fbguard: /opt/firebird/bin/firebird terminated abnormally (-1)

[AlexPeshkoff]

To inspect your core dump I need this files from your host:

ld-linux-x86-64.so.2
libc.so.6
libdl.so.2
libgcc_s.so.1
libm.so.6
libnss_files.so.2
libpthread.so.0
libthread_db.so.1
libstdc++.so.6

Most of them are symbolic links - certainly I need what they point too.

[gerdus]

Ok have uploaded them here: https://infireal.com/github-issues/firebird-crash-2023-09-27/lib.tar.gz

Thank you.

[AlexPeshkoff]

On 9/27/23 21:57, Gerdus van Zyl wrote: Ok have uploaded them here: https://infireal.com/github-issues/firebird-crash-2023-09-27/lib.tar.gz Thank you.

In the second dump I've found exact reason of a bug (i.e. more dumps with that bug are not needed). Hope to fix soon.

[AlexPeshkoff]

Try next snapshot (build >= 4.0.4-2997). Please reply the result (well understand it will be not earlier than a week or two).

[gerdus]

Thank you for looking into it so quickly. I will install the snapshot build this weekend and report back.

[gerdus]

It has been 7 days since I deployed the change and so far so good.

[gerdus]

There was a new crash today. Message in log is different but seems related.

Wed Oct 18 07:54:39 2023 Fatal lock manager error: Process disappeared in LockManager::acquire_shmem, errno: 22 --Invalid argument

Core dump: https://infireal.com/github-issues/firebird-crash-2023-10-18/

[AlexPeshkoff]

Please create new ticket - that's another bug

[AlexPeshkoff]

Also please send me snapshot you are using - w/o it core dump is useless