New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

segmentation fault with 3.0.x HEAD #1967

Open
alanbuxey opened this Issue Apr 22, 2017 · 4 comments

Comments

Projects
None yet
3 participants
@alanbuxey
Member

alanbuxey commented Apr 22, 2017

Issue type

  • Questions about the server or its usage should be posted to the users mailing list.
  • Remote security exploits MUST be sent to security@freeradius.org.
  • Defect - Crash or memory corruption.
  • Defect - Non compliance with a standards document, or incorrect API usage.
  • Defect - Unexpected behaviour (obvious or verified by project member).
  • Feature request.

See here for debugging instructions and how to obtain backtraces.

NOTE: PATCHES GO IN PULL REQUESTS. IF YOU SUBMIT A DIFF HERE, THE DEVELOPMENT TEAM WILL HUNT YOU DOWN AND BEAT YOU OVER THE HEAD WITH YOUR OWN KEYBOARD.

Defect/Feature description

How to reproduce issue

REMOVE SECTION IF FEATURE REQUEST

Output of [radiusd|freeradius] -X showing issue occurring

(you may need to run [radiusd|freeradius] -fxx -l stdout if using eg RADIUS with TLS)
REMOVE SECTION IF FEATURE REQUEST

...all normal , nothing seen at all, just this sort of stuff...and then

Fri Apr 21 08:00:28 2017 : Auth: (141)   Login OK: [user@domain] (from client client-1 port 0 via TLS tunnel)
Fri Apr 21 08:00:28 2017 : Info: rlm_ldap (ldap2): Deleting connection (15)
Fri Apr 21 08:00:28 2017 : Auth: (147) Login OK: [anonymous@domain] (from client client-1 port 8 cli 00-de-ad-00-be-ef)
Fri Apr 21 08:00:28 2017 : Info: rlm_ldap (ldap3): Deleting connection (12)
Fri Apr 21 08:00:28 2017 : Auth: (146)   Login OK: [host/machine1.local] (from client client-1 port 0 via TLS tunnel)
Fri Apr 21 08:00:28 2017 : Auth: (148) Login OK: [host/machine1.local] (from client client-1 port 8 cli aa-bb-cc-dd-ee-ff)
CAUGHT SIGNAL: Segmentation fault
Backtrace of last 18 frames:
/usr/lib/libfreeradius-radius.so(fr_fault+0x114)[0x7fbaa40993bc]
/lib64/libpthread.so.0(+0xf370)[0x7fbaa296b370]
/lib64/libc.so.6(+0x7c208)[0x7fbaa23e0208]
/lib64/libtalloc.so.2(+0xa0c4)[0x7fbaa361f0c4]
/lib64/libtalloc.so.2(+0xa01b)[0x7fbaa361f01b]
/lib64/libtalloc.so.2(+0xa01b)[0x7fbaa361f01b]
/lib64/libtalloc.so.2(+0xa01b)[0x7fbaa361f01b]
/lib64/libtalloc.so.2(_talloc_free+0x123)[0x7fbaa3618b63]
/usr/sbin/radiusd[0x43b800]
/usr/sbin/radiusd[0x43bf94]
/usr/sbin/radiusd[0x43c935]
/usr/sbin/radiusd[0x43b70d]
/usr/lib/libfreeradius-radius.so(fr_event_run+0x144)[0x7fbaa40c0688]
/usr/lib/libfreeradius-radius.so(fr_event_loop+0x4ed)[0x7fbaa40c0fa8]
/usr/sbin/radiusd(radius_event_process+0x26)[0x446d9d]
/usr/sbin/radiusd(main+0xc81)[0x431203]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7fbaa2385b35]
/usr/sbin/radiusd[0x40eb89]
Calling: gdb -silent -x /etc/raddb/panic.gdb /usr/sbin/radiusd 5321 2>&1 | tee /var/log/radius/gdb-radiusd-5321.log
Temporarily setting PR_DUMPABLE to 1
Resetting PR_DUMPABLE to 0
Panic action exited with 0
_EXIT(0) CALLED src/lib/debug.c[743]

Full backtrace from LLDB or GDB

REMOVE SECTION IF FEATURE REQUEST OR NOT CRASH/MEMORY CORRUPTION

more gdb-radiusd-5321.log

Reading symbols from /usr/sbin/radiusd...done.
Attaching to program: /usr/sbin/radiusd, process 5321
Reading symbols from /usr/lib/libfreeradius-server.so...done.
Loaded symbols for /usr/lib/libfreeradius-server.so
Reading symbols from /usr/lib/libfreeradius-radius.so...done.
Loaded symbols for /usr/lib/libfreeradius-radius.so
Reading symbols from /usr/lib/libfreeradius-eap.so...done.
Loaded symbols for /usr/lib/libfreeradius-eap.so
Reading symbols from /lib64/libcrypto.so.10...Reading symbols from /lib64/libcrypto.so.10...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypto.so.10
Reading symbols from /lib64/libssl.so.10...Reading symbols from /lib64/libssl.so.10...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libssl.so.10
Reading symbols from /lib64/libtalloc.so.2...Reading symbols from /lib64/libtalloc.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libtalloc.so.2
Reading symbols from /lib64/libpcre.so.1...Reading symbols from /lib64/libpcre.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpcre.so.1
Reading symbols from /lib64/libcap.so.2...Reading symbols from /lib64/libcap.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcap.so.2
Reading symbols from /lib64/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnsl.so.1
Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libresolv.so.2
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[New LWP 5450]
[New LWP 5449]
[New LWP 5448]
[New LWP 5447]
[New LWP 5446]
[New LWP 5445]
[New LWP 5444]
[New LWP 5443]
[New LWP 5442]
[New LWP 5441]
[New LWP 5440]
[New LWP 5439]
[New LWP 5438]
[New LWP 5437]
[New LWP 5436]
[New LWP 5435]
[New LWP 5434]
[New LWP 5433]
[New LWP 5432]
[New LWP 5431]
[New LWP 5430]
[New LWP 5429]
[New LWP 5428]
[New LWP 5427]
[New LWP 5426]
[New LWP 5425]
[New LWP 5424]
[New LWP 5423]
[New LWP 5422]
[New LWP 5421]
[New LWP 5420]
[New LWP 5419]
[New LWP 5418]
[New LWP 5417]
[New LWP 5416]
[New LWP 5415]
[New LWP 5414]
[New LWP 5413]
[New LWP 5412]
[New LWP 5411]
[New LWP 5410]
[New LWP 5409]
[New LWP 5408]
[New LWP 5407]
[New LWP 5406]
[New LWP 5405]
[New LWP 5404]
[New LWP 5403]
[New LWP 5402]
[New LWP 5401]
[New LWP 5400]
[New LWP 5399]
[New LWP 5398]
[New LWP 5397]
[New LWP 5396]
[New LWP 5395]
[New LWP 5394]
[New LWP 5393]
[New LWP 5392]
[New LWP 5391]
[New LWP 5390]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypt.so.1
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/libpcap.so.1...Reading symbols from /lib64/libpcap.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpcap.so.1
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib64/libz.so.1...Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libz.so.1
Reading symbols from /lib64/libgssapi_krb5.so.2...Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libgssapi_krb5.so.2
Reading symbols from /lib64/libkrb5.so.3...Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5.so.3
Reading symbols from /lib64/libcom_err.so.2...Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcom_err.so.2
Reading symbols from /lib64/libk5crypto.so.3...Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libk5crypto.so.3
Reading symbols from /lib64/libattr.so.1...Reading symbols from /lib64/libattr.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libattr.so.1
Reading symbols from /lib64/libfreebl3.so...Reading symbols from /lib64/libfreebl3.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libfreebl3.so
Reading symbols from /lib64/libkrb5support.so.0...Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5support.so.0
Reading symbols from /lib64/libkeyutils.so.1...Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkeyutils.so.1
Reading symbols from /lib64/libselinux.so.1...Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libselinux.so.1
Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_files.so.2
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1
Reading symbols from /usr/lib/rlm_utf8.so...done.
Loaded symbols for /usr/lib/rlm_utf8.so
Reading symbols from /usr/lib/rlm_unpack.so...done.
Loaded symbols for /usr/lib/rlm_unpack.so
Reading symbols from /usr/lib/rlm_ldap.so...done.
Loaded symbols for /usr/lib/rlm_ldap.so
Reading symbols from /usr/local/lib/libldap-2.4.so.2...done.
Loaded symbols for /usr/local/lib/libldap-2.4.so.2
Reading symbols from /usr/local/lib/liblber-2.4.so.2...done.
Loaded symbols for /usr/local/lib/liblber-2.4.so.2
Reading symbols from /lib64/libsasl2.so.3...Reading symbols from /lib64/libsasl2.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libsasl2.so.3
Reading symbols from /usr/lib/rlm_radutmp.so...done.
Loaded symbols for /usr/lib/rlm_radutmp.so
Reading symbols from /usr/lib/rlm_sql.so...done.
Loaded symbols for /usr/lib/rlm_sql.so
Reading symbols from /usr/lib/rlm_sql_postgresql.so...done.
Loaded symbols for /usr/lib/rlm_sql_postgresql.so
Reading symbols from /lib64/libpq.so.5...Reading symbols from /lib64/libpq.so.5...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpq.so.5
Reading symbols from /usr/local/lib/libldap_r-2.4.so.2...done.
Loaded symbols for /usr/local/lib/libldap_r-2.4.so.2
Reading symbols from /usr/lib/rlm_soh.so...done.
Loaded symbols for /usr/lib/rlm_soh.so
Reading symbols from /usr/lib/rlm_replicate.so...done.
Loaded symbols for /usr/lib/rlm_replicate.so
Reading symbols from /usr/lib/rlm_realm.so...done.
Loaded symbols for /usr/lib/rlm_realm.so
Reading symbols from /usr/lib/rlm_preprocess.so...done.
Loaded symbols for /usr/lib/rlm_preprocess.so
Reading symbols from /usr/lib/rlm_passwd.so...done.
Loaded symbols for /usr/lib/rlm_passwd.so
Reading symbols from /usr/lib/rlm_pap.so...done.
Loaded symbols for /usr/lib/rlm_pap.so
Reading symbols from /usr/lib/rlm_exec.so...done.
Loaded symbols for /usr/lib/rlm_exec.so
Reading symbols from /usr/lib/rlm_mschap.so...done.
Loaded symbols for /usr/lib/rlm_mschap.so
Reading symbols from /lib64/libwbclient.so.0...Missing separate debuginfo for /lib64/libwbclient.so.0
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/99/0861876f9c3654a17e71d271e832f4b42382cd.debug
Reading symbols from /lib64/libwbclient.so.0...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libwbclient.so.0
Reading symbols from /usr/lib64/samba/libwinbind-client-samba4.so...Reading symbols from /usr/lib64/samba/libwinbind-client-samba4.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/samba/libwinbind-client-samba4.so
Reading symbols from /usr/lib64/samba/libreplace-samba4.so...Reading symbols from /usr/lib64/samba/libreplace-samba4.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/samba/libreplace-samba4.so
Reading symbols from /usr/lib/rlm_logintime.so...done.
Loaded symbols for /usr/lib/rlm_logintime.so
Reading symbols from /usr/lib/rlm_linelog.so...done.
Loaded symbols for /usr/lib/rlm_linelog.so
Reading symbols from /usr/lib/rlm_krb5.so...done.
Loaded symbols for /usr/lib/rlm_krb5.so
Reading symbols from /usr/lib/rlm_eap.so...done.
Loaded symbols for /usr/lib/rlm_eap.so
Reading symbols from /usr/lib/rlm_files.so...done.
Loaded symbols for /usr/lib/rlm_files.so
Reading symbols from /usr/lib/rlm_expr.so...done.
Loaded symbols for /usr/lib/rlm_expr.so
Reading symbols from /usr/lib/rlm_expiration.so...done.
Loaded symbols for /usr/lib/rlm_expiration.so
Reading symbols from /usr/lib/rlm_dynamic_clients.so...done.
Loaded symbols for /usr/lib/rlm_dynamic_clients.so
Reading symbols from /usr/lib/rlm_digest.so...done.
Loaded symbols for /usr/lib/rlm_digest.so
Reading symbols from /usr/lib/rlm_dhcp.so...done.
Loaded symbols for /usr/lib/rlm_dhcp.so
Reading symbols from /usr/lib/libfreeradius-dhcp.so...done.
Loaded symbols for /usr/lib/libfreeradius-dhcp.so
Reading symbols from /usr/lib/rlm_detail.so...done.
Loaded symbols for /usr/lib/rlm_detail.so
Reading symbols from /usr/lib/rlm_chap.so...done.
Loaded symbols for /usr/lib/rlm_chap.so
Reading symbols from /usr/lib/rlm_cache.so...done.
Loaded symbols for /usr/lib/rlm_cache.so
Reading symbols from /usr/lib/rlm_attr_filter.so...done.
Loaded symbols for /usr/lib/rlm_attr_filter.so
Reading symbols from /usr/lib/rlm_always.so...done.
Loaded symbols for /usr/lib/rlm_always.so
Reading symbols from /lib64/libnss_dns.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_dns.so.2
Reading symbols from /usr/lib/rlm_eap_tls.so...done.
Loaded symbols for /usr/lib/rlm_eap_tls.so
Reading symbols from /usr/lib/rlm_eap_ttls.so...done.
Loaded symbols for /usr/lib/rlm_eap_ttls.so
Reading symbols from /usr/lib/rlm_eap_peap.so...done.
Loaded symbols for /usr/lib/rlm_eap_peap.so
Reading symbols from /usr/lib/rlm_eap_mschapv2.so...done.
Loaded symbols for /usr/lib/rlm_eap_mschapv2.so
Reading symbols from /usr/lib/rlm_cache_rbtree.so...done.
Loaded symbols for /usr/lib/rlm_cache_rbtree.so
0x00007fbaa24222c9 in waitpid () from /lib64/libc.so.6
No symbol table info available.
No symbol table info available.

Thread 62 (Thread 0x7fba98a41700 (LWP 5390)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b11e80)
    at src/main/threads.c:629
        self = 0x12b11e80
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 61 (Thread 0x7fba98240700 (LWP 5391)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b31260)
    at src/main/threads.c:629
        self = 0x12b31260
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 60 (Thread 0x7fba97a3f700 (LWP 5392)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b41bf0)
    at src/main/threads.c:629
        self = 0x12b41bf0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 59 (Thread 0x7fba9723e700 (LWP 5393)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b42290)
    at src/main/threads.c:629
        self = 0x12b42290
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 58 (Thread 0x7fba96a3d700 (LWP 5394)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b47870)
    at src/main/threads.c:629
        self = 0x12b47870
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 57 (Thread 0x7fba9623c700 (LWP 5395)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b49320)
    at src/main/threads.c:629
        self = 0x12b49320
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 56 (Thread 0x7fba95a3b700 (LWP 5396)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b52290)
    at src/main/threads.c:629
        self = 0x12b52290
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 55 (Thread 0x7fba9523a700 (LWP 5397)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b526e0)
    at src/main/threads.c:629
        self = 0x12b526e0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 54 (Thread 0x7fba94a39700 (LWP 5398)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b59a30)
    at src/main/threads.c:629
        self = 0x12b59a30
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 53 (Thread 0x7fba94238700 (LWP 5399)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b67dc0)
    at src/main/threads.c:629
        self = 0x12b67dc0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 52 (Thread 0x7fba93a37700 (LWP 5400)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b68210)
    at src/main/threads.c:629
        self = 0x12b68210
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 51 (Thread 0x7fba93236700 (LWP 5401)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b6dfe0)
    at src/main/threads.c:629
        self = 0x12b6dfe0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 50 (Thread 0x7fba92a35700 (LWP 5402)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b6f900)
    at src/main/threads.c:629
        self = 0x12b6f900
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 49 (Thread 0x7fba92234700 (LWP 5403)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b70300)
    at src/main/threads.c:629
        self = 0x12b70300
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 48 (Thread 0x7fba91a33700 (LWP 5404)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b72720)
    at src/main/threads.c:629
        self = 0x12b72720
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 47 (Thread 0x7fba91232700 (LWP 5405)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b73270)
    at src/main/threads.c:629
        self = 0x12b73270
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 46 (Thread 0x7fba90a31700 (LWP 5406)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b76480)
    at src/main/threads.c:629
        self = 0x12b76480
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 45 (Thread 0x7fba90230700 (LWP 5407)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b78400)
    at src/main/threads.c:629
        self = 0x12b78400
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 44 (Thread 0x7fba8fa2f700 (LWP 5408)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b79a40)
    at src/main/threads.c:629
        self = 0x12b79a40
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 43 (Thread 0x7fba8f22e700 (LWP 5409)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b7b890)
    at src/main/threads.c:629
        self = 0x12b7b890
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 42 (Thread 0x7fba8ea2d700 (LWP 5410)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b7ec90)
    at src/main/threads.c:629
        self = 0x12b7ec90
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 41 (Thread 0x7fba8e22c700 (LWP 5411)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b84970)
    at src/main/threads.c:629
        self = 0x12b84970
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 40 (Thread 0x7fba8da2b700 (LWP 5412)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b8c290)
    at src/main/threads.c:629
        self = 0x12b8c290
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 39 (Thread 0x7fba8d22a700 (LWP 5413)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b8c6e0)
    at src/main/threads.c:629
        self = 0x12b8c6e0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 38 (Thread 0x7fba8ca29700 (LWP 5414)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b92220)
    at src/main/threads.c:629
        self = 0x12b92220
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 37 (Thread 0x7fba8c228700 (LWP 5415)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b92d70)
    at src/main/threads.c:629
        self = 0x12b92d70
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 36 (Thread 0x7fba8ba27700 (LWP 5416)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b99c00)
    at src/main/threads.c:629
        self = 0x12b99c00
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 35 (Thread 0x7fba8b226700 (LWP 5417)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b9ca40)
    at src/main/threads.c:629
        self = 0x12b9ca40
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 34 (Thread 0x7fba8aa25700 (LWP 5418)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12ba1280)
    at src/main/threads.c:629
        self = 0x12ba1280
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 33 (Thread 0x7fba8a224700 (LWP 5419)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12ba5550)
    at src/main/threads.c:629
        self = 0x12ba5550
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 32 (Thread 0x7fba89a23700 (LWP 5420)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12ba9310)
    at src/main/threads.c:629
        self = 0x12ba9310
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 31 (Thread 0x7fba89222700 (LWP 5421)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bae680)
    at src/main/threads.c:629
        self = 0x12bae680
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 30 (Thread 0x7fba88a21700 (LWP 5422)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bb0a20)
    at src/main/threads.c:629
        self = 0x12bb0a20
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 29 (Thread 0x7fba88220700 (LWP 5423)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bb1de0)
    at src/main/threads.c:629
        self = 0x12bb1de0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 28 (Thread 0x7fba87a1f700 (LWP 5424)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bb5600)
    at src/main/threads.c:629
        self = 0x12bb5600
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 27 (Thread 0x7fba8721e700 (LWP 5425)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bb7210)
    at src/main/threads.c:629
        self = 0x12bb7210
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 26 (Thread 0x7fba86a1d700 (LWP 5426)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bba0c0)
    at src/main/threads.c:629
        self = 0x12bba0c0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 25 (Thread 0x7fba8621c700 (LWP 5427)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bbac10)
    at src/main/threads.c:629
        self = 0x12bbac10
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 24 (Thread 0x7fba85a1b700 (LWP 5428)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12af4790)
    at src/main/threads.c:629
        self = 0x12af4790
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 23 (Thread 0x7fba8521a700 (LWP 5429)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b40a00)
    at src/main/threads.c:629
        self = 0x12b40a00
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 22 (Thread 0x7fba84a19700 (LWP 5430)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b52b20)
    at src/main/threads.c:629
        self = 0x12b52b20
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 21 (Thread 0x7fba84218700 (LWP 5431)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b58c40)
    at src/main/threads.c:629
        self = 0x12b58c40
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 20 (Thread 0x7fba83a17700 (LWP 5432)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b60c90)
    at src/main/threads.c:629
        self = 0x12b60c90
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 19 (Thread 0x7fba83216700 (LWP 5433)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b68650)
    at src/main/threads.c:629
        self = 0x12b68650
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 18 (Thread 0x7fba82a15700 (LWP 5434)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b6c0e0)
    at src/main/threads.c:629
        self = 0x12b6c0e0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 17 (Thread 0x7fba82214700 (LWP 5435)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b755c0)
    at src/main/threads.c:629
        self = 0x12b755c0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 16 (Thread 0x7fba81a13700 (LWP 5436)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b76e80)
    at src/main/threads.c:629
        self = 0x12b76e80
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 15 (Thread 0x7fba81212700 (LWP 5437)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b7a480)
    at src/main/threads.c:629
        self = 0x12b7a480
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 14 (Thread 0x7fba80a11700 (LWP 5438)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b7f850)
    at src/main/threads.c:629
        self = 0x12b7f850
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 13 (Thread 0x7fba80210700 (LWP 5439)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b82b10)
    at src/main/threads.c:629
        self = 0x12b82b10
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 12 (Thread 0x7fba7fa0f700 (LWP 5440)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b88670)
    at src/main/threads.c:629
        self = 0x12b88670
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 11 (Thread 0x7fba7f20e700 (LWP 5441)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b8cb20)
    at src/main/threads.c:629
        self = 0x12b8cb20
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 10 (Thread 0x7fba7ea0d700 (LWP 5442)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b946e0)
    at src/main/threads.c:629
        self = 0x12b946e0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 9 (Thread 0x7fba7e20c700 (LWP 5443)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b95910)
    at src/main/threads.c:629
        self = 0x12b95910
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 8 (Thread 0x7fba7da0b700 (LWP 5444)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b968c0)
    at src/main/threads.c:629
        self = 0x12b968c0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 7 (Thread 0x7fba7d20a700 (LWP 5445)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b987f0)
    at src/main/threads.c:629
        self = 0x12b987f0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 6 (Thread 0x7fba7ca09700 (LWP 5446)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b9d600)
    at src/main/threads.c:629
        self = 0x12b9d600
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 5 (Thread 0x7fba7c208700 (LWP 5447)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b9fc90)
    at src/main/threads.c:629
        self = 0x12b9fc90
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 4 (Thread 0x7fba7ba07700 (LWP 5448)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12ba67e0)
    at src/main/threads.c:629
        self = 0x12ba67e0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 3 (Thread 0x7fba7b206700 (LWP 5449)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12ba98c0)
    at src/main/threads.c:629
        self = 0x12ba98c0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 2 (Thread 0x7fba7aa05700 (LWP 5450)):
#0  0x00007fbaa242266d in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fbaa24532c4 in usleep () from /lib64/libc.so.6
No symbol table info available.
#2  0x000000000044e85b in detail_handler_thread (arg=0x12bd73b0)
    at src/main/detail.c:1079
        packet = 0x0
        c = 0 '\000'
        this = 0x12bd73b0
        data = 0x12bd7500
#3  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 1 (Thread 0x7fbaa471c840 (LWP 5321)):
#0  0x00007fbaa24222c9 in waitpid () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fbaa23a5c72 in do_system () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007fbaa23a6021 in system () from /lib64/libc.so.6
No symbol table info available.
#3  0x00007fbaa4099578 in fr_fault (sig=11) at src/lib/debug.c:725
        disable = true
        cmd = "gdb -silent -x /etc/raddb/panic.gdb /usr/sbin/radiusd 5321 2>&1 | tee /var/log/radius/gdb-radiusd-5321.log", '\000' <repeats 425 times>
        out = 0x7fff72811446 ".log"
        left = 430
        ret = 44
        p = 0x7fbaa42d54a2 <panic_action+98> ".log"
        q = 0x0
        code = 0
#4  <signal handler called>
No symbol table info available.
#5  0x00007fbaa23e0208 in _int_free () from /lib64/libc.so.6
No symbol table info available.
#6  0x00007fbaa361f0c4 in _talloc_free_internal () from /lib64/libtalloc.so.2
No symbol table info available.
#7  0x00007fbaa361f01b in _talloc_free_internal () from /lib64/libtalloc.so.2
No symbol table info available.
#8  0x00007fbaa361f01b in _talloc_free_internal () from /lib64/libtalloc.so.2
No symbol table info available.
#9  0x00007fbaa361f01b in _talloc_free_internal () from /lib64/libtalloc.so.2
No symbol table info available.
#10 0x00007fbaa3618b63 in _talloc_free () from /lib64/libtalloc.so.2
No symbol table info available.
#11 0x000000000043b800 in request_free (request=0x9fc3560)
    at src/main/process.c:566
        ptr = 0x9fc3240
#12 0x000000000043bf94 in request_done (request=0x9fc3560, action=2)
    at src/main/process.c:814
        now = {tv_sec = 4621630028704, tv_usec = 4435457}
        when = {tv_sec = 245218208, tv_usec = 167523680}
#13 0x000000000043c935 in request_cleanup_delay (request=0x9fc3560, action=4)
    at src/main/process.c:1123
        when = {tv_sec = 1492761629, tv_usec = 124943}
        now = {tv_sec = 1492761629, tv_usec = 125048}
        __FUNCTION__ = "request_cleanup_delay"
#14 0x000000000043b70d in request_timer (ctx=0x9fc3560)
    at src/main/process.c:543
        request = 0x9fc3560
        action = 4
#15 0x00007fbaa40c0688 in fr_event_run (el=0xe8f7c0, when=0x7fff72812000)
    at src/lib/event.c:309
        callback = 0x43b6bd <request_timer>
        ctx = 0x9fc3560
        ev = 0x626de20
#16 0x00007fbaa40c0fa8 in fr_event_loop (el=0xe8f7c0) at src/lib/event.c:632
        i = 11
        rcode = 0
        when = {tv_sec = 1492761629, tv_usec = 125048}
        wake = 0x7fff72812000
        maxfd = 339
        read_fds = {fds_bits = {0 <repeats 16 times>}}
        master_fds = {fds_bits = {0, 0, 0, 0, 0, 933792, 0, 0, 0, 0, 0, 0, 0, 
            0, 0, 0}}
#17 0x0000000000446d9d in radius_event_process () at src/main/process.c:5667
No locals.
#18 0x0000000000431203 in main (argc=2, argv=0x7fff728121d8)
    at src/main/radiusd.c:585
        rcode = 0
        status = 32767
        argval = -1
        spawn_flag = true
        display_version = false
        flag = 0
        from_child = {4, 5}
        p = 0x7fff72812f92 "/radiusd"
        state = 0x680be0 <global_state>
        autofree = 0xa34090
A debugging session is active.

	Inferior 1 [process 5321] will be detached.

Quit anyway? (y or n) [answered Y; input not from terminal]
@arr2036

This comment has been minimized.

Show comment
Hide comment
@arr2036

arr2036 Apr 22, 2017

Member

I've seen this before. It'll be a double free somewhere, but it's impossible to track down unless you build both FreeRADIUS and talloc with debugging symbols.

Member

arr2036 commented Apr 22, 2017

I've seen this before. It'll be a double free somewhere, but it's impossible to track down unless you build both FreeRADIUS and talloc with debugging symbols.

@alanbuxey

This comment has been minimized.

Show comment
Hide comment
@alanbuxey

alanbuxey Apr 22, 2017

Member
Member

alanbuxey commented Apr 22, 2017

@arr2036

This comment has been minimized.

Show comment
Hide comment
@arr2036

arr2036 Apr 22, 2017

Member

Nope, that's fine, should be enough.

Member

arr2036 commented Apr 22, 2017

Nope, that's fine, should be enough.

@alanbuxey

This comment has been minimized.

Show comment
Hide comment
@alanbuxey

alanbuxey Apr 23, 2017

Member

okay...with the debugging info:

CAUGHT SIGNAL: Segmentation fault
Backtrace of last 18 frames:
/usr/lib/libfreeradius-radius.so(fr_fault+0x114)[0x7f3565c993bc]
/lib64/libpthread.so.0(+0xf370)[0x7f356456b370]
/lib64/libc.so.6(+0x7c208)[0x7f3563fe0208]
/lib64/libtalloc.so.2(+0xa0c4)[0x7f356521f0c4]
/lib64/libtalloc.so.2(+0xa01b)[0x7f356521f01b]
/lib64/libtalloc.so.2(+0xa01b)[0x7f356521f01b]
/lib64/libtalloc.so.2(+0xa01b)[0x7f356521f01b]
/lib64/libtalloc.so.2(_talloc_free+0x123)[0x7f3565218b63]
/usr/sbin/radiusd[0x43b800]
/usr/sbin/radiusd[0x43bf94]
/usr/sbin/radiusd[0x43c935]
/usr/sbin/radiusd[0x43b70d]
/usr/lib/libfreeradius-radius.so(fr_event_run+0x144)[0x7f3565cc0688]
/usr/lib/libfreeradius-radius.so(fr_event_loop+0x4ed)[0x7f3565cc0fa8]
/usr/sbin/radiusd(radius_event_process+0x26)[0x446d9d]
/usr/sbin/radiusd(main+0xc81)[0x431203]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f3563f85b35]
/usr/sbin/radiusd[0x40eb89]
Calling: gdb -silent -x /etc/raddb/panic.gdb /usr/sbin/radiusd 30248 2>&1 | tee /var/log/radius/gdb-radiusd-30248.log
Temporarily setting PR_DUMPABLE to 1
Resetting PR_DUMPABLE to 0
Panic action exited with 0
_EXIT(0) CALLED src/lib/debug.c[743]

and the gdb

cat /var/log/radius/gdb-radiusd-30248.log
Reading symbols from /usr/sbin/radiusd...done.
Attaching to program: /usr/sbin/radiusd, process 30248
Reading symbols from /usr/lib/libfreeradius-server.so...done.
Loaded symbols for /usr/lib/libfreeradius-server.so
Reading symbols from /usr/lib/libfreeradius-radius.so...done.
Loaded symbols for /usr/lib/libfreeradius-radius.so
Reading symbols from /usr/lib/libfreeradius-eap.so...done.
Loaded symbols for /usr/lib/libfreeradius-eap.so
Reading symbols from /lib64/libcrypto.so.10...Reading symbols from /lib64/libcrypto.so.10...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypto.so.10
Reading symbols from /lib64/libssl.so.10...Reading symbols from /lib64/libssl.so.10...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libssl.so.10
Reading symbols from /lib64/libtalloc.so.2...Reading symbols from /usr/lib/debug/usr/lib64/libtalloc.so.2.1.6.debug...done.
done.
Loaded symbols for /lib64/libtalloc.so.2
Reading symbols from /lib64/libpcre.so.1...Reading symbols from /lib64/libpcre.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpcre.so.1
Reading symbols from /lib64/libcap.so.2...Reading symbols from /lib64/libcap.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcap.so.2
Reading symbols from /lib64/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnsl.so.1
Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libresolv.so.2
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[New LWP 30380]
[New LWP 30378]
[New LWP 30377]
[New LWP 30376]
[New LWP 30375]
[New LWP 30374]
[New LWP 30373]
[New LWP 30372]
[New LWP 30371]
[New LWP 30370]
[New LWP 30369]
[New LWP 30368]
[New LWP 30367]
[New LWP 30366]
[New LWP 30365]
[New LWP 30364]
[New LWP 30363]
[New LWP 30362]
[New LWP 30361]
[New LWP 30360]
[New LWP 30359]
[New LWP 30358]
[New LWP 30357]
[New LWP 30356]
[New LWP 30355]
[New LWP 30354]
[New LWP 30353]
[New LWP 30352]
[New LWP 30351]
[New LWP 30350]
[New LWP 30349]
[New LWP 30348]
[New LWP 30347]
[New LWP 30346]
[New LWP 30345]
[New LWP 30344]
[New LWP 30343]
[New LWP 30342]
[New LWP 30341]
[New LWP 30340]
[New LWP 30339]
[New LWP 30338]
[New LWP 30337]
[New LWP 30336]
[New LWP 30335]
[New LWP 30334]
[New LWP 30333]
[New LWP 30332]
[New LWP 30331]
[New LWP 30330]
[New LWP 30329]
[New LWP 30328]
[New LWP 30327]
[New LWP 30326]
[New LWP 30325]
[New LWP 30324]
[New LWP 30323]
[New LWP 30322]
[New LWP 30321]
[New LWP 30320]
[New LWP 30319]
[New LWP 30318]
[New LWP 30317]
[New LWP 30316]
[New LWP 30315]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypt.so.1
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/libpcap.so.1...Reading symbols from /lib64/libpcap.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpcap.so.1
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib64/libz.so.1...Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libz.so.1
Reading symbols from /lib64/libgssapi_krb5.so.2...Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libgssapi_krb5.so.2
Reading symbols from /lib64/libkrb5.so.3...Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5.so.3
Reading symbols from /lib64/libcom_err.so.2...Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcom_err.so.2
Reading symbols from /lib64/libk5crypto.so.3...Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libk5crypto.so.3
Reading symbols from /lib64/libattr.so.1...Reading symbols from /lib64/libattr.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libattr.so.1
Reading symbols from /lib64/libfreebl3.so...Reading symbols from /lib64/libfreebl3.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libfreebl3.so
Reading symbols from /lib64/libkrb5support.so.0...Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5support.so.0
Reading symbols from /lib64/libkeyutils.so.1...Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkeyutils.so.1
Reading symbols from /lib64/libselinux.so.1...Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libselinux.so.1
Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_files.so.2
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1
Reading symbols from /usr/lib/rlm_utf8.so...done.
Loaded symbols for /usr/lib/rlm_utf8.so
Reading symbols from /usr/lib/rlm_unpack.so...done.
Loaded symbols for /usr/lib/rlm_unpack.so
Reading symbols from /usr/lib/rlm_ldap.so...done.
Loaded symbols for /usr/lib/rlm_ldap.so
Reading symbols from /usr/local/lib/libldap-2.4.so.2...done.
Loaded symbols for /usr/local/lib/libldap-2.4.so.2
Reading symbols from /usr/local/lib/liblber-2.4.so.2...done.
Loaded symbols for /usr/local/lib/liblber-2.4.so.2
Reading symbols from /lib64/libsasl2.so.3...Reading symbols from /lib64/libsasl2.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libsasl2.so.3
Reading symbols from /usr/lib/rlm_radutmp.so...done.
Loaded symbols for /usr/lib/rlm_radutmp.so
Reading symbols from /usr/lib/rlm_sql.so...done.
Loaded symbols for /usr/lib/rlm_sql.so
Reading symbols from /usr/lib/rlm_sql_postgresql.so...done.
Loaded symbols for /usr/lib/rlm_sql_postgresql.so
Reading symbols from /lib64/libpq.so.5...Reading symbols from /lib64/libpq.so.5...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpq.so.5
Reading symbols from /usr/local/lib/libldap_r-2.4.so.2...done.
Loaded symbols for /usr/local/lib/libldap_r-2.4.so.2
Reading symbols from /usr/lib/rlm_soh.so...done.
Loaded symbols for /usr/lib/rlm_soh.so
Reading symbols from /usr/lib/rlm_replicate.so...done.
Loaded symbols for /usr/lib/rlm_replicate.so
Reading symbols from /usr/lib/rlm_realm.so...done.
Loaded symbols for /usr/lib/rlm_realm.so
Reading symbols from /usr/lib/rlm_preprocess.so...done.
Loaded symbols for /usr/lib/rlm_preprocess.so
Reading symbols from /usr/lib/rlm_passwd.so...done.
Loaded symbols for /usr/lib/rlm_passwd.so
Reading symbols from /usr/lib/rlm_pap.so...done.
Loaded symbols for /usr/lib/rlm_pap.so
Reading symbols from /usr/lib/rlm_exec.so...done.
Loaded symbols for /usr/lib/rlm_exec.so
Reading symbols from /usr/lib/rlm_mschap.so...done.
Loaded symbols for /usr/lib/rlm_mschap.so
Reading symbols from /lib64/libwbclient.so.0...Missing separate debuginfo for /lib64/libwbclient.so.0
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/99/0861876f9c3654a17e71d271e832f4b42382cd.debug
Reading symbols from /lib64/libwbclient.so.0...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libwbclient.so.0
Reading symbols from /usr/lib64/samba/libwinbind-client-samba4.so...Reading symbols from /usr/lib64/samba/libwinbind-client-samba4.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/samba/libwinbind-client-samba4.so
Reading symbols from /usr/lib64/samba/libreplace-samba4.so...Reading symbols from /usr/lib64/samba/libreplace-samba4.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/samba/libreplace-samba4.so
Reading symbols from /usr/lib/rlm_logintime.so...done.
Loaded symbols for /usr/lib/rlm_logintime.so
Reading symbols from /usr/lib/rlm_linelog.so...done.
Loaded symbols for /usr/lib/rlm_linelog.so
Reading symbols from /usr/lib/rlm_krb5.so...done.
Loaded symbols for /usr/lib/rlm_krb5.so
Reading symbols from /usr/lib/rlm_eap.so...done.
Loaded symbols for /usr/lib/rlm_eap.so
Reading symbols from /usr/lib/rlm_files.so...done.
Loaded symbols for /usr/lib/rlm_files.so
Reading symbols from /usr/lib/rlm_expr.so...done.
Loaded symbols for /usr/lib/rlm_expr.so
Reading symbols from /usr/lib/rlm_expiration.so...done.
Loaded symbols for /usr/lib/rlm_expiration.so
Reading symbols from /usr/lib/rlm_dynamic_clients.so...done.
Loaded symbols for /usr/lib/rlm_dynamic_clients.so
Reading symbols from /usr/lib/rlm_digest.so...done.
Loaded symbols for /usr/lib/rlm_digest.so
Reading symbols from /usr/lib/rlm_dhcp.so...done.
Loaded symbols for /usr/lib/rlm_dhcp.so
Reading symbols from /usr/lib/libfreeradius-dhcp.so...done.
Loaded symbols for /usr/lib/libfreeradius-dhcp.so
Reading symbols from /usr/lib/rlm_detail.so...done.
Loaded symbols for /usr/lib/rlm_detail.so
Reading symbols from /usr/lib/rlm_chap.so...done.
Loaded symbols for /usr/lib/rlm_chap.so
Reading symbols from /usr/lib/rlm_cache.so...done.
Loaded symbols for /usr/lib/rlm_cache.so
Reading symbols from /usr/lib/rlm_attr_filter.so...done.
Loaded symbols for /usr/lib/rlm_attr_filter.so
Reading symbols from /usr/lib/rlm_always.so...done.
Loaded symbols for /usr/lib/rlm_always.so
Reading symbols from /lib64/libnss_dns.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_dns.so.2
Reading symbols from /usr/lib/rlm_eap_tls.so...done.
Loaded symbols for /usr/lib/rlm_eap_tls.so
Reading symbols from /usr/lib/rlm_eap_ttls.so...done.
Loaded symbols for /usr/lib/rlm_eap_ttls.so
Reading symbols from /usr/lib/rlm_eap_peap.so...done.
Loaded symbols for /usr/lib/rlm_eap_peap.so
Reading symbols from /usr/lib/rlm_eap_mschapv2.so...done.
Loaded symbols for /usr/lib/rlm_eap_mschapv2.so
Reading symbols from /usr/lib/rlm_cache_rbtree.so...done.
Loaded symbols for /usr/lib/rlm_cache_rbtree.so
0x00007f35640222c9 in waitpid () from /lib64/libc.so.6
No symbol table info available.
No symbol table info available.

Thread 66 (Thread 0x7f355c645700 (LWP 30315)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1344e6f0)
    at src/main/threads.c:629
        self = 0x1344e6f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 65 (Thread 0x7f355be44700 (LWP 30316)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134501a0)
    at src/main/threads.c:629
        self = 0x134501a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 64 (Thread 0x7f355b643700 (LWP 30317)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13481130)
    at src/main/threads.c:629
        self = 0x13481130
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 63 (Thread 0x7f355ae42700 (LWP 30318)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13482be0)
    at src/main/threads.c:629
        self = 0x13482be0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 62 (Thread 0x7f355a641700 (LWP 30319)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134a1fc0)
    at src/main/threads.c:629
        self = 0x134a1fc0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 61 (Thread 0x7f3559e40700 (LWP 30320)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b2950)
    at src/main/threads.c:629
        self = 0x134b2950
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 60 (Thread 0x7f355963f700 (LWP 30321)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b2ff0)
    at src/main/threads.c:629
        self = 0x134b2ff0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 59 (Thread 0x7f3558e3e700 (LWP 30322)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b85d0)
    at src/main/threads.c:629
        self = 0x134b85d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 58 (Thread 0x7f355863d700 (LWP 30323)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ba080)
    at src/main/threads.c:629
        self = 0x134ba080
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 57 (Thread 0x7f3557e3c700 (LWP 30324)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c2ff0)
    at src/main/threads.c:629
        self = 0x134c2ff0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 56 (Thread 0x7f355763b700 (LWP 30325)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c3440)
    at src/main/threads.c:629
        self = 0x134c3440
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 55 (Thread 0x7f3556e3a700 (LWP 30326)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ca790)
    at src/main/threads.c:629
        self = 0x134ca790
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 54 (Thread 0x7f3556639700 (LWP 30327)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d8b20)
    at src/main/threads.c:629
        self = 0x134d8b20
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 53 (Thread 0x7f3555e38700 (LWP 30328)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d8f70)
    at src/main/threads.c:629
        self = 0x134d8f70
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 52 (Thread 0x7f3555637700 (LWP 30329)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ded40)
    at src/main/threads.c:629
        self = 0x134ded40
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 51 (Thread 0x7f3554e36700 (LWP 30330)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e0660)
    at src/main/threads.c:629
        self = 0x134e0660
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 50 (Thread 0x7f3554635700 (LWP 30331)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e1060)
    at src/main/threads.c:629
        self = 0x134e1060
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 49 (Thread 0x7f3553e34700 (LWP 30332)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e3480)
    at src/main/threads.c:629
        self = 0x134e3480
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 48 (Thread 0x7f3553633700 (LWP 30333)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e3fd0)
    at src/main/threads.c:629
        self = 0x134e3fd0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 47 (Thread 0x7f3552e32700 (LWP 30334)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e71e0)
    at src/main/threads.c:629
        self = 0x134e71e0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 46 (Thread 0x7f3552631700 (LWP 30335)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e9160)
    at src/main/threads.c:629
        self = 0x134e9160
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 45 (Thread 0x7f3551e30700 (LWP 30336)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ea7a0)
    at src/main/threads.c:629
        self = 0x134ea7a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 44 (Thread 0x7f355162f700 (LWP 30337)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ec5f0)
    at src/main/threads.c:629
        self = 0x134ec5f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 43 (Thread 0x7f3550e2e700 (LWP 30338)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ef9f0)
    at src/main/threads.c:629
        self = 0x134ef9f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 42 (Thread 0x7f355062d700 (LWP 30339)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f56d0)
    at src/main/threads.c:629
        self = 0x134f56d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 41 (Thread 0x7f354fe2c700 (LWP 30340)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134fcff0)
    at src/main/threads.c:629
        self = 0x134fcff0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 40 (Thread 0x7f354f62b700 (LWP 30341)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134fd440)
    at src/main/threads.c:629
        self = 0x134fd440
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 39 (Thread 0x7f354ee2a700 (LWP 30342)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13502f80)
    at src/main/threads.c:629
        self = 0x13502f80
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 38 (Thread 0x7f354e629700 (LWP 30343)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13503ad0)
    at src/main/threads.c:629
        self = 0x13503ad0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 37 (Thread 0x7f354de28700 (LWP 30344)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1350a960)
    at src/main/threads.c:629
        self = 0x1350a960
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 36 (Thread 0x7f354d627700 (LWP 30345)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1350d7a0)
    at src/main/threads.c:629
        self = 0x1350d7a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 35 (Thread 0x7f354ce26700 (LWP 30346)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13511fe0)
    at src/main/threads.c:629
        self = 0x13511fe0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 34 (Thread 0x7f354c625700 (LWP 30347)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x135165d0)
    at src/main/threads.c:629
        self = 0x135165d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 33 (Thread 0x7f354be24700 (LWP 30348)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351a390)
    at src/main/threads.c:629
        self = 0x1351a390
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 32 (Thread 0x7f354b623700 (LWP 30349)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351f700)
    at src/main/threads.c:629
        self = 0x1351f700
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 31 (Thread 0x7f354ae22700 (LWP 30350)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13521aa0)
    at src/main/threads.c:629
        self = 0x13521aa0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 30 (Thread 0x7f354a621700 (LWP 30351)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13522e60)
    at src/main/threads.c:629
        self = 0x13522e60
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 29 (Thread 0x7f3549e20700 (LWP 30352)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13526680)
    at src/main/threads.c:629
        self = 0x13526680
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 28 (Thread 0x7f354961f700 (LWP 30353)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13528290)
    at src/main/threads.c:629
        self = 0x13528290
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 27 (Thread 0x7f3548e1e700 (LWP 30354)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1352b140)
    at src/main/threads.c:629
        self = 0x1352b140
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 26 (Thread 0x7f354861d700 (LWP 30355)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1352bc90)
    at src/main/threads.c:629
        self = 0x1352bc90
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 25 (Thread 0x7f3547e1c700 (LWP 30356)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13465270)
    at src/main/threads.c:629
        self = 0x13465270
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 24 (Thread 0x7f354761b700 (LWP 30357)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b1760)
    at src/main/threads.c:629
        self = 0x134b1760
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 23 (Thread 0x7f3546e1a700 (LWP 30358)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c3880)
    at src/main/threads.c:629
        self = 0x134c3880
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 22 (Thread 0x7f3546619700 (LWP 30359)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c99a0)
    at src/main/threads.c:629
        self = 0x134c99a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 21 (Thread 0x7f3545e18700 (LWP 30360)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d19f0)
    at src/main/threads.c:629
        self = 0x134d19f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 20 (Thread 0x7f3545617700 (LWP 30361)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d93b0)
    at src/main/threads.c:629
        self = 0x134d93b0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 19 (Thread 0x7f3544e16700 (LWP 30362)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134dce40)
    at src/main/threads.c:629
        self = 0x134dce40
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 18 (Thread 0x7f3544615700 (LWP 30363)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e6320)
    at src/main/threads.c:629
        self = 0x134e6320
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 17 (Thread 0x7f3543e14700 (LWP 30364)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e7be0)
    at src/main/threads.c:629
        self = 0x134e7be0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 16 (Thread 0x7f3543613700 (LWP 30365)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134eb1e0)
    at src/main/threads.c:629
        self = 0x134eb1e0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 15 (Thread 0x7f3542e12700 (LWP 30366)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f05b0)
    at src/main/threads.c:629
        self = 0x134f05b0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 14 (Thread 0x7f3542611700 (LWP 30367)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f3870)
    at src/main/threads.c:629
        self = 0x134f3870
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 13 (Thread 0x7f3541e10700 (LWP 30368)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f93d0)
    at src/main/threads.c:629
        self = 0x134f93d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 12 (Thread 0x7f354160f700 (LWP 30369)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134fd880)
    at src/main/threads.c:629
        self = 0x134fd880
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 11 (Thread 0x7f3540e0e700 (LWP 30370)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13505440)
    at src/main/threads.c:629
        self = 0x13505440
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 10 (Thread 0x7f354060d700 (LWP 30371)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13506670)
    at src/main/threads.c:629
        self = 0x13506670
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 9 (Thread 0x7f353fe0c700 (LWP 30372)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13507620)
    at src/main/threads.c:629
        self = 0x13507620
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 8 (Thread 0x7f353f60b700 (LWP 30373)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13509550)
    at src/main/threads.c:629
        self = 0x13509550
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 7 (Thread 0x7f353ee0a700 (LWP 30374)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1350e360)
    at src/main/threads.c:629
        self = 0x1350e360
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 6 (Thread 0x7f353e609700 (LWP 30375)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x135109f0)
    at src/main/threads.c:629
        self = 0x135109f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 5 (Thread 0x7f353de08700 (LWP 30376)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13517860)
    at src/main/threads.c:629
        self = 0x13517860
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 4 (Thread 0x7f353d607700 (LWP 30377)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351a940)
    at src/main/threads.c:629
        self = 0x1351a940
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 3 (Thread 0x7f353ce06700 (LWP 30378)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351ad90)
    at src/main/threads.c:629
        self = 0x1351ad90
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 2 (Thread 0x7f353c605700 (LWP 30380)):
#0  0x00007f356402266d in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007f35640532c4 in usleep () from /lib64/libc.so.6
No symbol table info available.
#2  0x000000000044e85b in detail_handler_thread (arg=0x13547c20)
    at src/main/detail.c:1079
        packet = 0x0
        c = 0 '\000'
        this = 0x13547c20
        data = 0x13547d70
#3  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 1 (Thread 0x7f356631c840 (LWP 30248)):
#0  0x00007f35640222c9 in waitpid () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007f3563fa5c72 in do_system () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007f3563fa6021 in system () from /lib64/libc.so.6
No symbol table info available.
#3  0x00007f3565c99578 in fr_fault (sig=11) at src/lib/debug.c:725
        disable = true
        cmd = "gdb -silent -x /etc/raddb/panic.gdb /usr/sbin/radiusd 30248 2>&1 | tee /var/log/radius/gdb-radiusd-30248.log", '\000' <repeats 423 times>
        out = 0x7ffc8d576108 ".log"
        left = 428
        ret = 45
        p = 0x7f3565ed54a2 <panic_action+98> ".log"
        q = 0x0
        code = 0
#4  <signal handler called>
No symbol table info available.
#5  0x00007f3563fe0208 in _int_free () from /lib64/libc.so.6
No symbol table info available.
#6  0x00007f356521f0c4 in _talloc_free_internal (ptr=<optimized out>, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1116
        ptr_to_free = <optimized out>
#7  0x00007f356521f01b in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x7f34a8002860, 
    tc=0x7f34a8002800) at ../talloc.c:1525
        child = 0x7f34a8002920
        new_parent = 0x0
#8  _talloc_free_internal (ptr=0x7f34a8002860, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1072
        ptr_to_free = <optimized out>
#9  0x00007f356521f01b in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x12f90e30, tc=0x12f90dd0)
    at ../talloc.c:1525
        child = 0x7f34a8002860
        new_parent = 0x0
#10 _talloc_free_internal (ptr=0x12f90e30, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1072
        ptr_to_free = <optimized out>
#11 0x00007f356521f01b in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x12f910f0, tc=0x12f91090)
    at ../talloc.c:1525
        child = 0x12f90e30
        new_parent = 0x0
#12 _talloc_free_internal (ptr=0x12f910f0, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1072
        ptr_to_free = <optimized out>
#13 0x00007f3565218b63 in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x12f90dd0, tc=0x12f90d70)
    at ../talloc.c:1525
        child = 0x12f910f0
        new_parent = 0x0
#14 _talloc_free_internal (location=<optimized out>, ptr=<optimized out>)
    at ../talloc.c:1072
        ptr_to_free = <optimized out>
#15 _talloc_free (ptr=0x12f90dd0, location=0x46aed6 "src/main/process.c:566")
    at ../talloc.c:1647
No locals.
#16 0x000000000043b800 in request_free (request=0x12f910f0)
    at src/main/process.c:566
        ptr = 0x12f90dd0
#17 0x000000000043bf94 in request_done (request=0x12f910f0, action=2)
    at src/main/process.c:814
        now = {tv_sec = 4621557231520, tv_usec = 4435457}
        when = {tv_sec = 172421024, tv_usec = 318312688}
#18 0x000000000043c935 in request_cleanup_delay (request=0x12f910f0, action=4)
    at src/main/process.c:1123
        when = {tv_sec = 1492889274, tv_usec = 457163}
        now = {tv_sec = 1492889274, tv_usec = 457273}
        __FUNCTION__ = "request_cleanup_delay"
#19 0x000000000043b70d in request_timer (ctx=0x12f910f0)
    at src/main/process.c:543
        request = 0x12f910f0
        action = 4
#20 0x00007f3565cc0688 in fr_event_run (el=0x1800930, when=0x7ffc8d576cc0)
    at src/lib/event.c:309
        callback = 0x43b6bd <request_timer>
        ctx = 0x12f910f0
        ev = 0x12fc75b0
#21 0x00007f3565cc0fa8 in fr_event_loop (el=0x1800930) at src/lib/event.c:632
        i = 11
        rcode = 0
        when = {tv_sec = 1492889274, tv_usec = 457273}
        wake = 0x7ffc8d576cc0
        maxfd = 339
        read_fds = {fds_bits = {0 <repeats 16 times>}}
        master_fds = {fds_bits = {0, 0, 0, 0, 0, 933792, 0, 0, 0, 0, 0, 0, 0, 
            0, 0, 0}}
#22 0x0000000000446d9d in radius_event_process () at src/main/process.c:5667
No locals.
#23 0x0000000000431203 in main (argc=2, argv=0x7ffc8d576e98)
    at src/main/radiusd.c:585
        rcode = 0
        status = 32764
        argval = -1
        spawn_flag = true
        display_version = false
        flag = 0
        from_child = {4, 5}
        p = 0x7ffc8d577f92 "/radiusd"
        state = 0x680be0 <global_state>
        autofree = 0x13a2090
A debugging session is active.

	Inferior 1 [process 30248] will be detached.

Quit anyway? (y or n) [answered Y; input not from terminal]
Member

alanbuxey commented Apr 23, 2017

okay...with the debugging info:

CAUGHT SIGNAL: Segmentation fault
Backtrace of last 18 frames:
/usr/lib/libfreeradius-radius.so(fr_fault+0x114)[0x7f3565c993bc]
/lib64/libpthread.so.0(+0xf370)[0x7f356456b370]
/lib64/libc.so.6(+0x7c208)[0x7f3563fe0208]
/lib64/libtalloc.so.2(+0xa0c4)[0x7f356521f0c4]
/lib64/libtalloc.so.2(+0xa01b)[0x7f356521f01b]
/lib64/libtalloc.so.2(+0xa01b)[0x7f356521f01b]
/lib64/libtalloc.so.2(+0xa01b)[0x7f356521f01b]
/lib64/libtalloc.so.2(_talloc_free+0x123)[0x7f3565218b63]
/usr/sbin/radiusd[0x43b800]
/usr/sbin/radiusd[0x43bf94]
/usr/sbin/radiusd[0x43c935]
/usr/sbin/radiusd[0x43b70d]
/usr/lib/libfreeradius-radius.so(fr_event_run+0x144)[0x7f3565cc0688]
/usr/lib/libfreeradius-radius.so(fr_event_loop+0x4ed)[0x7f3565cc0fa8]
/usr/sbin/radiusd(radius_event_process+0x26)[0x446d9d]
/usr/sbin/radiusd(main+0xc81)[0x431203]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f3563f85b35]
/usr/sbin/radiusd[0x40eb89]
Calling: gdb -silent -x /etc/raddb/panic.gdb /usr/sbin/radiusd 30248 2>&1 | tee /var/log/radius/gdb-radiusd-30248.log
Temporarily setting PR_DUMPABLE to 1
Resetting PR_DUMPABLE to 0
Panic action exited with 0
_EXIT(0) CALLED src/lib/debug.c[743]

and the gdb

cat /var/log/radius/gdb-radiusd-30248.log
Reading symbols from /usr/sbin/radiusd...done.
Attaching to program: /usr/sbin/radiusd, process 30248
Reading symbols from /usr/lib/libfreeradius-server.so...done.
Loaded symbols for /usr/lib/libfreeradius-server.so
Reading symbols from /usr/lib/libfreeradius-radius.so...done.
Loaded symbols for /usr/lib/libfreeradius-radius.so
Reading symbols from /usr/lib/libfreeradius-eap.so...done.
Loaded symbols for /usr/lib/libfreeradius-eap.so
Reading symbols from /lib64/libcrypto.so.10...Reading symbols from /lib64/libcrypto.so.10...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypto.so.10
Reading symbols from /lib64/libssl.so.10...Reading symbols from /lib64/libssl.so.10...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libssl.so.10
Reading symbols from /lib64/libtalloc.so.2...Reading symbols from /usr/lib/debug/usr/lib64/libtalloc.so.2.1.6.debug...done.
done.
Loaded symbols for /lib64/libtalloc.so.2
Reading symbols from /lib64/libpcre.so.1...Reading symbols from /lib64/libpcre.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpcre.so.1
Reading symbols from /lib64/libcap.so.2...Reading symbols from /lib64/libcap.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcap.so.2
Reading symbols from /lib64/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnsl.so.1
Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libresolv.so.2
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[New LWP 30380]
[New LWP 30378]
[New LWP 30377]
[New LWP 30376]
[New LWP 30375]
[New LWP 30374]
[New LWP 30373]
[New LWP 30372]
[New LWP 30371]
[New LWP 30370]
[New LWP 30369]
[New LWP 30368]
[New LWP 30367]
[New LWP 30366]
[New LWP 30365]
[New LWP 30364]
[New LWP 30363]
[New LWP 30362]
[New LWP 30361]
[New LWP 30360]
[New LWP 30359]
[New LWP 30358]
[New LWP 30357]
[New LWP 30356]
[New LWP 30355]
[New LWP 30354]
[New LWP 30353]
[New LWP 30352]
[New LWP 30351]
[New LWP 30350]
[New LWP 30349]
[New LWP 30348]
[New LWP 30347]
[New LWP 30346]
[New LWP 30345]
[New LWP 30344]
[New LWP 30343]
[New LWP 30342]
[New LWP 30341]
[New LWP 30340]
[New LWP 30339]
[New LWP 30338]
[New LWP 30337]
[New LWP 30336]
[New LWP 30335]
[New LWP 30334]
[New LWP 30333]
[New LWP 30332]
[New LWP 30331]
[New LWP 30330]
[New LWP 30329]
[New LWP 30328]
[New LWP 30327]
[New LWP 30326]
[New LWP 30325]
[New LWP 30324]
[New LWP 30323]
[New LWP 30322]
[New LWP 30321]
[New LWP 30320]
[New LWP 30319]
[New LWP 30318]
[New LWP 30317]
[New LWP 30316]
[New LWP 30315]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypt.so.1
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/libpcap.so.1...Reading symbols from /lib64/libpcap.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpcap.so.1
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib64/libz.so.1...Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libz.so.1
Reading symbols from /lib64/libgssapi_krb5.so.2...Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libgssapi_krb5.so.2
Reading symbols from /lib64/libkrb5.so.3...Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5.so.3
Reading symbols from /lib64/libcom_err.so.2...Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcom_err.so.2
Reading symbols from /lib64/libk5crypto.so.3...Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libk5crypto.so.3
Reading symbols from /lib64/libattr.so.1...Reading symbols from /lib64/libattr.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libattr.so.1
Reading symbols from /lib64/libfreebl3.so...Reading symbols from /lib64/libfreebl3.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libfreebl3.so
Reading symbols from /lib64/libkrb5support.so.0...Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5support.so.0
Reading symbols from /lib64/libkeyutils.so.1...Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkeyutils.so.1
Reading symbols from /lib64/libselinux.so.1...Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libselinux.so.1
Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_files.so.2
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1
Reading symbols from /usr/lib/rlm_utf8.so...done.
Loaded symbols for /usr/lib/rlm_utf8.so
Reading symbols from /usr/lib/rlm_unpack.so...done.
Loaded symbols for /usr/lib/rlm_unpack.so
Reading symbols from /usr/lib/rlm_ldap.so...done.
Loaded symbols for /usr/lib/rlm_ldap.so
Reading symbols from /usr/local/lib/libldap-2.4.so.2...done.
Loaded symbols for /usr/local/lib/libldap-2.4.so.2
Reading symbols from /usr/local/lib/liblber-2.4.so.2...done.
Loaded symbols for /usr/local/lib/liblber-2.4.so.2
Reading symbols from /lib64/libsasl2.so.3...Reading symbols from /lib64/libsasl2.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libsasl2.so.3
Reading symbols from /usr/lib/rlm_radutmp.so...done.
Loaded symbols for /usr/lib/rlm_radutmp.so
Reading symbols from /usr/lib/rlm_sql.so...done.
Loaded symbols for /usr/lib/rlm_sql.so
Reading symbols from /usr/lib/rlm_sql_postgresql.so...done.
Loaded symbols for /usr/lib/rlm_sql_postgresql.so
Reading symbols from /lib64/libpq.so.5...Reading symbols from /lib64/libpq.so.5...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpq.so.5
Reading symbols from /usr/local/lib/libldap_r-2.4.so.2...done.
Loaded symbols for /usr/local/lib/libldap_r-2.4.so.2
Reading symbols from /usr/lib/rlm_soh.so...done.
Loaded symbols for /usr/lib/rlm_soh.so
Reading symbols from /usr/lib/rlm_replicate.so...done.
Loaded symbols for /usr/lib/rlm_replicate.so
Reading symbols from /usr/lib/rlm_realm.so...done.
Loaded symbols for /usr/lib/rlm_realm.so
Reading symbols from /usr/lib/rlm_preprocess.so...done.
Loaded symbols for /usr/lib/rlm_preprocess.so
Reading symbols from /usr/lib/rlm_passwd.so...done.
Loaded symbols for /usr/lib/rlm_passwd.so
Reading symbols from /usr/lib/rlm_pap.so...done.
Loaded symbols for /usr/lib/rlm_pap.so
Reading symbols from /usr/lib/rlm_exec.so...done.
Loaded symbols for /usr/lib/rlm_exec.so
Reading symbols from /usr/lib/rlm_mschap.so...done.
Loaded symbols for /usr/lib/rlm_mschap.so
Reading symbols from /lib64/libwbclient.so.0...Missing separate debuginfo for /lib64/libwbclient.so.0
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/99/0861876f9c3654a17e71d271e832f4b42382cd.debug
Reading symbols from /lib64/libwbclient.so.0...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libwbclient.so.0
Reading symbols from /usr/lib64/samba/libwinbind-client-samba4.so...Reading symbols from /usr/lib64/samba/libwinbind-client-samba4.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/samba/libwinbind-client-samba4.so
Reading symbols from /usr/lib64/samba/libreplace-samba4.so...Reading symbols from /usr/lib64/samba/libreplace-samba4.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/samba/libreplace-samba4.so
Reading symbols from /usr/lib/rlm_logintime.so...done.
Loaded symbols for /usr/lib/rlm_logintime.so
Reading symbols from /usr/lib/rlm_linelog.so...done.
Loaded symbols for /usr/lib/rlm_linelog.so
Reading symbols from /usr/lib/rlm_krb5.so...done.
Loaded symbols for /usr/lib/rlm_krb5.so
Reading symbols from /usr/lib/rlm_eap.so...done.
Loaded symbols for /usr/lib/rlm_eap.so
Reading symbols from /usr/lib/rlm_files.so...done.
Loaded symbols for /usr/lib/rlm_files.so
Reading symbols from /usr/lib/rlm_expr.so...done.
Loaded symbols for /usr/lib/rlm_expr.so
Reading symbols from /usr/lib/rlm_expiration.so...done.
Loaded symbols for /usr/lib/rlm_expiration.so
Reading symbols from /usr/lib/rlm_dynamic_clients.so...done.
Loaded symbols for /usr/lib/rlm_dynamic_clients.so
Reading symbols from /usr/lib/rlm_digest.so...done.
Loaded symbols for /usr/lib/rlm_digest.so
Reading symbols from /usr/lib/rlm_dhcp.so...done.
Loaded symbols for /usr/lib/rlm_dhcp.so
Reading symbols from /usr/lib/libfreeradius-dhcp.so...done.
Loaded symbols for /usr/lib/libfreeradius-dhcp.so
Reading symbols from /usr/lib/rlm_detail.so...done.
Loaded symbols for /usr/lib/rlm_detail.so
Reading symbols from /usr/lib/rlm_chap.so...done.
Loaded symbols for /usr/lib/rlm_chap.so
Reading symbols from /usr/lib/rlm_cache.so...done.
Loaded symbols for /usr/lib/rlm_cache.so
Reading symbols from /usr/lib/rlm_attr_filter.so...done.
Loaded symbols for /usr/lib/rlm_attr_filter.so
Reading symbols from /usr/lib/rlm_always.so...done.
Loaded symbols for /usr/lib/rlm_always.so
Reading symbols from /lib64/libnss_dns.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_dns.so.2
Reading symbols from /usr/lib/rlm_eap_tls.so...done.
Loaded symbols for /usr/lib/rlm_eap_tls.so
Reading symbols from /usr/lib/rlm_eap_ttls.so...done.
Loaded symbols for /usr/lib/rlm_eap_ttls.so
Reading symbols from /usr/lib/rlm_eap_peap.so...done.
Loaded symbols for /usr/lib/rlm_eap_peap.so
Reading symbols from /usr/lib/rlm_eap_mschapv2.so...done.
Loaded symbols for /usr/lib/rlm_eap_mschapv2.so
Reading symbols from /usr/lib/rlm_cache_rbtree.so...done.
Loaded symbols for /usr/lib/rlm_cache_rbtree.so
0x00007f35640222c9 in waitpid () from /lib64/libc.so.6
No symbol table info available.
No symbol table info available.

Thread 66 (Thread 0x7f355c645700 (LWP 30315)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1344e6f0)
    at src/main/threads.c:629
        self = 0x1344e6f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 65 (Thread 0x7f355be44700 (LWP 30316)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134501a0)
    at src/main/threads.c:629
        self = 0x134501a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 64 (Thread 0x7f355b643700 (LWP 30317)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13481130)
    at src/main/threads.c:629
        self = 0x13481130
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 63 (Thread 0x7f355ae42700 (LWP 30318)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13482be0)
    at src/main/threads.c:629
        self = 0x13482be0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 62 (Thread 0x7f355a641700 (LWP 30319)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134a1fc0)
    at src/main/threads.c:629
        self = 0x134a1fc0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 61 (Thread 0x7f3559e40700 (LWP 30320)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b2950)
    at src/main/threads.c:629
        self = 0x134b2950
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 60 (Thread 0x7f355963f700 (LWP 30321)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b2ff0)
    at src/main/threads.c:629
        self = 0x134b2ff0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 59 (Thread 0x7f3558e3e700 (LWP 30322)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b85d0)
    at src/main/threads.c:629
        self = 0x134b85d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 58 (Thread 0x7f355863d700 (LWP 30323)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ba080)
    at src/main/threads.c:629
        self = 0x134ba080
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 57 (Thread 0x7f3557e3c700 (LWP 30324)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c2ff0)
    at src/main/threads.c:629
        self = 0x134c2ff0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 56 (Thread 0x7f355763b700 (LWP 30325)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c3440)
    at src/main/threads.c:629
        self = 0x134c3440
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 55 (Thread 0x7f3556e3a700 (LWP 30326)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ca790)
    at src/main/threads.c:629
        self = 0x134ca790
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 54 (Thread 0x7f3556639700 (LWP 30327)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d8b20)
    at src/main/threads.c:629
        self = 0x134d8b20
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 53 (Thread 0x7f3555e38700 (LWP 30328)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d8f70)
    at src/main/threads.c:629
        self = 0x134d8f70
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 52 (Thread 0x7f3555637700 (LWP 30329)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ded40)
    at src/main/threads.c:629
        self = 0x134ded40
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 51 (Thread 0x7f3554e36700 (LWP 30330)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e0660)
    at src/main/threads.c:629
        self = 0x134e0660
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 50 (Thread 0x7f3554635700 (LWP 30331)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e1060)
    at src/main/threads.c:629
        self = 0x134e1060
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 49 (Thread 0x7f3553e34700 (LWP 30332)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e3480)
    at src/main/threads.c:629
        self = 0x134e3480
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 48 (Thread 0x7f3553633700 (LWP 30333)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e3fd0)
    at src/main/threads.c:629
        self = 0x134e3fd0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 47 (Thread 0x7f3552e32700 (LWP 30334)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e71e0)
    at src/main/threads.c:629
        self = 0x134e71e0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 46 (Thread 0x7f3552631700 (LWP 30335)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e9160)
    at src/main/threads.c:629
        self = 0x134e9160
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 45 (Thread 0x7f3551e30700 (LWP 30336)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ea7a0)
    at src/main/threads.c:629
        self = 0x134ea7a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 44 (Thread 0x7f355162f700 (LWP 30337)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ec5f0)
    at src/main/threads.c:629
        self = 0x134ec5f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 43 (Thread 0x7f3550e2e700 (LWP 30338)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ef9f0)
    at src/main/threads.c:629
        self = 0x134ef9f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 42 (Thread 0x7f355062d700 (LWP 30339)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f56d0)
    at src/main/threads.c:629
        self = 0x134f56d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 41 (Thread 0x7f354fe2c700 (LWP 30340)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134fcff0)
    at src/main/threads.c:629
        self = 0x134fcff0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 40 (Thread 0x7f354f62b700 (LWP 30341)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134fd440)
    at src/main/threads.c:629
        self = 0x134fd440
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 39 (Thread 0x7f354ee2a700 (LWP 30342)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13502f80)
    at src/main/threads.c:629
        self = 0x13502f80
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 38 (Thread 0x7f354e629700 (LWP 30343)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13503ad0)
    at src/main/threads.c:629
        self = 0x13503ad0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 37 (Thread 0x7f354de28700 (LWP 30344)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1350a960)
    at src/main/threads.c:629
        self = 0x1350a960
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 36 (Thread 0x7f354d627700 (LWP 30345)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1350d7a0)
    at src/main/threads.c:629
        self = 0x1350d7a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 35 (Thread 0x7f354ce26700 (LWP 30346)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13511fe0)
    at src/main/threads.c:629
        self = 0x13511fe0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 34 (Thread 0x7f354c625700 (LWP 30347)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x135165d0)
    at src/main/threads.c:629
        self = 0x135165d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 33 (Thread 0x7f354be24700 (LWP 30348)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351a390)
    at src/main/threads.c:629
        self = 0x1351a390
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 32 (Thread 0x7f354b623700 (LWP 30349)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351f700)
    at src/main/threads.c:629
        self = 0x1351f700
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 31 (Thread 0x7f354ae22700 (LWP 30350)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13521aa0)
    at src/main/threads.c:629
        self = 0x13521aa0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 30 (Thread 0x7f354a621700 (LWP 30351)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13522e60)
    at src/main/threads.c:629
        self = 0x13522e60
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 29 (Thread 0x7f3549e20700 (LWP 30352)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13526680)
    at src/main/threads.c:629
        self = 0x13526680
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 28 (Thread 0x7f354961f700 (LWP 30353)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13528290)
    at src/main/threads.c:629
        self = 0x13528290
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 27 (Thread 0x7f3548e1e700 (LWP 30354)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1352b140)
    at src/main/threads.c:629
        self = 0x1352b140
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 26 (Thread 0x7f354861d700 (LWP 30355)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1352bc90)
    at src/main/threads.c:629
        self = 0x1352bc90
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 25 (Thread 0x7f3547e1c700 (LWP 30356)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13465270)
    at src/main/threads.c:629
        self = 0x13465270
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 24 (Thread 0x7f354761b700 (LWP 30357)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b1760)
    at src/main/threads.c:629
        self = 0x134b1760
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 23 (Thread 0x7f3546e1a700 (LWP 30358)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c3880)
    at src/main/threads.c:629
        self = 0x134c3880
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 22 (Thread 0x7f3546619700 (LWP 30359)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c99a0)
    at src/main/threads.c:629
        self = 0x134c99a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 21 (Thread 0x7f3545e18700 (LWP 30360)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d19f0)
    at src/main/threads.c:629
        self = 0x134d19f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 20 (Thread 0x7f3545617700 (LWP 30361)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d93b0)
    at src/main/threads.c:629
        self = 0x134d93b0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 19 (Thread 0x7f3544e16700 (LWP 30362)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134dce40)
    at src/main/threads.c:629
        self = 0x134dce40
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 18 (Thread 0x7f3544615700 (LWP 30363)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e6320)
    at src/main/threads.c:629
        self = 0x134e6320
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 17 (Thread 0x7f3543e14700 (LWP 30364)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e7be0)
    at src/main/threads.c:629
        self = 0x134e7be0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 16 (Thread 0x7f3543613700 (LWP 30365)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134eb1e0)
    at src/main/threads.c:629
        self = 0x134eb1e0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 15 (Thread 0x7f3542e12700 (LWP 30366)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f05b0)
    at src/main/threads.c:629
        self = 0x134f05b0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 14 (Thread 0x7f3542611700 (LWP 30367)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f3870)
    at src/main/threads.c:629
        self = 0x134f3870
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 13 (Thread 0x7f3541e10700 (LWP 30368)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f93d0)
    at src/main/threads.c:629
        self = 0x134f93d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 12 (Thread 0x7f354160f700 (LWP 30369)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134fd880)
    at src/main/threads.c:629
        self = 0x134fd880
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 11 (Thread 0x7f3540e0e700 (LWP 30370)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13505440)
    at src/main/threads.c:629
        self = 0x13505440
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 10 (Thread 0x7f354060d700 (LWP 30371)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13506670)
    at src/main/threads.c:629
        self = 0x13506670
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 9 (Thread 0x7f353fe0c700 (LWP 30372)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13507620)
    at src/main/threads.c:629
        self = 0x13507620
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 8 (Thread 0x7f353f60b700 (LWP 30373)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13509550)
    at src/main/threads.c:629
        self = 0x13509550
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 7 (Thread 0x7f353ee0a700 (LWP 30374)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1350e360)
    at src/main/threads.c:629
        self = 0x1350e360
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 6 (Thread 0x7f353e609700 (LWP 30375)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x135109f0)
    at src/main/threads.c:629
        self = 0x135109f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 5 (Thread 0x7f353de08700 (LWP 30376)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13517860)
    at src/main/threads.c:629
        self = 0x13517860
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 4 (Thread 0x7f353d607700 (LWP 30377)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351a940)
    at src/main/threads.c:629
        self = 0x1351a940
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 3 (Thread 0x7f353ce06700 (LWP 30378)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351ad90)
    at src/main/threads.c:629
        self = 0x1351ad90
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 2 (Thread 0x7f353c605700 (LWP 30380)):
#0  0x00007f356402266d in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007f35640532c4 in usleep () from /lib64/libc.so.6
No symbol table info available.
#2  0x000000000044e85b in detail_handler_thread (arg=0x13547c20)
    at src/main/detail.c:1079
        packet = 0x0
        c = 0 '\000'
        this = 0x13547c20
        data = 0x13547d70
#3  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 1 (Thread 0x7f356631c840 (LWP 30248)):
#0  0x00007f35640222c9 in waitpid () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007f3563fa5c72 in do_system () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007f3563fa6021 in system () from /lib64/libc.so.6
No symbol table info available.
#3  0x00007f3565c99578 in fr_fault (sig=11) at src/lib/debug.c:725
        disable = true
        cmd = "gdb -silent -x /etc/raddb/panic.gdb /usr/sbin/radiusd 30248 2>&1 | tee /var/log/radius/gdb-radiusd-30248.log", '\000' <repeats 423 times>
        out = 0x7ffc8d576108 ".log"
        left = 428
        ret = 45
        p = 0x7f3565ed54a2 <panic_action+98> ".log"
        q = 0x0
        code = 0
#4  <signal handler called>
No symbol table info available.
#5  0x00007f3563fe0208 in _int_free () from /lib64/libc.so.6
No symbol table info available.
#6  0x00007f356521f0c4 in _talloc_free_internal (ptr=<optimized out>, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1116
        ptr_to_free = <optimized out>
#7  0x00007f356521f01b in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x7f34a8002860, 
    tc=0x7f34a8002800) at ../talloc.c:1525
        child = 0x7f34a8002920
        new_parent = 0x0
#8  _talloc_free_internal (ptr=0x7f34a8002860, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1072
        ptr_to_free = <optimized out>
#9  0x00007f356521f01b in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x12f90e30, tc=0x12f90dd0)
    at ../talloc.c:1525
        child = 0x7f34a8002860
        new_parent = 0x0
#10 _talloc_free_internal (ptr=0x12f90e30, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1072
        ptr_to_free = <optimized out>
#11 0x00007f356521f01b in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x12f910f0, tc=0x12f91090)
    at ../talloc.c:1525
        child = 0x12f90e30
        new_parent = 0x0
#12 _talloc_free_internal (ptr=0x12f910f0, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1072
        ptr_to_free = <optimized out>
#13 0x00007f3565218b63 in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x12f90dd0, tc=0x12f90d70)
    at ../talloc.c:1525
        child = 0x12f910f0
        new_parent = 0x0
#14 _talloc_free_internal (location=<optimized out>, ptr=<optimized out>)
    at ../talloc.c:1072
        ptr_to_free = <optimized out>
#15 _talloc_free (ptr=0x12f90dd0, location=0x46aed6 "src/main/process.c:566")
    at ../talloc.c:1647
No locals.
#16 0x000000000043b800 in request_free (request=0x12f910f0)
    at src/main/process.c:566
        ptr = 0x12f90dd0
#17 0x000000000043bf94 in request_done (request=0x12f910f0, action=2)
    at src/main/process.c:814
        now = {tv_sec = 4621557231520, tv_usec = 4435457}
        when = {tv_sec = 172421024, tv_usec = 318312688}
#18 0x000000000043c935 in request_cleanup_delay (request=0x12f910f0, action=4)
    at src/main/process.c:1123
        when = {tv_sec = 1492889274, tv_usec = 457163}
        now = {tv_sec = 1492889274, tv_usec = 457273}
        __FUNCTION__ = "request_cleanup_delay"
#19 0x000000000043b70d in request_timer (ctx=0x12f910f0)
    at src/main/process.c:543
        request = 0x12f910f0
        action = 4
#20 0x00007f3565cc0688 in fr_event_run (el=0x1800930, when=0x7ffc8d576cc0)
    at src/lib/event.c:309
        callback = 0x43b6bd <request_timer>
        ctx = 0x12f910f0
        ev = 0x12fc75b0
#21 0x00007f3565cc0fa8 in fr_event_loop (el=0x1800930) at src/lib/event.c:632
        i = 11
        rcode = 0
        when = {tv_sec = 1492889274, tv_usec = 457273}
        wake = 0x7ffc8d576cc0
        maxfd = 339
        read_fds = {fds_bits = {0 <repeats 16 times>}}
        master_fds = {fds_bits = {0, 0, 0, 0, 0, 933792, 0, 0, 0, 0, 0, 0, 0, 
            0, 0, 0}}
#22 0x0000000000446d9d in radius_event_process () at src/main/process.c:5667
No locals.
#23 0x0000000000431203 in main (argc=2, argv=0x7ffc8d576e98)
    at src/main/radiusd.c:585
        rcode = 0
        status = 32764
        argval = -1
        spawn_flag = true
        display_version = false
        flag = 0
        from_child = {4, 5}
        p = 0x7ffc8d577f92 "/radiusd"
        state = 0x680be0 <global_state>
        autofree = 0x13a2090
A debugging session is active.

	Inferior 1 [process 30248] will be detached.

Quit anyway? (y or n) [answered Y; input not from terminal]

@alandekok alandekok added the v3.0.x label Nov 3, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment