Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SIGSEGV in scollectd ? #1558

Closed
slivne opened this issue Aug 8, 2016 · 1 comment
Closed

SIGSEGV in scollectd ? #1558

slivne opened this issue Aug 8, 2016 · 1 comment

Comments

@slivne
Copy link
Contributor

slivne commented Aug 8, 2016

Installation details
Scylla version (or git commit hash): 1.3 rc2+

on longevity

[root@n0 coredump]# /opt/scylladb/bin/gdb /usr/bin/scylla a
GNU gdb (GDB) Red Hat Enterprise Linux 7.10.1-30.el7.centos
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/bin/scylla...Reading symbols from /usr/lib/debug/usr/bin/scylla.debug...../../gdb/cp-support.c:1595: demangler-warning: unable to demangle '_ZN8futurizeI13frozen_schemaE5applyIRZN7seastar7shardedIN7service13storage_proxyEE9invoke_onIZZNS6_22init_messaging_serviceEvENKUljN5utils4UUIDEE5_clEjSA_EUlOT_E_6futureIJS0_EEEET0_jSD_EUlvE_JEEESG_SD_DpOT0_' (demangler failed with signal 11)
Unable to dump core, use `ulimit -c unlimited' before executing GDB next time.
../../gdb/cp-support.c:1608: demangler-warning: unable to demangle '_ZN8futurizeI13frozen_schemaE5applyIRZN7seastar7shardedIN7service13storage_proxyEE9invoke_onIZZNS6_22init_messaging_serviceEvENKUljN5utils4UUIDEE5_clEjSA_EUlOT_E_6futureIJS0_EEEET0_jSD_EUlvE_JEEESG_SD_DpOT0_' (demangler failed with signal 11)
A problem internal to GDB has been detected,
further debugging may prove unreliable.
Quit this debugging session? (y or n) n

This is a bug, please report it.  For instructions, see:
<http://www.gnu.org/software/gdb/bugs/>.
No coredumps found.
[root@n0 coredump]# sudo coredumpctl info 43389
           PID: 43389 (scylla)
           UID: 489 (scylla)
           GID: 1001 (scylla)
        Signal: 11 (SEGV)
     Timestamp: Mon 2016-08-08 10:36:27 EDT (31min ago)
  Command Line: /usr/bin/scylla --options-file /etc/scylla/scylla2.yaml --log-to-syslog 1 --log-to-stdout 0 --default-log-level info --collectd-address=127.0.0.1:25826 --collectd=1 --collectd-poll-period 3000 --
    Executable: /usr/bin/scylla
 Control Group: /user.slice/user-1014.slice/session-12671.scope
          Unit: session-12671.scope
         Slice: user-1014.slice
       Session: 12671
     Owner UID: 1014 (shlomi)
       Boot ID: be3c04f779654e738efb0bf383ee89ca
    Machine ID: cfb4df31458748c1835e37c71acfee84
      Hostname: n0.sahara.cloudius-systems.com
      Coredump: /var/lib/systemd/coredump/core.scylla.489.be3c04f779654e738efb0bf383ee89ca.43389.1470666987000000
       Message: Process 43389 (scylla) of user 489 dumped core.

                Stack trace of thread 43393:
                #0  0x00000000004d3b9a _ZNK12chunked_fifoIN15basic_semaphoreI35semaphore_default_exception_factoryE5entryELm128EE4sizeEv (scylla)
                #1  0x00000000005701bb _ZN9scollectd8cpwriter3putENS_9part_typeERKNS_10value_listE (scylla)
                #2  0x0000000000574b47 do_until<scollectd::impl::run()::<lambda()>&, scollectd::impl::run()::<lambda()>&> (scylla)
                #3  0x00000000004d4f30 _ZNKSt8functionIFvvEEclEv (scylla)
                #4  0x00000000004d4089 _ZNKSt8functionIFvvEEclEv (scylla)
                #5  0x00000000004d2b85 _ZN7reactor9poll_onceEv (scylla)
                #6  0x0000000000503634 _ZNKSt8functionIFbvEEclEv (scylla)
                #7  0x00000000005203fd _ZZN3smp9configureEN5boost15program_options13variables_mapEENKUlvE1_clEv.constprop.3053 (scylla)
                #8  0x00000000005523de _ZNKSt8functionIFvvEEclEv (scylla)
                #9  0x00007f6c64158dc5 start_thread (libpthread.so.0)
                #10 0x00007f6c63e8628d __clone (libc.so.6)

                Stack trace of thread 43394:
                #0  0x00007f6c63e864c7 epoll_pwait (libc.so.6)
                #1  0x00000000004e3eab _ZN21reactor_backend_epoll16wait_and_processEiPK10__sigset_t (scylla)
                #2  0x00000000004d2b85 _ZN7reactor9poll_onceEv (scylla)
                #3  0x00000000005032c6 _ZNKSt8functionIFbvEEclEv (scylla)
                #4  0x00000000005203fd _ZZN3smp9configureEN5boost15program_options13variables_mapEENKUlvE1_clEv.constprop.3053 (scylla)
                #5  0x00000000005523de _ZNKSt8functionIFvvEEclEv (scylla)
                #6  0x00007f6c64158dc5 start_thread (libpthread.so.0)
                #7  0x00007f6c63e8628d __clone (libc.so.6)

                Stack trace of thread 43391:
                #0  0x00007f6c63e864c7 epoll_pwait (libc.so.6)
                #1  0x00000000004e3eab _ZN21reactor_backend_epoll16wait_and_processEiPK10__sigset_t (scylla)
                #2  0x00000000004d2c02 _ZN7reactor14pure_poll_onceEv (scylla)
                #3  0x000000000091f331 _ZNKSt8functionIFbvEEclEv (scylla)
                #4  0x000000000050360e _ZNKSt8functionIFN7reactor23idle_cpu_handler_resultERKS_IFbvEEEEclES5_ (scylla)
                #5  0x00000000005203fd _ZZN3smp9configureEN5boost15program_options13variables_mapEENKUlvE1_clEv.constprop.3053 (scylla)
                #6  0x00000000005523de _ZNKSt8functionIFvvEEclEv (scylla)
                #7  0x00007f6c64158dc5 start_thread (libpthread.so.0)
                #8  0x00007f6c63e8628d __clone (libc.so.6)

                Stack trace of thread 43389:
                #0  0x00007f6c63e864c7 epoll_pwait (libc.so.6)
                #1  0x00000000004e3eab _ZN21reactor_backend_epoll16wait_and_processEiPK10__sigset_t (scylla)
                #2  0x00000000004d2b85 _ZN7reactor9poll_onceEv (scylla)
                #3  0x0000000000503634 _ZNKSt8functionIFbvEEclEv (scylla)
                #4  0x000000000057ae05 _ZN12app_template14run_deprecatedEiPPcOSt8functionIFvvEE (scylla)
                #5  0x00000000004731ba main (scylla)
                #6  0x00007f6c63db1b15 __libc_start_main (libc.so.6)
                #7  0x00000000004d19d5 _start (scylla)

                Stack trace of thread 43390:
                #0  0x0000000000553d06 _ZN6memory9cpu_pages4freeEPv (scylla)
                #1  0x0000000000942d1c _ZN9__gnu_cxx13new_allocatorI15range_tombstoneE10deallocateEPS1_m (scylla)
                #2  0x0000000000942e1a _ZZN6futureIJ17data_query_resultEE12then_wrappedIZ7do_withI15mutation_reader35stable_flattened_mutations_consumerI17compact_for_queryIL19emit_only_live_rows1E20query_result
                #3  0x0000000000942ed5 _ZN12continuationIZN6futureIJ17data_query_resultEE12then_wrappedIZ7do_withI15mutation_reader35stable_flattened_mutations_consumerI17compact_for_queryIL19emit_only_live_rows
                #4  0x00000000004d5749 _ZNKSt14default_deleteI4taskEclEPS0_ (scylla)
                #5  0x000000000050329b _ZN7reactor3runEv (scylla)
                #6  0x00000000005203fd _ZZN3smp9configureEN5boost15program_options13variables_mapEENKUlvE1_clEv.constprop.3053 (scylla)
                #7  0x00000000005523de _ZNKSt8functionIFvvEEclEv (scylla)
                #8  0x00007f6c64158dc5 start_thread (libpthread.so.0)
                #9  0x00007f6c63e8628d __clone (libc.so.6)

                Stack trace of thread 43399:
                #0  0x00007f6c6415f22d read (libpth
@tgrabiec
Copy link
Contributor

tgrabiec commented Aug 8, 2016

Caused by scylladb/seastar#177

avikivity added a commit that referenced this issue Aug 10, 2016
* seastar de789f1...36a8ebe (1):
  > reactor: fix I/O queue pending requests collectd metric

Fixes #1558.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants