Scylla on AWS throws a SIGSEGV

[slivne]

When starting a cluster on AWS via the AMI scylla sometimes crashes

it happens even when running via the command line

rm -Rf /data/data/; rm -Rf /data/commitlog/ ; env HOME=/var/lib/scylla /usr/bin/scylla --log-to-syslog 1 --default-log-level info --options-file /var/lib/scylla/conf/scylla.yaml --network-stack posix

[root@ip-172-30-0-158 ~]# sudo gdb /usr/bin/scylla /var/lib/scylla/core.2014
GNU gdb (GDB) Fedora 7.9.1-17.fc22
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/bin/scylla...Reading symbols from /usr/bin/scylla...(no debugging symbols found)...done.
(no debugging symbols found)...done.
[New LWP 2014]
[New LWP 2015]
[New LWP 2019]
[New LWP 2022]
[New LWP 2020]
[New LWP 2017]
[New LWP 2016]
[New LWP 2021]
[New LWP 2018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/bin/scylla --log-to-syslog 1 --default-log-level info --options-file /var/'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00000000004ce2d8 in memory::cpu_pages::free(void*, unsigned long) ()
Missing separate debuginfos, use: dnf debuginfo-install scylla-server-0.00-1.fc22.x86_64
(gdb) where
#0  0x00000000004ce2d8 in memory::cpu_pages::free(void*, unsigned long) ()
#1  0x0000000000b99047 in std::_Function_handler<future<> (), gms::gossiper::init_messaging_service_handler()::{lambda()#1}>::_M_invoke(std::_Any_data const&) ()
#2  0x0000000000ccc8dd in ?? ()
#3  0x0000000000c9cdad in ?? ()
#4  0x0000000000c9cf58 in ?? ()
#5  0x000000000045ee5a in reactor::run_tasks(circular_buffer<std::unique_ptr<task, std::default_delete<task> >, std::allocator<std::unique_ptr<task, std::default_delete<task> > > >&, unsigned long) ()
#6  0x000000000048462b in reactor::run() ()
#7  0x00000000004de180 in app_template::run_deprecated(int, char**, std::function<void ()>&&) ()
#8  0x000000000041ba12 in main ()

not sure there is enough data here to work with we are updating the ami to install debug info

[asias]

which ami？

On 9/9/15, slivne notifications@github.com wrote:

When starting a cluster on AWS via the AMI scylla sometimes crashes

it happens even when running via the command line

rm -Rf /data/data/; rm -Rf /data/commitlog/ ; env HOME=/var/lib/scylla
/usr/bin/scylla --log-to-syslog 1 --default-log-level info --options-file
/var/lib/scylla/conf/scylla.yaml --network-stack posix

[root@ip-172-30-0-158 ~]# sudo gdb /usr/bin/scylla
/var/lib/scylla/core.2014
GNU gdb (GDB) Fedora 7.9.1-17.fc22
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/bin/scylla...Reading symbols from
/usr/bin/scylla...(no debugging symbols found)...done.
(no debugging symbols found)...done.
[New LWP 2014]
[New LWP 2015]
[New LWP 2019]
[New LWP 2022]
[New LWP 2020]
[New LWP 2017]
[New LWP 2016]
[New LWP 2021]
[New LWP 2018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/bin/scylla --log-to-syslog 1 --default-log-level
info --options-file /var/'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00000000004ce2d8 in memory::cpu_pages::free(void*, unsigned long) ()
Missing separate debuginfos, use: dnf debuginfo-install
scylla-server-0.00-1.fc22.x86_64
(gdb) where
#0  0x00000000004ce2d8 in memory::cpu_pages::free(void*, unsigned long) ()
#1  0x0000000000b99047 in std::_Function_handler<future<> (),
gms::gossiper::init_messaging_service_handler()::{lambda()#1}>::_M_invoke(std::_Any_data
const&) ()
#2  0x0000000000ccc8dd in ?? ()
#3  0x0000000000c9cdad in ?? ()
#4  0x0000000000c9cf58 in ?? ()
#5  0x000000000045ee5a in
reactor::run_tasks(circular_buffer<std::unique_ptr<task,
std::default_delete<task> >, std::allocator<std::unique_ptr<task,
std::default_delete<task> > > >&, unsigned long) ()
#6  0x000000000048462b in reactor::run() ()
#7  0x00000000004de180 in app_template::run_deprecated(int, char**,
std::function<void ()>&&) ()
#8  0x000000000041ba12 in main ()

not sure there is enough data here to work with we are updating the ami to
install debug info

---

Reply to this email directly or view it on GitHub:
#326

Asias

[dorlaor]

On Wed, Sep 9, 2015 at 4:20 PM, slivne notifications@github.com wrote:

When starting a cluster on AWS via the AMI scylla sometimes crashes

it happens even when running via the command line

rm -Rf /data/data/; rm -Rf /data/commitlog/ ; env HOME=/var/lib/scylla
/usr/bin/scylla --log-to-syslog 1 --default-log-level info --options-file
/var/lib/scylla/conf/scylla.yaml --network-stack posix

Could it be out of memory or very low memory condition?
Can you reproduce it with -m ?

[root@ip-172-30-0-158 ~]# sudo gdb /usr/bin/scylla /var/lib/scylla/core.2014
GNU gdb (GDB) Fedora 7.9.1-17.fc22
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
http://www.gnu.org/software/gdb/bugs/.
Find the GDB manual and other documentation resources online at:
http://www.gnu.org/software/gdb/documentation/.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/bin/scylla...Reading symbols from /usr/bin/scylla...(no debugging symbols found)...done.
(no debugging symbols found)...done.
[New LWP 2014]
[New LWP 2015]
[New LWP 2019]
[New LWP 2022]
[New LWP 2020]
[New LWP 2017]
[New LWP 2016]
[New LWP 2021]
[New LWP 2018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/bin/scylla --log-to-syslog 1 --default-log-level info --options-file /var/'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x00000000004ce2d8 in memory::cpu_pages::free(void_, unsigned long) ()
Missing separate debuginfos, use: dnf debuginfo-install scylla-server-0.00-1.fc22.x86_64
(gdb) where
#0 0x00000000004ce2d8 in memory::cpu_pages::free(void_, unsigned long) ()
#1 0x0000000000b99047 in std::_Function_handler<future<> (), gms::gossiper::init_messaging_service_handler()::{lambda()#1}>::_M_invoke(std::_Any_data const&) ()
#2 0x0000000000ccc8dd in ?? ()
#3 0x0000000000c9cdad in ?? ()
#4 0x0000000000c9cf58 in ?? ()
#5 0x000000000045ee5a in reactor::run_tasks(circular_buffer<std::unique_ptr<task, std::default_delete >, std::allocator<std::unique_ptr<task, std::default_delete > > >&, unsigned long) ()
#6 0x000000000048462b in reactor::run() ()
#7 0x00000000004de180 in app_template::run_deprecated(int, char**, std::function<void ()>&&) ()
#8 0x000000000041ba12 in main ()

not sure there is enough data here to work with we are updating the ami to
install debug info

—
Reply to this email directly or view it on GitHub
#326.

[slivne]

ami-6fb9d70a

started with

--clustername sl
--totalnodes 3
--version community
--rpcbinding

I'll write a wiki page on how to start a cluster via the ami and update the
issue

its on scylla boot the machine is a m4.xlarge 16GB, 4 CPUS - I doubt we ran
out of memory

On Wed, Sep 9, 2015 at 4:34 PM, Dor Laor notifications@github.com wrote:

On Wed, Sep 9, 2015 at 4:20 PM, slivne notifications@github.com wrote:

When starting a cluster on AWS via the AMI scylla sometimes crashes

it happens even when running via the command line

rm -Rf /data/data/; rm -Rf /data/commitlog/ ; env HOME=/var/lib/scylla
/usr/bin/scylla --log-to-syslog 1 --default-log-level info --options-file
/var/lib/scylla/conf/scylla.yaml --network-stack posix

Could it be out of memory or very low memory condition?
Can you reproduce it with -m ?

[root@ip-172-30-0-158 ~]# sudo gdb /usr/bin/scylla
/var/lib/scylla/core.2014
GNU gdb (GDB) Fedora 7.9.1-17.fc22
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <
http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
http://www.gnu.org/software/gdb/bugs/.
Find the GDB manual and other documentation resources online at:
http://www.gnu.org/software/gdb/documentation/.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/bin/scylla...Reading symbols from
/usr/bin/scylla...(no debugging symbols found)...done.
(no debugging symbols found)...done.
[New LWP 2014]
[New LWP 2015]
[New LWP 2019]
[New LWP 2022]
[New LWP 2020]
[New LWP 2017]
[New LWP 2016]
[New LWP 2021]
[New LWP 2018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/bin/scylla --log-to-syslog 1
--default-log-level info --options-file /var/'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x00000000004ce2d8 in memory::cpu_pages::free(void_, unsigned long) ()
Missing separate debuginfos, use: dnf debuginfo-install
scylla-server-0.00-1.fc22.x86_64
(gdb) where
#0 0x00000000004ce2d8 in memory::cpu_pages::free(void_, unsigned long) ()
#1 0x0000000000b99047 in std::_Function_handler<future<> (),
gms::gossiper::init_messaging_service_handler()::{lambda()#1}>::_M_invoke(std::_Any_data
const&) ()
#2 0x0000000000ccc8dd in ?? ()
#3 0x0000000000c9cdad in ?? ()
#4 0x0000000000c9cf58 in ?? ()
#5 0x000000000045ee5a in
reactor::run_tasks(circular_buffer<std::unique_ptr<task,
std::default_delete >, std::allocator<std::unique_ptr<task,
std::default_delete > > >&, unsigned long) ()
#6 0x000000000048462b in reactor::run() ()
#7 0x00000000004de180 in app_template::run_deprecated(int, char**,
std::function<void ()>&&) ()
#8 0x000000000041ba12 in main ()

not sure there is enough data here to work with we are updating the ami
to
install debug info

—
Reply to this email directly or view it on GitHub
#326.

—
Reply to this email directly or view it on GitHub
#326 (comment)
.

[tgrabiec]

Could be related to the problem I am seeing (and investigating):
scylladb/seastar#54

2015-09-09 15:38 GMT+02:00 slivne notifications@github.com:

ami-6fb9d70a

started with

--clustername sl
--totalnodes 3
--version community
--rpcbinding

I'll write a wiki page on how to start a cluster via the ami and update the
issue

its on scylla boot the machine is a m4.xlarge 16GB, 4 CPUS - I doubt we ran
out of memory

On Wed, Sep 9, 2015 at 4:34 PM, Dor Laor notifications@github.com wrote:

On Wed, Sep 9, 2015 at 4:20 PM, slivne notifications@github.com wrote:

When starting a cluster on AWS via the AMI scylla sometimes crashes

it happens even when running via the command line

rm -Rf /data/data/; rm -Rf /data/commitlog/ ; env
HOME=/var/lib/scylla
/usr/bin/scylla --log-to-syslog 1 --default-log-level info
--options-file
/var/lib/scylla/conf/scylla.yaml --network-stack posix

Could it be out of memory or very low memory condition?
Can you reproduce it with -m ?

[root@ip-172-30-0-158 ~]# sudo gdb /usr/bin/scylla
/var/lib/scylla/core.2014
GNU gdb (GDB) Fedora 7.9.1-17.fc22
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <
http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show
copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
http://www.gnu.org/software/gdb/bugs/.
Find the GDB manual and other documentation resources online at:
http://www.gnu.org/software/gdb/documentation/.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/bin/scylla...Reading symbols from
/usr/bin/scylla...(no debugging symbols found)...done.
(no debugging symbols found)...done.
[New LWP 2014]
[New LWP 2015]
[New LWP 2019]
[New LWP 2022]
[New LWP 2020]
[New LWP 2017]
[New LWP 2016]
[New LWP 2021]
[New LWP 2018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/bin/scylla --log-to-syslog 1
--default-log-level info --options-file /var/'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x00000000004ce2d8 in memory::cpu_pages::free(void_, unsigned long)
()
Missing separate debuginfos, use: dnf debuginfo-install
scylla-server-0.00-1.fc22.x86_64
(gdb) where
#0 0x00000000004ce2d8 in memory::cpu_pages::free(void_, unsigned long)
()
#1 0x0000000000b99047 in std::_Function_handler<future<> (),

gms::gossiper::init_messaging_service_handler()::{lambda()#1}>::_M_invoke(std::_Any_data
const&) ()

#2 0x0000000000ccc8dd in ?? ()
#3 0x0000000000c9cdad in ?? ()
#4 0x0000000000c9cf58 in ?? ()
#5 0x000000000045ee5a in
reactor::run_tasks(circular_buffer<std::unique_ptr<task,
std::default_delete >, std::allocator<std::unique_ptr<task,
std::default_delete > > >&, unsigned long) ()
#6 0x000000000048462b in reactor::run() ()
#7 0x00000000004de180 in app_template::run_deprecated(int, char**,
std::function<void ()>&&) ()
#8 0x000000000041ba12 in main ()

not sure there is enough data here to work with we are updating the ami
to
install debug info

—
Reply to this email directly or view it on GitHub
#326.

—
Reply to this email directly or view it on GitHub
<
#326 (comment)

.

—
Reply to this email directly or view it on GitHub
#326 (comment)
.

[slivne]

https://github.com/cloudius-systems/urchin/wiki/Using-AWS-AMI

[tgrabiec]

2015-09-09 15:47 GMT+02:00 Tomasz Grabiec tgrabiec@gmail.com:

Could be related to the problem I am seeing (and investigating):
scylladb/seastar#54

I've just posted a patch which fixed the problem for me:
"utils/large_bitset: Fix buffer overflow in load()/save()", I recommend
retesting once that's applied.

2015-09-09 15:38 GMT+02:00 slivne notifications@github.com:

ami-6fb9d70a

started with

--clustername sl
--totalnodes 3
--version community
--rpcbinding

I'll write a wiki page on how to start a cluster via the ami and update
the
issue

its on scylla boot the machine is a m4.xlarge 16GB, 4 CPUS - I doubt we
ran
out of memory

On Wed, Sep 9, 2015 at 4:34 PM, Dor Laor notifications@github.com
wrote:

On Wed, Sep 9, 2015 at 4:20 PM, slivne notifications@github.com
wrote:

When starting a cluster on AWS via the AMI scylla sometimes crashes

it happens even when running via the command line

rm -Rf /data/data/; rm -Rf /data/commitlog/ ; env
HOME=/var/lib/scylla
/usr/bin/scylla --log-to-syslog 1 --default-log-level info
--options-file
/var/lib/scylla/conf/scylla.yaml --network-stack posix

Could it be out of memory or very low memory condition?
Can you reproduce it with -m ?

[root@ip-172-30-0-158 ~]# sudo gdb /usr/bin/scylla
/var/lib/scylla/core.2014
GNU gdb (GDB) Fedora 7.9.1-17.fc22
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <
http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show
copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
http://www.gnu.org/software/gdb/bugs/.
Find the GDB manual and other documentation resources online at:
http://www.gnu.org/software/gdb/documentation/.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/bin/scylla...Reading symbols from
/usr/bin/scylla...(no debugging symbols found)...done.
(no debugging symbols found)...done.
[New LWP 2014]
[New LWP 2015]
[New LWP 2019]
[New LWP 2022]
[New LWP 2020]
[New LWP 2017]
[New LWP 2016]
[New LWP 2021]
[New LWP 2018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/bin/scylla --log-to-syslog 1
--default-log-level info --options-file /var/'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x00000000004ce2d8 in memory::cpu_pages::free(void_, unsigned
long) ()
Missing separate debuginfos, use: dnf debuginfo-install
scylla-server-0.00-1.fc22.x86_64
(gdb) where
#0 0x00000000004ce2d8 in memory::cpu_pages::free(void_, unsigned
long) ()
#1 0x0000000000b99047 in std::_Function_handler<future<> (),

gms::gossiper::init_messaging_service_handler()::{lambda()#1}>::_M_invoke(std::_Any_data
const&) ()

#2 0x0000000000ccc8dd in ?? ()
#3 0x0000000000c9cdad in ?? ()
#4 0x0000000000c9cf58 in ?? ()
#5 0x000000000045ee5a in
reactor::run_tasks(circular_buffer<std::unique_ptr<task,
std::default_delete >, std::allocator<std::unique_ptr<task,
std::default_delete > > >&, unsigned long) ()
#6 0x000000000048462b in reactor::run() ()
#7 0x00000000004de180 in app_template::run_deprecated(int, char**,
std::function<void ()>&&) ()
#8 0x000000000041ba12 in main ()

not sure there is enough data here to work with we are updating the
ami
to
install debug info

—
Reply to this email directly or view it on GitHub
#326.

—
Reply to this email directly or view it on GitHub
<
#326 (comment)

.

—
Reply to this email directly or view it on GitHub
#326 (comment)
.

[asias]

Comments on your ami-6fb9d70a on N. virginia

1. It fails to start a single node cluster (https://github.com/cloudius-systems/urchin/wiki/Using-AWS-AMI)
2. I managed to start 3 nodes cluster. But the service will restart scylla when it aborts. It is impossible to understand the log. I don't know if the log was the previous run of current run in case of failure. Please set Restart=no.

cat /usr/lib/systemd/system/scylla-server.service
[Unit]
Description=Scylla Server
After=network.target libvirtd.service

[Service]
Type=simple
EnvironmentFile=/etc/sysconfig/scylla-server
ExecStartPre=/usr/lib/scylla/scylla_prepare
ExecStart=/usr/lib/scylla/scylla_run
ExecStopPost=/usr/lib/scylla/scylla_stop
KillMode=process
Restart=always

[Install]
WantedBy=multi-user.target

[asias]

Regarding cluster,

With https://github.com/cloudius-systems/urchin/wiki/Using-AWS-AMI, I started 3 nodes cluster.

One of the node fails to join the cluster, the second node.

node 1(seed):

Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: INFO INFO      [shard 3] database - Row: max_vector_size: 32, internal_count: 5
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: [shard 1] database - Row: max_vector_size: 32, internal_count: 5
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: WARN    [shard 0] database - Populating Keyspace system
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: WARN    [shard 2] database - Populating Keyspace system
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: WARN    [shard 1] database - Populating Keyspace system
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: WARN    [shard 3] database - Populating Keyspace system
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: INFO    [shard 0] storage_service - Loading persisted ring state
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: INFO    [shard 0] storage_service - Starting up server gossip
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: Start gossiper service ...
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: INFO    [shard 0] storage_service - Generated random tokens. tokens are {a6 af 0a 8f c1 03 34 24 , 16 d6 ae 93 f5 64 8b db , 71 eb 21 db 40 4c d9 0b , 94 e0 fe c0 ab 68 89 65 , f1 65 af 4a 50 1b 94 c8 , 62 11 f1 f7 08 03 03 3c , c3 b4 da 31 9d f1 c0 0a , 3e 40 5f 50 6f 62 81 eb , dd f7 22 6c 20 10 ed 08 , 50 6d eb 69 7f 3e 62 17 , d4 78 70 8f 8c 6d 62 68 , 01 16 3d 33 b1 bf 4e 26 , 10 84 6e a1 8a e4 f1 c6 , 2e 6a bc bc 09 6f 75 40 , e5 bb 3b a8 37 a9 f4 57 , 3e a0 1a 47 07 ba f2 b4 , 26 02 4f ec 2b 91 88 80 , 09 a8 72 2c fd 1e 53 90 , 8b 52 f8 40 3b 06 dc f3 , a8 68 45 a6 89 cb 0f 8f , 12 52 0c 10 c7 e4 84 5b , 4f c6 52 04 8b 4d 5b 39 , 82 8d 50 3f 8c ec 02 4f , c2 14 9b 5a a5 77 8f 39 , bd 9f 44 8e 50 21 8c 62 , e9 58 4f 15 a4 02 9e 33 , 8e 4f 17 ba 9c 03 a8 ec , 5f ff a2 cf 90 36 e9 31 , 7c cb 30 82 8c 90 95 78 , 1c c1 cd f2 fc 69 40 63 , a0 a0 71 61 08 68 1a fd , 72 30 fa f4 12 95 23 e7 , 69 9c b0 b0 35 b6 d7 72 , 9e a1 d9 03 ac d8 35 6a , 5d 2f 29 25 91 b1 bd 2a , 08 14 c0 8a f4 87 13 1e , 6b ee 98 2e ca d9 7f e4 , 9e f9 31 cb 78 85 f5 ee , ba fe b8 c7 e6 32 8e cf , 22 14 fd 3d 97 a8 52 88 , 7c de c7 e4 98 b1 bf 86 , 74 cf 2a a8 46 b8 4e 44 , 0f 61 b9 5d f4 1b 00 99 , b1 38 32 91 fc 22 17 2c , fa c8 6a ae 0c 89 b3 ab , 80 95 6e 47 a2 a2 c6 9a , 69 89 b0 72 f7 19 8e bd , f5 47 a9 3c 92 54 ae b7 , cb bb fb 3d 15 ea 38 19 , bb 1e 96 cf 3e 06 93 9b , 19 6a 57 55 43 6e 5a ef , 74 7c 20 e4 b0 b8 70 ec , ff 2b 2e 54 5b 34 79 cc , 24 6a fb ef c5 d9 0a 61 , d9 50 fb b9 42 3c 1f 85 , b2 9b 4c 2f 18 e2 d6 fa , 70 d0 b3 9a e8 3d f7 c4 , 13 86 36 00 d2 6e 74 f7 , 24 be 21 e5 6a 4e a4 2d , 13 d6 7d c4 7e 5c 3e 4c , 8b 5b 94 c0 a5 99 db a1 , 81 2b a3 ab 2b 60 20 77 , a0 f0 f9 59 55 43 50 ff , 74 6b 7e c1 a8 f1 68 17 , 86 fa 87 8c b7 ca 6a 1b , 5b e6 dd c0 34 37 00 02 , ec 7e 05 e7 59 76 f0 22 , e6 88 83 65 fe b6 ec 16 , 3e d6 54 44 d7 14 6e b2 , 70 a1 f5 17 ef 3d dc b6 , 32 df f6 03 cf a1 e0 a3 , 9c 9a 4c 8b 39 c7 ef 00 , ee 24 13 ed 4c a4 11 8f , 63 92 1a 9b 8b da f1 d3 , 96 ce c7 39 e7 ba aa ff , 05 81 57 0a c6 ed cf d4 ,
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: 35 fe 36 8f b1 68 30 4e , b2 bf 4a 90 8e 76 43 ce , c9 d9 c7 80 4a 0d 8a 88 , e5 ed 3b f2 dc 44 29 93 , 35 ed 52 3e 87 b0 7c 2d , d7 f4 43 0f ea f0 00 a0 , e4 65 23 eb c6 a1 a0 fb , 22 e9 2d 3b 69 8c eb 28 , 7a d4 30 d1 96 53 58 f0 , 51 b2 0c 91 b9 e7 b2 99 , 4d 33 14 32 f4 1b 45 86 , 3f f4 73 67 13 b8 17 51 , 32 76 01 81 78 e2 6a fd , d6 79 35 05 05 2e 4e ed , fa 98 e0 c4 ab 39 9b 21 , 72 3d 39 33 59 f9 a0 cf , a8 2b 76 82 da 37 c2 e8 , dc df a5 e8 ca 8f a3 66 , 4d bd 97 3a 7d 31 fc bf , 50 01 bd c7 84 9f 4a d4 , a7 bf 8e ae 03 65 01 8d , 6a 5d 28 39 ea 85 04 1c , b5 28 42 68 f7 a1 b4 5c , 93 c6 a5 f8 5e 5c 86 74 , bf 55 50 d1 f7 07 a4 26 , 44 3f 77 4d b4 66 71 80 , 40 8e b0 65 ad 84 36 a7 , 8b cf 6a 32 8d 4e e5 0c , 38 d9 13 c2 83 dc fb 54 , d7 3a 61 e8 96 fd b3 f6 , 23 4e 92 7e e9 ad bb 93 , a5 3b 19 91 01 2d 4d 96 , 85 c7 91 d8 4b 54 05 33 , 88 6b 13 69 39 e4 ae d2 , af 93 3d 6c 19 00 c6 80 , 92 eb 9e 2a 0a 0d 98 62 , 39 53 b7 95 69 25 4f d0 , 1d 73 6e ed 15 21 f9 03 , 2d 91 41 a0 00 92 8a 49 , 7d 5c 09 d0 55 a2 50 99 , e1 b3 9f 06 a8 50 05 06 , 06 f7 33 be 02 ef 77 b7 , 63 8f 6c 27 ab cf 28 48 , ba aa 33 8e 0d 97 5d b4 , 0d a7 c5 ed cc c8 50 74 , 5e 93 74 e2 4b 71 18 94 , cc 38 ef d6 ab 33 79 78 , 5c 3f 9f 95 b9 0f 48 94 , 4e 3c fe e8 d4 14 41 33 , 16 36 38 54 aa 80 20 01 , 5b f0 46 74 87 83 60 13 , e8 a4 a0 85 fd be b9 80 , a3 63 0f f6 eb d0 75 88 , 5e 7f 56 35 79 ed b3 7d , 67 56 a0 24 b2 fe aa 4a , 77 32 de 9c fc a0 72 e4 , 2f 08 ba 70 8f ee 29 8f , 0f 7e 5c 0d a3 a1 d5 f1 , 70 a2 54 91 a0 34 a2 55 , a9 fd 72 d0 d5 06 9d 52 , 21 ac 70 7a f9 68 1a 64 , 32 50 a2 4a ce 5c 01 96 , e1 0b bb 6f 8e 51 f5 b4 , bc 29 3a 2e 7c b3 6b 22 , af 93 23 cc 0b dc 7e 40 , e0 c8 ff 17 d4 a6 7b ff , da 93 9b 7a 37 3e 11 9a , a7 b6 3c 37 bb 80 87 c2 , 5e 2c 02 15 3d cb 01 e8 , 1d 47 aa fc 23 37 02 2c , d8 1a 58 60 f2 da 9d 31 , c8 95 58 24 67 49 86 49 , bd 26 df a0 11 ae 95 1b , 3d 48 bd bb f0 1e ce 80 , d2 0d 51 25 08 62 cb a4 , 68 d4 4f 77 72 0a d2 d0 , 50 d4 2d aa 70 b4 cc 4a , 45 03 28 ed 90 dc aa 89 , 79 c7 3d e9 a8 48 6
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: 8 cc , a7 92 11 32 2f 08 47 86 , 3e e7 97 64 31 6a f4 5f , 6c c6 0c dc 49 d6 03 68 , 21 ca 50 c3 cb d0 08 f7 , 21 ff d8 a7 3f d2 bb 71 , 10 e5 53 e5 3c 38 c2 2c , 87 be ce ea 61 0c 26 11 , ae d4 ca b4 6d 3f b6 32 , 33 90 45 aa bb 5b 5c 9e , c5 4b c9 56 4f f2 8f b8 , 2c 81 a6 8b 35 b3 f6 20 , 88 91 c4 bb 91 d1 28 53 , 2d 24 9c 49 c8 8f 7b 58 , e6 1d 3c 1e fa 3a fc 22 , a1 9c ef 8c 05 f4 95 6e , 29 09 6d 57 2f ad cd 89 , e7 5e c4 77 df f1 b0 80 , 11 9a ce 12 4e 33 5c 8e , 8a 52 af 78 cb b3 bb c1 , 47 c6 58 d6 be cc c1 b8 , 43 3e 6e 0d 62 5d c2 53 , 8d 68 01 89 18 db e9 30 , 32 0e 31 d5 3b 9b 5e db , fe cf 20 fb 25 c4 12 b4 , 6d 4e 12 3d 0b e8 34 fe , 89 6c 08 b7 81 b2 c4 0b , a2 4f 0d ef 5e fe 07 c2 , 3a 93 7c fc 67 98 15 de , 1c 7b ed 93 a6 65 c7 a6 , 1e d9 b3 7a 51 c5 f2 34 , 6d 47 ae c9 c5 2b 5b 14 , af 5c 52 c1 6f 0b b1 7f , 03 59 7a b4 41 a7 d9 1d , cf 28 22 8f eb 4d 12 9a , ac 8e 3c 45 29 f7 79 21 , 07 50 02 53 8e 51 af c9 , dd af b5 d9 7e dc 51 40 , 0d be c5 88 98 3a 42 b4 , 31 e3 4d 5c 3c 4b 68 b5 , 05 2f f6 9e 0b 10 6a a4 , f9 75 5f 93 2b d9 ed 27 , 65 3d ee 48 f4 d7 ec 31 , 03 95 d3 10 34 50 77 f3 , ef 38 39 72 6b a9 fa 1c , ae 44 92 fb f7 0c 30 c9 , 69 c2 1c bc 66 d2 78 b6 , 0d 73 ec d7 35 b4 ca 98 , 7d bd 4f 5b 38 56 8c 2b , 18 ab 05 38 a5 1c 08 6e , 74 c4 b1 50 e7 99 74 6e , 6f 62 db fd c9 28 4b eb , ce 23 67 9b 34 43 a7 bc , 7c 95 0d 20 c8 cf 76 92 , 4d 4d 09 c9 c4 48 46 a1 , 5f 7a 66 46 bb b9 4e 0e , a5 1d fc 9d 12 f2 12 f0 , d3 c3 3b 58 9d d0 da c8 , 8c 30 c7 f4 7c 6e 45 84 , 55 54 81 0e e8 79 59 75 , 37 e9 e2 3e 58 62 1e 37 , e3 be ea fd 87 73 61 85 , dd f6 38 46 27 fb cc 0b , 20 97 f5 8b ae 94 01 8d , 89 38 1d f4 61 8f 1e 78 , ed ac 56 0f 63 de 94 e8 , 9b 98 d0 2c 2c b5 5d 82 , dd 84 61 ac c6 43 36 b7 , 7d 4a b9 3f f4 67 15 42 , 85 bb 49 a0 fe d3 00 41 , 95 32 0c 66 bc d2 af 5a , a0 11 b0 db d2 a0 23 53 , 5a 4f 8d 13 50 31 25 5e , 1a 9d 3d 04 27 ad 4d c0 , 6c db 79 e8 c6 d4 ee 9b , 57 75 e3 ef 9b b8 d2 09 , f4 79 8f 86 5f 99 1d 48 , 6f 36 49 5a 6d 3c 3d fa , d8 a1 34 96 9c 85 a5 b2 , 71 d1 61 ce 8
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: b 94 ae 2e , 9d 01 aa 90 bc c5 ed 81 , f4 41 9f 73 2f 93 fe 91 , e5 a1 7c b9 03 84 76 27 , ab 8f cf bc ae e2 3f 27 , b5 72 4b c2 6f d1 35 07 , 43 d2 06 a4 14 1d 23 91 , bd 8a 77 8c a5 36 85 5e , 1f 22 4d 2c 8d 68 b7 98 , 8a 8c 8d 89 79 10 9f e7 , 80 e2 88 5b 2d 44 4b 0c , 88 eb ff 2c 57 cd 9e b4 , db fd c2 43 f1 c6 65 cc , 51 af 0c 44 af e1 f3 ae , 51 79 74 ab 33 d0 94 98 , 0c c9 fd aa 0f 31 9f e8 , 1c 31 eb d3 32 1b c4 35 , e3 d1 f8 9e cc ee b5 22 , 4b 0d f3 ab d5 ba c7 4d , ff 80 09 b9 e0 00 d5 fa , 23 08 16 b6 c3 f6 9b 7b , 08 c3 61 73 83 58 90 86 , 19 c0 9c 08 81 85 d0 05 }
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: INFO    [shard 0] storage_service - Node 172.30.0.145 state jump to normal
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: Starting listening for CQL clients on 172.30.0.145:9042...
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: Thrift server listening on 172.30.0.145:9160 ...
Sep 10 00:17:26 ip-172-30-0-145 scylla_run[800]: Seastar HTTP server listening on 172.30.0.145:10000 ...
Sep 10 00:17:27 ip-172-30-0-145 scylla_run[800]: INFO    [shard 0] gossip - Node 172.30.0.147 is now part of the cluster
Sep 10 00:17:27 ip-172-30-0-145 scylla_run[800]: INFO    [shard 0] gossip - inet_address 172.30.0.147 is now UP
Sep 10 00:17:27 ip-172-30-0-145 scylla_run[800]: INFO    [shard 0] gossip - Node 172.30.0.146 is now part of the cluster
Sep 10 00:17:28 ip-172-30-0-145 scylla_run[800]: WARN    [shard 0] gossip - Fail to send EchoMessage to 172.30.0.146:0: rpc::timeout_error (rpc call timed out)
Sep 10 00:17:39 ip-172-30-0-145 scylla_run[800]: INFO    [shard 0] gossip - Node 172.30.0.146 has restarted, now UP
Sep 10 00:17:39 ip-172-30-0-145 scylla_run[800]: WARN    [shard 0] gossip - Fail to send EchoMessage to 172.30.0.146:0: rpc::closed_error (connection is closed)
Sep 10 00:17:39 ip-172-30-0-145 scylla_run[800]: INFO    [shard 0] storage_service - Node 172.30.0.146 state jump to normal

[fedora@ip-172-30-0-145 ~]$ sudo cat /var/lib/scylla/conf/scylla.yaml|grep -E 'seeds|rpc_address|listen_address'|grep -v "^#"
          # seeds is actually a comma-delimited list of addresses.
          - seeds: "172.30.0.145"
listen_address: 172.30.0.145
rpc_address: 172.30.0.145
[fedora@ip-172-30-0-145 ~]$ curl -X GET --header "Accept: application/json" "http://`hostname`:10000/gossiper/endpoint/live/"
["172.30.0.145","172.30.0.147"]

node 2
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 3] database - sstable /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-8-Data.db not relevant for this shard, ignoring
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 2] database - sstable /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-4-Data.db not relevant for this shard, ignoring
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 3] database - sstable /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-12-Data.db not relevant for this shard, ignoring
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 2] database - sstable /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-8-Data.db not relevant for this shard, ignoring
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 1] database - sstable /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-4-Data.db not relevant for this shard, ignoring
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 2] database - sstable /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-12-Data.db not relevant for this shard, ignoring
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 1] database - sstable /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-8-Data.db not relevant for this shard, ignoring
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 1] database - sstable /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-12-Data.db not relevant for this shard, ignoring
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 0] storage_service - Loading persisted ring state
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 0] storage_service - Starting up server gossip
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: Start gossiper service ...
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 0] storage_service - Using saved tokens {0d 8e 45 b9 38 ce 22 07 , 0c e0 94 d7 a5 15 9b a6 , 7b 54 43 f6 45 24 8f 80 , 0c 47 ac d1 3a 27 35 a8 , 0c 12 b9 03 92 16 93 8b , 77 cd c0 7b ea fa da f9 , 77 c2 f3 95 e1 01 ee 72 , 76 0e 82 00 0c b9 55 56 , 73 cd 35 5a 7b a0 7a af , 6c c0 0b fa 35 a6 1c 0e , 6b 90 4a 52 ed bf ab 91 , 6a e9 9e c6 73 c9 2e c9 , 65 31 98 42 a1 41 ba c3 , 5e e7 ca 92 0b aa ed cb , 5b c7 ce a5 46 81 d1 14 , 59 db 82 66 4d 2f 87 e5 , 56 6d d8 4f 31 72 94 bb , 56 4a ef 50 4a 20 bd e1 , 56 05 8c e5 34 b5 89 ac , 55 ac 2f 58 60 01 57 8e , 55 a8 0e b7 42 1d 86 00 , 08 55 5e dd 18 38 cd 14 , 53 2c 18 df 9b 7a eb 03 , 52 bc b8 33 7c d0 f4 d9 , 4d b5 f7 09 14 04 59 e8 , 4c ac 95 43 7a 46 05 41 , 4a e8 9b d7 2e fd 64 94 , 4a a3 ab c8 54 38 52 f7 , 07 5d 80 04 f9 89 d9 a6 , a0 3a 5d 90 2e c2 6d 2a , ac 6c 83 63 5e 9c a3 50 , a3 b9 50 8c 27 cb a1 98 , 68 6c d1 c1 de cc 9b 6f , a5 35 92 fc 2b b6 27 7e , ef 37 bd bd ac 38 98 c9 , a5 b4 7d 8a c2 6c e0 b1 , aa b0 a2 54 3a 22 a4 8d , 10 44 c6 6c e5 6b 74 d8 , a6 cc d4 06 07 b7 14 04 , d9 b5 57 04 39 f5 e4 9a , a8 ed e6 f3 11 f5 d5 b5 , ff e9 c9 18 1b 7f 83 38 , c1 e5 62 86 6d bc 64 1b , 54 23 f3 55 37 ea 74 1e , a9 a5 f4 c3 76 3b 86 37 , a8 da c4 62 41 bd a4 b7 , 15 38 38 62 67 1b 0b 63 , 21 dd f8 b0 60 6c 98 e8 , 7e a6 b5 d0 eb 3c 4b 91 , f7 d4 ef 4e 1a 05 e6 e4 , fe 82 35 2a b2 dc 36 a0 , ae 6a 14 84 33 2c 3a 3f , fc ef d1 65 d5 7d 8f 11 , 9d 4a 58 d0 82 f2 ca a6 , bb 3a f9 ab 4c d1 bb 50 , be d5 ea 4b 20 bd 2d 43 , 0d c1 48 10 61 bf 96 07 , 14 8e 8f 2e 64 7a 85 ad , a6 b6 8b 42 9a 0a 00 ea , ff 50 16 e4 48 e1 63 92 , f1 33 30 1d ea 6f 0c 37 , 1b 28 e2 38 45 94 ab 57 , bc 48 16 0a 50 20 8c da , 55 92 dd 49 63 b1 f2 1e , a7 d9 93 22 5b 31 a7 2f , 98 5c cd 9e 88 0d f3 24 , 44 7f de da 3c 01 45 df , 89 cd 1e 04 cb a9 53 b0 , be 9a de a1 58 b3 cf e2 , 77 d0 51 a8 bc 02 d8 fe , be aa 6e 53 d3 bb b1 0b , bf 1d 9b f7 e5 61 ce e9 , a5 0f 88 bf 29 79 fa b5 , c7 35 69 05 ea 31 ca 8f , 2a d5 2e fa 78 aa 73 24 , 01 57 ed 3d 61 d1 0d a8 , d9 32 85 10 22 b
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: 5 57 8c , 36 74 05 5b 1c 47 d8 74 , dc ac 92 32 18 b5 8c f1 , f7 98 5b c6 09 04 a9 56 , ff a5 73 06 0f b3 6b be , a2 7e d0 25 dd 2e 0f 34 , 48 9a d9 88 3a 14 ca 61 , dd 85 31 7d 30 d6 fa 7d , 93 45 6d 93 19 26 48 18 , bc 34 ad 97 dc 11 c4 2d , cb 0d 25 45 eb e2 f9 00 , 56 a0 36 08 85 f7 57 68 , 35 98 28 5b da a3 78 dd , 0a 8e 2e 25 ce b6 d3 d0 , b9 c7 40 09 29 60 2a ff , 03 0c 90 d7 4f c0 27 ec , e5 38 df 27 5c a5 33 87 , 8a f4 0f 99 8e 8a 68 f1 , 48 19 6f 51 db 52 32 9b , a5 d6 7c ad b1 cf 89 f2 , 28 58 7b 1c 70 93 d8 6b , 0d 7c 11 94 62 dc 61 e8 , 3d 25 ea f0 14 2f bd 0a , d9 47 0c 2d 29 c8 3d 03 , b0 39 5e 6f cb eb 5e 53 , 23 51 dd 61 19 f3 48 90 , e1 92 5a 27 98 73 ff 6e , e5 9e a5 cd 0e b7 91 ec , e7 60 98 7e 4f f8 4d e3 , 84 52 3c 74 d4 b7 6a 71 , b3 73 99 75 06 f4 00 14 , 47 80 0a 0c b0 28 9d 0c , 2a ae 25 60 73 77 de 78 , f9 ce 55 f5 cb a5 8d 7b , 9f 9d 04 51 fc 9b a4 f7 , 72 c1 62 f6 21 8c 3b 0f , b5 b1 d6 eb 86 65 6a 22 , b9 8c b4 79 23 09 23 23 , 7a a5 83 ca a6 4a bf ba , 4f 2c f0 b8 e2 2d 98 49 , f4 ee 76 a2 d3 a7 81 7d , d9 22 9d 5c 7a 8b 41 73 , c3 ba 9b 3a 11 62 e6 05 , c7 b4 5e cb 86 a8 e6 a8 , ed 15 a7 13 1c c4 c9 d0 , b3 e8 20 3b 49 9a 89 6d , 5e db d5 85 e9 d0 b2 a1 , d6 17 4f 51 d0 57 4f cb , 3b 43 8d 20 b2 bf 6e a0 , ce b1 f4 f3 cf cd 0f 09 , f1 c7 fe 0f ba d5 6a c4 , d3 48 d3 88 57 4f 68 2b , b4 2f 31 e9 bc 31 f1 a7 , 67 32 16 10 f5 c6 c6 02 , dc 79 12 c9 2f 9f fd 62 , c8 bd c5 55 a2 d9 29 9c , be e3 68 9f 0c 48 ad 99 , ea 05 35 15 cf af 1a e4 , 98 55 2d be 1f 0a 1c 5d , fa c5 10 49 d4 50 66 c0 , c0 56 04 34 1d 07 28 ce , c1 7a fd 32 dd 21 5f 0b , 3e 19 33 03 d8 64 8e 26 , a6 36 74 6e 69 54 eb 1f , da 7a d7 49 83 b0 48 56 , df 21 d6 38 50 6a 4b 32 , 1c fe a0 9d 2d cb 65 6b , b6 72 fb fd 94 32 58 1c , da 4c c4 8c 62 c8 26 85 , 3f 2c 5d cb f6 d3 45 10 , c6 8c d5 60 f5 e9 ad 30 , 9f c1 4e 7a 19 0b ce 52 , 4a 41 1f 9d ca 02 0e c9 , cd ce 91 51 32 15 d8 01 , b9 f1 45 fa 36 90 35 d4 , d6 e4 72 07 84 66 39 94 , ee ac f6 26 7f f8 a1 95 , 81 f4 31 d7 86 19 ff a2 , df 0c c1 23 80 88 74 0a , d5 a2 e8 d
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: f 9e 45 1a ba , 5f 3c 06 a0 be bf b5 d2 , cd eb c9 d5 ae 73 fb ec , 51 8a 3b 41 4e 48 ff ab , fa d2 78 91 34 8d 21 f9 , c9 bb ae 0d 5a 54 97 d1 , c7 eb 91 e8 55 c5 42 9d , 94 ce c8 ae 54 79 b2 1f , 1c db f6 83 e6 bb 2d 68 , cd ed 70 89 87 3c 47 f6 , 9e c8 4a 8e 64 0e e7 1a , 05 89 cd 66 1d f0 d8 d0 , 67 32 70 44 a4 09 33 65 , f6 2a e7 21 9c b0 c2 d2 , 2e 14 cc d9 76 d7 35 ef , 75 d3 ae 62 61 6e 91 13 , 93 8c cb 76 b2 d3 18 4a , 3c d5 86 27 59 5f bf 9d , 92 a9 06 85 e3 34 d6 b6 , 0f 20 11 ae 48 51 b9 1b , 48 72 f4 6d 44 4f bf 6a , d8 19 b5 47 9f 35 6b 51 , 8e f8 f9 a3 bb b9 31 f4 , 20 96 09 f8 32 79 6e 68 , 8e 9a e1 90 fa 34 c4 bb , 42 fc be be b2 ab e9 df , 9b 02 da ec 44 dc b8 68 , 8c 3e 94 67 10 09 f6 2b , 06 1c 33 17 32 4b d1 90 , 8a 0c 68 44 c0 f3 8a 71 , 88 65 f2 8a 18 97 11 57 , 85 49 cd d3 cb ab 0d e5 , 86 b9 97 d3 6a 59 73 5f , b7 69 bd ea a0 c2 ae 9b , c9 2e 45 d2 55 1e 03 8c , 86 4a 64 3a 62 cc fc 0d , 68 61 88 21 94 dc 31 7e , 5a 68 e3 96 ce c9 71 fb , 81 dc 88 56 63 85 bb 9a , ad cb 75 b4 da 0e 64 c7 , 0e 5c 2b 65 d0 da 0d dd , 0f 6d 6c 4c 74 0c c5 16 , 42 14 4a da 7c 2c bd 09 , 10 59 39 96 62 42 fb 6c , 01 c2 2e 6f 5f e4 7c 89 , f8 ae 65 69 a0 52 5f dc , ee 2e 9f 47 34 ff 25 f8 , 25 49 4d 4b c9 be a3 dd , 12 95 1f 40 2e 19 1d 35 , 15 29 92 0d e3 c1 b9 67 , 03 da 0b 74 30 e3 f1 21 , e7 b7 2b 04 b5 f9 7c 9d , 17 5b 3a c0 ef 70 18 65 , 55 3d 3b 86 f9 2a a8 0d , 40 6a 1a 69 6a 30 a6 04 , 17 a7 10 59 53 a8 e0 48 , 90 6b a7 07 d5 99 bf fe , 17 dd ac 5a 55 46 7b ca , 02 bd c5 9b 66 f9 b4 43 , 1e dd 0a 70 08 3c f7 54 , 21 f5 de c2 a2 10 91 da , 20 60 69 c5 31 ff 06 73 , 3d 94 44 eb ac 21 72 ae , 24 f0 39 b8 1a fa 80 5f , 25 d4 cc f6 54 65 cb 35 , 0f 46 bc c7 9d 0c f9 7c , 39 4c 43 35 96 70 8c 08 , 28 ea b1 1a ec 78 b0 12 , 2e d9 e3 04 0a 27 5e 82 , 2a 7e db 0a 32 c2 1d c6 , 2c dc d1 da f7 38 6b 9e , 2f b0 e3 89 4d 91 d6 76 , 2f dc 14 00 f3 da ff ad , 8c 0c de 5a 91 82 f0 db , 45 ae 6a 11 64 b2 a9 fb , a9 2a 26 ed f8 1d c5 81 , 04 d8 f4 63 6b c5 94 3c , d1 94 14 76 5b 49 f5 37 , 36 ec a2 c3 77 b1 d2 a5 , 33 3
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: 4 12 6e 72 7c 97 42 , 33 ce 71 82 1d c3 0e 03 , 34 d1 d1 90 22 e3 fd 19 , 66 06 d5 d6 7d 68 44 66 , 34 e4 f1 56 f1 ae 01 b3 , 35 91 66 6e 63 72 e1 af , 38 e8 2b da 41 8e 3a 54 , 0c 2e 98 66 dd 75 10 eb , ac bb 6b ba d6 50 93 6c , 38 fc 63 ac 1f f6 d3 1d , 3a 2b 72 f7 0c 64 5f 5c , 3d 18 42 b0 93 24 9c 21 , 2e 38 fc 6e 05 a5 f4 81 , 3d bb 3a 24 26 e0 3e ab , 3e f4 e3 37 83 0f d8 6a , 06 2e 85 f7 98 00 a8 08 , 3e 2f fc 7f 08 14 fe 71 , 3e 69 0a a4 4a d0 04 5d , dc 06 66 a8 60 65 58 62 , 06 97 0a bd 32 28 1a 0a , ff d5 17 ab fe b9 b4 45 , 46 6f 31 50 42 61 7f f7 }
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 0] compaction - Compacting [/data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-4-Data.db:level=0, /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-8-Data.db:level=0, /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-12-Data.db:level=0, /data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-16-Data.db:level=0, ]
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 0] storage_service - Node 172.30.0.146 state jump to normal
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: INFO    [shard 0] compaction - Compacted 4 sstables to [/data/data/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-20-Data.db]. 13144 bytes to 12493 (~95% of original) in 46ms = 0.253564MB/s. ~1024 total partitions merged to 1.
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: Starting listening for CQL clients on 172.30.0.146:9042...
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: Thrift server listening on 172.30.0.146:9160 ...
Sep 10 00:17:38 ip-172-30-0-146 scylla_run[834]: Seastar HTTP server listening on 172.30.0.146:10000 ...
[fedora@ip-172-30-0-147 ~]$ sudo cat /var/lib/scylla/conf/scylla.yaml|grep -E 'seeds|rpc_address|listen_address'|grep -v "^#"
          # seeds is actually a comma-delimited list of addresses.
          - seeds: "172.30.0.145"
listen_address: 172.30.0.147
rpc_address: 172.30.0.147
[fedora@ip-172-30-0-147 ~]$ curl -X GET --header "Accept: application/json" "http://`hostname`:10000/gossiper/endpoint/live/"
["172.30.0.145","172.30.0.147"]

node 3
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: INFO    [shard 1] database - Row: max_vector_size: 32, internal_count: 5
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: WARN    [shard 0] database - Populating Keyspace system
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: WARN    [shard 2] database - Populating Keyspace system
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: WARN    [shard 3] database - Populating Keyspace system
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: WARN    [shard 1] database - Populating Keyspace system
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: INFO    [shard 0] storage_service - Loading persisted ring state
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: INFO    [shard 0] storage_service - Starting up server gossip
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: Start gossiper service ...
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: INFO    [shard 0] storage_service - Generated random tokens. tokens are {da 31 fa fa a5 e4 6d db , b2 4f 61 e3 aa 0c 7a 59 , c3 56 43 6e 9b 74 62 4b , 18 90 b6 31 27 10 59 a8 , 5c 73 40 41 b3 33 be 81 , 4f 04 0f e1 6b 4e 53 54 , 76 f5 8e 85 8a eb 45 5a , cd a7 2c 42 7d fc 36 28 , 5b 69 dc 1f 18 3f 23 f8 , c0 a8 7e 7a e9 70 95 03 , c5 2e a7 aa df 4c 11 87 , 3c 38 e0 32 03 2b 25 85 , 0f 73 85 2a 14 89 4d a3 , 86 6a 86 ab dd b7 05 7d , 7c 61 db c2 87 bf d5 8c , 58 26 88 75 32 f8 f3 7b , 25 8e 51 df 2f 09 71 47 , b9 89 78 df fa 9a 5c 40 , 77 b6 a8 46 92 ea 7a ea , 49 b9 9c 0c ca 82 d3 54 , 49 b5 bd fb 4e c1 ad c1 , d6 6b 7b 02 7b 07 42 a6 , 8d 50 a8 bc 1f ab 56 d6 , c5 e1 c3 ca ba 76 93 7f , 4d 1a 7c 84 d7 61 63 21 , f1 06 36 99 d9 c0 5f e1 , fd 2e 84 f9 fd 82 34 19 , e1 48 52 6d 21 19 53 b9 , ac ac 06 23 f0 e0 f0 b6 , a4 9a 46 95 86 b9 9d be , 6f 8f 41 69 0d e3 5e 06 , de a6 ed cf c7 f5 a2 ff , 2d a1 c4 2d f8 26 f1 66 , 1b 04 e3 a2 cf e6 93 7b , 53 b7 78 9e 95 c3 55 c8 , 60 ed df 11 3d e9 d9 94 , 5f 97 17 39 f2 90 cd 69 , ab 68 3d ae 63 b4 dc f3 , 4d 28 da f9 35 de 0c b7 , b6 04 b4 a6 05 cf f1 e0 , d7 a0 99 2e 82 d2 80 9b , 52 af 0f d3 fb b5 6a b0 , 77 6e 4f 5e 78 82 0f 90 , 91 cc 83 a3 4c 7d 18 db , c5 5f 54 28 d5 a2 68 25 , 36 84 9e 69 9f 66 82 36 , b5 bd 0a d6 45 33 ad 1c , 9f a9 f2 91 9e 43 43 85 , 93 10 26 11 46 28 57 f3 , 08 d6 40 16 30 ba 13 12 , bf ce f9 da db b2 1c 3d , 4c d3 3e b0 4e 25 c5 eb , 56 34 a6 1f dc 3b c4 45 , da e0 59 54 92 93 80 ec , 3c b8 cc ee 9e 4a 4b ab , f4 8c 11 bf 5d 95 ec d5 , c5 7c 26 30 9d 71 36 93 , 81 f2 fc 85 e7 77 9f ec , 65 26 d1 37 9a 49 90 8a , 26 61 f6 33 39 4d ee 68 , 61 f5 b3 2b 8b b6 b9 cc , 4e 92 46 a9 90 72 80 af , 0f 0e 88 a8 ca 22 4c f2 , f6 18 b3 e9 47 38 4c 90 , 99 99 5b 89 e0 2e 7c fc , 26 df d8 56 c8 69 77 ac , 20 59 38 d4 01 df 8d c2 , b5 ab 1a 56 91 f2 a8 09 , 9c 25 1e d3 21 83 8f 58 , db 5a ef 4e f0 c2 0b 53 , 87 c4 e8 84 81 e9 5a 9b , d7 c5 d4 7c 1a ee 4d a8 , 53 ae bb 46 9a 58 92 4f , f1 70 15 94 25 74 c2 91 , 0e fc 55 52 74 9a 32 5e , 1f cf ad c0 f7 f2 5f 11 ,
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: eb 67 39 1d 5e 14 5e a0 , a4 00 ac 2b c0 4e bc 7c , ee 89 1f 2f 1e 9b d7 65 , 03 6a 96 f0 88 0c f8 2c , ca a8 d4 6c 79 84 4d 3a , 12 ab a7 fc bc 95 5a ef , e9 6a 33 59 d0 fd 65 ed , 6f 78 b4 b1 7d 5c ca 64 , 69 d7 68 70 52 b7 35 2e , d4 90 6f d8 5a ff 88 9b , c6 b6 98 00 e0 93 8d f5 , b0 c3 d2 62 cd 46 3c 1f , 29 d0 28 c6 9b 0a 0b 10 , 5d 48 4d cf 76 b9 12 c2 , fe 7c 9f 92 d5 b2 30 aa , 07 e3 e1 09 64 07 32 fd , f5 ec ac 3c b2 90 cf 06 , d2 6b 91 b7 de ac af 83 , d4 b2 b8 20 ef e5 87 33 , b6 1b 86 34 39 a4 70 a9 , 3e d0 f7 15 96 d8 72 17 , b5 b0 db 15 05 3d da a0 , 50 ee ea a4 a7 23 5a a9 , 32 b7 9a 46 9d 05 63 32 , 0e 03 d0 00 00 8a 70 06 , a3 18 e1 0a e0 5c 21 04 , f1 5c af a3 32 ae f7 d3 , 2e 96 2a 82 cf 2a 05 f3 , b2 2d bc f2 68 eb 79 8d , e2 6e 14 18 c8 1e 12 f9 , 4a 68 88 08 7f d4 fe e0 , 03 ac 45 ec 37 94 3f a2 , 49 15 fd 3d e0 f3 3f 7c , 64 a2 e3 fa 71 c0 c5 61 , b9 2b e3 c5 fc 40 f4 5c , 85 f7 5b 0c 4d 19 ca 6c , ca 59 97 f6 d6 ac b2 72 , ad 05 56 ee 3f 09 a9 75 , 9d 24 33 31 72 ab 8d 89 , ee ca 67 38 99 57 86 e7 , 24 ce d4 56 7a 72 4d 8e , 76 0e 5e 9c 7a 93 30 13 , ab 7d 01 5e 09 d8 3c 43 , 21 8b 7e 32 13 e6 b6 28 , 16 0c c3 64 67 ad 40 d1 , 7d 8e a1 eb c8 18 5b 40 , 7b 22 c8 c0 64 ca 4f b1 , 95 1b 1e 62 7a 65 94 75 , 7e 1c 44 92 6b 44 93 72 , a0 17 22 f0 1d 93 9a c6 , b3 99 4b e1 5c 27 19 18 , 9a e5 39 fe 12 f2 27 d8 , 52 f3 af d8 ad 6d f9 c3 , 58 b8 cb 49 b5 73 02 fe , c7 9d 01 61 0b 1a 66 47 , 12 87 93 79 3b a8 22 47 , 9f eb a4 0a 4f 11 3a 1d , ee 11 c2 a4 e7 c0 79 07 , f3 cc 77 00 1a 03 32 35 , 1c b1 c0 7f 40 e3 42 70 , 6f 62 a4 f2 ac ed 80 17 , 63 5e 84 f6 17 5d ff 47 , fa c2 67 15 f6 f5 e1 b5 , 2e c1 8a 9a 0d df 91 c5 , 6f 5e 95 29 97 ad 14 f9 , 10 ba f3 2f 80 7b ed 0a , d1 2f f3 c8 01 9f 36 df , cb 63 dd a4 65 4c a0 2a , c1 f5 5f 3b a0 ac 51 23 , 87 fd 99 5d 94 cb 84 8f , 65 6e 46 76 3f f0 70 64 , 72 6e c3 ea c2 47 a0 8d , c3 4f e1 28 d5 52 28 08 , d0 44 32 bd 19 b0 c7 bf , 54 1c 86 74 69 0d d8 0c , ea 3c b8 9b 48 08 70 34 , 8b b1 2f cb 0c af 0c 82 , 5e 02 ad dc 8b bf bf e9 , fa 05 5d ed 84 a1 8
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: 1 be , ed a2 f8 68 16 3c cb f3 , 6d a9 a1 07 00 70 d9 c0 , bf ac 09 17 70 64 79 16 , 71 06 ac 6b 96 2a 95 c0 , 54 d8 01 a5 8f 49 87 f6 , 97 d5 fe 97 65 25 85 94 , 8b 9f b6 7a 16 8d 88 06 , 46 e2 56 22 4f 81 9b 21 , 93 1c e0 48 4d 20 50 e6 , 37 8e 25 3c cc 25 b6 ea , 27 ff db 03 fd 09 07 7b , c7 af 54 e5 71 23 58 27 , 21 cf 8d b9 fb 85 cb be , 43 b4 a8 6a 84 68 7a 54 , 51 53 76 51 b7 ad 42 12 , f6 a1 2e 96 45 72 4a 1e , d2 2c e6 19 3a bc f7 f2 , 25 d0 1c ac 6c d5 39 72 , 4d 45 b9 2a 03 e9 59 ff , b1 5a b3 2f ad eb dd 56 , 46 38 3f dd 94 f2 1d 26 , 8f c8 b3 53 c3 ca 31 4f , fe ea 0f c2 75 bc ed 55 , 95 5e eb d9 40 22 de 21 , 51 b1 8c cd 78 61 36 4b , ae 32 02 2d f1 94 eb 2a , a3 0d 39 bd 66 61 1c 11 , 97 3a ec bd 5e 2f cd f1 , 7b 7b 1b d7 b0 d7 5b 57 , 18 40 8f a0 0c 28 be c6 , 9d d1 4e 44 b9 90 5c 5e , ca c8 2b b6 8c 3e 66 be , 04 17 02 85 f4 f1 92 94 , 77 d4 a4 5d f3 95 60 54 , d2 02 83 1a fd d4 1e b5 , cf 4b b2 b7 a8 58 f4 a9 , 9d 61 d1 13 0c 45 d7 1d , 92 88 37 fd 90 09 49 9f , 2a 00 c1 c9 87 62 cf 20 , 88 29 6a 68 8d 6e 92 ea , b4 56 a9 c6 79 f0 6d 0c , a6 63 32 a6 db 9a 8f 7c , f8 86 b4 9e 45 61 22 60 , 88 92 f6 ac ae b7 ea fe , c1 53 8e b8 24 32 bf fa , 39 c4 09 50 83 6f a1 51 , aa db 3a 2b 12 25 8d df , ee cd 7e 5a af 12 9c be , 78 b2 38 6f 16 66 e1 21 , fc df 6f 7c ee a7 06 a6 , 98 90 6f d7 02 fd c1 2e , 45 96 12 b0 e8 f3 06 7d , ed f1 aa 02 71 de 32 6d , e5 c1 05 e7 2f d4 a7 93 , 0f 99 31 1f e6 6b e4 e6 , de 46 e0 b1 05 7a fa a6 , bf 71 1f 16 39 9e 51 90 , 84 62 39 06 07 94 e1 11 , d7 9e 7d 99 ee 19 8a 2c , 56 aa 79 8c c9 7b a9 40 , ff bd 18 b2 b0 50 95 33 , 1d d4 4d 4e c2 ee 26 15 , e9 5b 66 8c 39 e9 09 f7 , 4e c7 28 f9 af 8a dc 05 , 5e 6e 08 58 9a 15 5c 2f , 35 3d 7f a3 5c 18 49 ab , 9b 23 59 7a 6f 03 f7 95 , 8b 7a 67 be 74 7a d3 2d , 19 49 40 3a cb 0b 1d a4 , 17 45 7a 2c c7 9a b1 87 , ea 9c b8 f5 83 f6 da 40 , c2 c5 92 6f e7 0e bb 00 , cc 52 96 0d 52 ab aa 79 , 4e 61 bf c9 ad 66 e3 bd , 00 72 46 39 1a f7 b9 95 , 43 e6 b5 e3 af c5 4a 81 , 98 85 d9 62 94 f0 a5 f6 , a9 41 86 3b f4 a4 3c 25 , 3b 72 13 c7 8
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: f 19 8e 70 , ca 3b d7 23 14 66 79 0b , 04 97 66 46 cd 19 ea 3c , 32 01 f5 16 f4 fc 54 3d , dd ad 24 25 2d 8f 17 36 , ce 46 1b 77 80 55 7b 1d , 8a 42 e0 1e 30 06 7c 08 , 80 2a a9 a3 e1 26 02 c4 , cf c6 f2 9e dd ac e4 93 , 73 e3 25 77 bb d6 fb cd , fc d4 79 c4 cf be d7 6b , 5d 46 89 88 8e c6 42 e0 , 2e 0b ba c7 cf f9 08 57 , 01 7b a6 cd b4 19 a3 12 , cb 40 3a a9 1e 98 d0 d2 , ed d0 9b eb fe 1a 9c 4a , e1 55 84 c2 e5 ab a0 fd , 34 7b a4 4c f0 d1 9e 63 , 8b ef 69 a7 76 47 9b ff , 4b e8 d2 71 94 fe 3d c4 , 6e 70 22 4f 4d fa 53 01 , 20 c5 6e 26 00 6f ed e5 , 1a 22 35 d4 8f 6f a9 61 }
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: INFO    [shard 0] storage_service - Node 172.30.0.147 state jump to normal
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: Starting listening for CQL clients on 172.30.0.147:9042...
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: Thrift server listening on 172.30.0.147:9160 ...
Sep 10 00:17:26 ip-172-30-0-147 scylla_run[804]: Seastar HTTP server listening on 172.30.0.147:10000 ...
Sep 10 00:17:27 ip-172-30-0-147 scylla_run[804]: INFO    [shard 0] gossip - Node 172.30.0.145 is now part of the cluster
Sep 10 00:17:27 ip-172-30-0-147 scylla_run[804]: INFO    [shard 0] gossip - inet_address 172.30.0.145 is now UP
Sep 10 00:17:27 ip-172-30-0-147 scylla_run[804]: INFO    [shard 0] gossip - Node 172.30.0.146 is now part of the cluster
Sep 10 00:17:29 ip-172-30-0-147 scylla_run[804]: WARN    [shard 0] gossip - Fail to send EchoMessage to 172.30.0.146:0: rpc::timeout_error (rpc call timed out)
Sep 10 00:17:39 ip-172-30-0-147 scylla_run[804]: INFO    [shard 0] gossip - Node 172.30.0.146 has restarted, now UP
Sep 10 00:17:39 ip-172-30-0-147 scylla_run[804]: WARN    [shard 0] gossip - Fail to send EchoMessage to 172.30.0.146:0: rpc::closed_error (connection is closed)
Sep 10 00:17:39 ip-172-30-0-147 scylla_run[804]: INFO    [shard 0] storage_service - Node 172.30.0.146 state jump to normal
Sep 10 00:24:56 ip-172-30-0-147 sudo[890]:   fedora : TTY=pts/0 ; PWD=/home/fedora ; USER=root ; COMMAND=/bin/cat /var/lib/scylla/conf/scylla.yaml

[fedora@ip-172-30-0-146 ~]$ sudo cat /var/lib/scylla/conf/scylla.yaml|grep -E 'seeds|rpc_address|listen_address'|grep -v "^#"
          # seeds is actually a comma-delimited list of addresses.
          - seeds: "172.30.0.145"
listen_address: 172.30.0.146
rpc_address: 172.30.0.146
[fedora@ip-172-30-0-146 ~]$ curl -X GET --header "Accept: application/json" "http://`hostname`:10000/gossiper/endpoint/live/"
["172.30.0.146"]

[asias]

I can confirm with

commit 554292c1aff9d3899f5a14707b1591439ff430ae
Author: Tomasz Grabiec <tgrabiec@cloudius-systems.com>
Date:   Wed Sep 9 18:42:10 2015 +0200

    utils/large_bitset: Fix buffer overflow in load()/save()

    Also fixes https://github.com/cloudius-systems/seastar/issues/54

The abort goes away. After update the patched scylla binary on the failed node. I can rejoin the node into the cluster (this also suggests we are good in terms of rejoining a node). See blow:

[fedora@ip-172-30-0-145 ~]$ curl -X GET --header "Accept: application/json" "http://`hostname`:10000/gossiper/endpoint/live/"
["172.30.0.145","172.30.0.146","172.30.0.147"]


[fedora@ip-172-30-0-146 ~]$ curl -X GET --header "Accept: application/json" "http://`hostname`:10000/gossiper/endpoint/live/"
["172.30.0.145","172.30.0.146","172.30.0.147"]

[fedora@ip-172-30-0-147 ~]$ curl -X GET --header "Accept: application/json" "http://`hostname`:10000/gossiper/endpoint/live/"
["172.30.0.145","172.30.0.146","172.30.0.147"]

[dorlaor]

Good progress Asias.

Can you please provide details about what was tested, how (A wiki for new
comers should be nice), and
what's next on your agenda?

On Thu, Sep 10, 2015 at 3:58 AM, Asias He notifications@github.com wrote:

I can confirm with

commit 554292c1aff9d3899f5a14707b1591439ff430ae
Author: Tomasz Grabiec tgrabiec@cloudius-systems.com
Date: Wed Sep 9 18:42:10 2015 +0200

utils/large_bitset: Fix buffer overflow in load()/save()

Also fixes https://github.com/cloudius-systems/seastar/issues/54

The abort goes away. After update the patched scylla binary on the failed
node. I can rejoin the node into the cluster (this also suggests we are
good in terms of rejoining a node). See blow:

[fedora@ip-172-30-0-145 ~]$ curl -X GET --header "Accept: application/json" "http://hostname:10000/gossiper/endpoint/live/"
["172.30.0.145","172.30.0.146","172.30.0.147"]

[fedora@ip-172-30-0-146 ~]$ curl -X GET --header "Accept: application/json" "http://hostname:10000/gossiper/endpoint/live/"
["172.30.0.145","172.30.0.146","172.30.0.147"]

[fedora@ip-172-30-0-147 ~]$ curl -X GET --header "Accept: application/json" "http://hostname:10000/gossiper/endpoint/live/"
["172.30.0.145","172.30.0.146","172.30.0.147"]

—
Reply to this email directly or view it on GitHub
#326 (comment)
.

[asias]

I updated it here:

https://github.com/cloudius-systems/urchin/wiki/Using-AWS-AMI

I'm still have trouble running cassandra-stress against a cluster.