Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CoreDumpEvent(Segmentation fault) during rolling upgrade in ami and ami-arm test #14342

Closed
1 of 2 tasks
temichus opened this issue Jun 21, 2023 · 18 comments
Closed
1 of 2 tasks

CoreDumpEvent(Segmentation fault) during rolling upgrade in ami and ami-arm test #14342

temichus opened this issue Jun 21, 2023 · 18 comments
Assignees
@tchaikov @bhalevy
Labels
area/rolling upgrades
Milestone
5.4.1

Comments

@temichus
Copy link
Contributor

Issue description

  • This issue is a regression.
  • It is unknown if this issue is a regression.

Installation details (ami-arm)

Kernel Version: 5.15.0-1036-aws
Scylla version (or git commit hash): 5.3.0~rc0-20230523.3c3621db072d with build-id ac735c65cfc09d37f3191db6df39e94b8ec0417b

Cluster size: 4 nodes (im4gn.2xlarge)

Scylla Nodes used in this run:

  • rolling-upgrade--null-db-node-0968268b-4 (54.171.59.249 | 10.4.2.140) (shards: 7)
  • rolling-upgrade--null-db-node-0968268b-3 (54.229.108.14 | 10.4.1.95) (shards: 7)
  • rolling-upgrade--null-db-node-0968268b-2 (3.250.217.18 | 10.4.2.224) (shards: 7)
  • rolling-upgrade--null-db-node-0968268b-1 (52.31.119.197 | 10.4.3.131) (shards: 7)

OS / Image: `` (aws: undefined_region)

Test: rolling-upgrade-ami-arm-test
Test id: 0968268b-af4d-4c2c-a354-8d3843eb4b2f
Test name: scylla-master/rolling-upgrade/rolling-upgrade-ami-arm-test
Test config file(s):

Logs and commands
  • Restore Monitor Stack command: $ hydra investigate show-monitor 0968268b-af4d-4c2c-a354-8d3843eb4b2f
  • Restore monitor on AWS instance using Jenkins job
  • Show all stored logs command: $ hydra investigate show-logs 0968268b-af4d-4c2c-a354-8d3843eb4b2f

Logs:

Jenkins job URL
Argus

Installation details (ami)

Kernel Version: 5.15.0-1036-aws
Scylla version (or git commit hash): 5.3.0~rc0-20230523.3c3621db072d with build-id 78cb9caaf1cdd0b37c3a38fa83548e6c4e3d4ab4

Cluster size: 4 nodes (i3.2xlarge)

Scylla Nodes used in this run:

  • rolling-upgrade--null-db-node-bfb39068-4 (34.245.61.240 | 10.4.0.243) (shards: 7)
  • rolling-upgrade--null-db-node-bfb39068-3 (3.250.168.87 | 10.4.2.54) (shards: 7)
  • rolling-upgrade--null-db-node-bfb39068-2 (34.242.255.1 | 10.4.0.141) (shards: 7)
  • rolling-upgrade--null-db-node-bfb39068-1 (34.244.142.107 | 10.4.1.63) (shards: 7)

OS / Image: `` (aws: undefined_region)

Test: rolling-upgrade-ami-test
Test id: bfb39068-18f2-414e-9f1c-5180862ce211
Test name: scylla-master/rolling-upgrade/rolling-upgrade-ami-test
Test config file(s):

Logs and commands
  • Restore Monitor Stack command: $ hydra investigate show-monitor bfb39068-18f2-414e-9f1c-5180862ce211
  • Restore monitor on AWS instance using Jenkins job
  • Show all stored logs command: $ hydra investigate show-logs bfb39068-18f2-414e-9f1c-5180862ce211

Logs:

Jenkins job URL
Argus
@temichus
Copy link
Contributor Author

ami-arm

gsutil cp gs://upload.scylladb.com/core.scylla.112.7e0d140229f1404ba1aebbbd550aa8c7.29504.1686977059000000/core.scylla.112.7e0d140229f1404ba1aebbbd550aa8c7.29504.1686977059000000.gz .
gunzip /var/lib/systemd/coredump/core.scylla.112.7e0d140229f1404ba1aebbbd550aa8c7.29504.1686977059000000.gz

2023-06-17 04:49:46.737 <2023-06-17 04:44:19.000>: (CoreDumpEvent Severity.ERROR) period_type=one-time event_id=9e19a6fb-dbab-4032-ae61-7df8caefa1ea node=Node rolling-upgrade--null-db-node-0968268b-1 [52.31.119.197 | 10.4.3.131] (seed: True)
corefile_url=https://storage.cloud.google.com/upload.scylladb.com/core.scylla.112.7e0d140229f1404ba1aebbbd550aa8c7.29504.1686977059000000/core.scylla.112.7e0d140229f1404ba1aebbbd550aa8c7.29504.1686977059000000.gz
backtrace=           PID: 29504 (scylla)
UID: 112 (scylla)
GID: 118 (scylla)
Signal: 11 (SEGV)
Timestamp: Sat 2023-06-17 04:44:19 UTC (1min 37s ago)
Command Line: /usr/bin/scylla --blocked-reactor-notify-ms 500 --abort-on-lsa-bad-alloc 1 --abort-on-seastar-bad-alloc --abort-on-internal-error 1 --log-to-syslog 1 --log-to-stdout 0 --default-log-level info --network-stack posix --io-properties-file=/etc/scylla.d/io_properties.yaml --cpuset 1-7 --lock-memory=1
Executable: /opt/scylladb/libexec/scylla
Control Group: /scylla.slice/scylla-server.slice/scylla-server.service
Unit: scylla-server.service
Slice: scylla-server.slice
Boot ID: 7e0d140229f1404ba1aebbbd550aa8c7
Machine ID: ec29741863822bf7a1265e996407b2af
Hostname: rolling-upgrade--null-db-node-0968268b-1
Storage: /var/lib/systemd/coredump/core.scylla.112.7e0d140229f1404ba1aebbbd550aa8c7.29504.1686977059000000 (present)
Disk Size: 28.2G
Message: Process 29504 (scylla) of user 112 dumped core.
Found module linux-vdso.so.1 with build-id: e1e3e02895258d9781edead3edde7f924df33bb4
Found module libcrypto.so.3 with build-id: dcab6bc781ae98c442bde46a7fce1e0e3747fd1c
Metadata for module libcrypto.so.3 owned by FDO found: {
"type" : "rpm",
"name" : "openssl",
"version" : "3.0.8-1.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libssl.so.3 with build-id: eb6dfedbec7ecc2995521f1e6c876948a13a953a
Metadata for module libssl.so.3 owned by FDO found: {
"type" : "rpm",
"name" : "openssl",
"version" : "3.0.8-1.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libzstd.so.1 with build-id: 701f68ff6ad93ee61d47236b3d6b6084b84c8152
Metadata for module libzstd.so.1 owned by FDO found: {
"type" : "rpm",
"name" : "zstd",
"version" : "1.5.5-1.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module liblzma.so.5 with build-id: 6d7c44a4a503435c35e9a0a65b97c44115d29829
Metadata for module liblzma.so.5 owned by FDO found: {
"type" : "rpm",
"name" : "xz",
"version" : "5.4.1-1.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libcap.so.2 with build-id: 0a00151d73f3a9bdb7f22db54049122cc24d75e6
Metadata for module libcap.so.2 owned by FDO found: {
"type" : "rpm",
"name" : "libcap",
"version" : "2.48-5.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libicudata.so.71 with build-id: 995bcdf2082a10165b6b0fe912800efad5136c0e
Metadata for module libicudata.so.71 owned by FDO found: {
"type" : "rpm",
"name" : "icu",
"version" : "71.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libffi.so.8 with build-id: ba598b4c7456dfbc03e428b468dd2e1d01092544
Metadata for module libffi.so.8 owned by FDO found: {
"type" : "rpm",
"name" : "libffi",
"version" : "3.4.4-1.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libc.so.6 with build-id: 10b4c278657371efa1b4540de00ec3d8ad1db81e
Found module libgcc_s.so.1 with build-id: a7b7f02be351cef87d3f497eb90c2bc0c704225c
Found module libstdc++.so.6 with build-id: 4a9830d6d1ff9611f2a44d71b87c0cf4e46bcace
Found module libboost_unit_test_framework.so.1.78.0 with build-id: acb6e7a19a90417cb7e3ecf6c52a23ea6c8ec78d
Metadata for module libboost_unit_test_framework.so.1.78.0 owned by FDO found: {
"type" : "rpm",
"name" : "boost",
"version" : "1.78.0-9.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libthrift-0.14.0.so with build-id: 04f0bbf6b86f616723f221954b6e3ea2fafc2559
Metadata for module libthrift-0.14.0.so owned by FDO found: {
"type" : "rpm",
"name" : "thrift",
"version" : "0.14.0-11.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_low_level_hash.so.2206.0.0 with build-id: 03b5c5b4a0960b9e4261bdf5adfe84c368d2a81a
Metadata for module libabsl_low_level_hash.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_bad_variant_access.so.2206.0.0 with build-id: d07f1b22e74b4e9b45e93d32eb5b7a3addfe00d7
Metadata for module libabsl_bad_variant_access.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_city.so.2206.0.0 with build-id: 616070a058e62707c5c53142ed7c457a7caaea37
Metadata for module libabsl_city.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_hash.so.2206.0.0 with build-id: 89b9a74acf8d5d4737c91720b804a32c34862ff2
Metadata for module libabsl_hash.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_time_zone.so.2206.0.0 with build-id: d8f6fe352965f4c3f919a082881bcb27f6367c77
Metadata for module libabsl_time_zone.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_log_severity.so.2206.0.0 with build-id: b203f5dfe58560d2088ebe7cfc728a8690e96c0c
Metadata for module libabsl_log_severity.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_raw_logging_internal.so.2206.0.0 with build-id: f246610d474cb9a433e418df3bd2d87141a09d88
Metadata for module libabsl_raw_logging_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_throw_delegate.so.2206.0.0 with build-id: 4f4eab802dd8cc5bacd203a4a233731b804204c8
Metadata for module libabsl_throw_delegate.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_int128.so.2206.0.0 with build-id: 1ec26167fd0e46887b039d8b186f987ad5cbb554
Metadata for module libabsl_int128.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_spinlock_wait.so.2206.0.0 with build-id: e87b5fe3c643198487de1e84d7e503e78b29cc6b
Metadata for module libabsl_spinlock_wait.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_base.so.2206.0.0 with build-id: 4ba56748dc5e87ff5760d3e674b68494f677db27
Metadata for module libabsl_base.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_strings_internal.so.2206.0.0 with build-id: 3f5a160096df71f98b76f6684b27d3703612fe90
Metadata for module libabsl_strings_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_strings.so.2206.0.0 with build-id: 66da9410dfd80ad5e66dde184653567fac7fe02e
Metadata for module libabsl_strings.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_civil_time.so.2206.0.0 with build-id: f1d9992b3b67d5e2029f3f7b6300651485bf527f
Metadata for module libabsl_civil_time.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_time.so.2206.0.0 with build-id: 7efb44089904f365f03c47c2401b0a723eb15241
Metadata for module libabsl_time.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_malloc_internal.so.2206.0.0 with build-id: 2611dc36e032c901729376ec4faf8d457a78a581
Metadata for module libabsl_malloc_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_demangle_internal.so.2206.0.0 with build-id: 1d880e9da634410e41f0347e92c1fe866daee1ea
Metadata for module libabsl_demangle_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_debugging_internal.so.2206.0.0 with build-id: a2448eb7e5137225daae7039bd2c6c57c24675d0
Metadata for module libabsl_debugging_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_symbolize.so.2206.0.0 with build-id: 1ec22e27d413d8f78493f709762a516c982565a9
Metadata for module libabsl_symbolize.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_stacktrace.so.2206.0.0 with build-id: dc102b75fef10b664fdd20e4d78e1d31264af6ef
Metadata for module libabsl_stacktrace.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_graphcycles_internal.so.2206.0.0 with build-id: bdad69436826047e36c8c5cca7c9161c874d62a7
Metadata for module libabsl_graphcycles_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_synchronization.so.2206.0.0 with build-id: 972eaa53f421215923fcf41f71a78cbe08770e96
Metadata for module libabsl_synchronization.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_exponential_biased.so.2206.0.0 with build-id: 965718919a61d3cb3875df02c0e3aea99445df58
Metadata for module libabsl_exponential_biased.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_hashtablez_sampler.so.2206.0.0 with build-id: 6193c00a24d2ef747c175231bfa810c56660f0d1
Metadata for module libabsl_hashtablez_sampler.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_bad_optional_access.so.2206.0.0 with build-id: 6829040a8305721f593a2e8134bea859ecf8c2ff
Metadata for module libabsl_bad_optional_access.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_raw_hash_set.so.2206.0.0 with build-id: 067f46c24a618300415ef72e201d2da10aac1f32
Metadata for module libabsl_raw_hash_set.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libsystemd.so.0 with build-id: 1d1747e6124a2b788479b71e9b4dc33411c8b483
Metadata for module libsystemd.so.0 owned by FDO found: {
"type" : "rpm",
"name" : "systemd",
"version" : "251.14-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module liblua-5.4.so with build-id: 0b1b0dced9bb79b9eb08256ae93a5148362d8016
Metadata for module liblua-5.4.so owned by FDO found: {
"type" : "rpm",
"name" : "lua",
"version" : "5.4.4-9.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libdeflate.so.0 with build-id: 8c572ef5886beff9db08be64bf5615514f7fded2
Metadata for module libdeflate.so.0 owned by FDO found: {
"type" : "rpm",
"name" : "libdeflate",
"version" : "1.9-4.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libxxhash.so.0 with build-id: b11aa0ce26141210d9db603e8a60a66e6556bec9
Metadata for module libxxhash.so.0 owned by FDO found: {
"type" : "rpm",
"name" : "xxhash",
"version" : "0.8.1-3.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libicui18n.so.71 with build-id: 7c19ee6d38a416a4a560dcece3efa1bd54309840
Metadata for module libicui18n.so.71 owned by FDO found: {
"type" : "rpm",
"name" : "icu",
"version" : "71.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libicuuc.so.71 with build-id: ecd98116c0d7438b0623ef046f0c18c6106a4497
Metadata for module libicuuc.so.71 owned by FDO found: {
"type" : "rpm",
"name" : "icu",
"version" : "71.1-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libboost_regex.so.1.78.0 with build-id: 25c02d0df46f513c02885d9e4a8ee10262e4c2c1
Metadata for module libboost_regex.so.1.78.0 owned by FDO found: {
"type" : "rpm",
"name" : "boost",
"version" : "1.78.0-9.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libboost_date_time.so.1.78.0 with build-id: a0d8f3087b876029c4cdece2b77bcee68b180d9f
Metadata for module libboost_date_time.so.1.78.0 owned by FDO found: {
"type" : "rpm",
"name" : "boost",
"version" : "1.78.0-9.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libcrypt.so.2 with build-id: 099822142928a36ff598e01d9973aceaf5ba7ab0
Metadata for module libcrypt.so.2 owned by FDO found: {
"type" : "rpm",
"name" : "libxcrypt",
"version" : "4.4.33-4.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libjsoncpp.so.25 with build-id: dbba45aac3dc1d4bdc3e51cb1eb014e45671b145
Metadata for module libjsoncpp.so.25 owned by FDO found: {
"type" : "rpm",
"name" : "jsoncpp",
"version" : "1.9.5-3.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libsnappy.so.1 with build-id: 88932fff7e3fe77b537350b3f2afdd4fe33a04d1
Metadata for module libsnappy.so.1 owned by FDO found: {
"type" : "rpm",
"name" : "snappy",
"version" : "1.1.9-5.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libz.so.1 with build-id: 8a7596982e38b2cb686257c378fa77a777dcab6e
Metadata for module libz.so.1 owned by FDO found: {
"type" : "rpm",
"name" : "zlib",
"version" : "1.2.12-5.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libyaml-cpp.so.0.6 with build-id: c4530958e52e72c550198606fe186379d3482170
Metadata for module libyaml-cpp.so.0.6 owned by FDO found: {
"type" : "rpm",
"name" : "yaml-cpp",
"version" : "0.6.3-7.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libm.so.6 with build-id: 78337de1c3b24a559a8577090e5c8b4e8001da52
Found module libhwloc.so.15 with build-id: b7d6a95e9e9e89a393c1e88c3f7b477de3279ac0
Metadata for module libhwloc.so.15 owned by FDO found: {
"type" : "rpm",
"name" : "hwloc",
"version" : "2.5.0-4.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libp11-kit.so.0 with build-id: 60747d0f4fc30eac79f37dcd047008b2c7e13d0b
Metadata for module libp11-kit.so.0 owned by FDO found: {
"type" : "rpm",
"name" : "p11-kit",
"version" : "0.24.1-3.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libidn2.so.0 with build-id: ea93cef68eb6760a9433897673e52960367ad6d5
Metadata for module libidn2.so.0 owned by FDO found: {
"type" : "rpm",
"name" : "libidn2",
"version" : "2.3.4-1.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libtasn1.so.6 with build-id: d83dfefbafee81050843af4dbb2d4c43914c1bbe
Metadata for module libtasn1.so.6 owned by FDO found: {
"type" : "rpm",
"name" : "libtasn1",
"version" : "4.19.0-1.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libhogweed.so.6 with build-id: a1407850b89a8842c4528f1c2b429310710467f1
Metadata for module libhogweed.so.6 owned by FDO found: {
"type" : "rpm",
"name" : "nettle",
"version" : "3.8-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libnettle.so.8 with build-id: 61522fa0bc6d7f99d22da71a98fd6586e4da61a5
Metadata for module libnettle.so.8 owned by FDO found: {
"type" : "rpm",
"name" : "nettle",
"version" : "3.8-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libunistring.so.2 with build-id: cf50775319e356143a2a7c9f9ec94b9afd9a4bc9
Metadata for module libunistring.so.2 owned by FDO found: {
"type" : "rpm",
"name" : "libunistring",
"version" : "1.0-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libgmp.so.10 with build-id: e67edd6c9eab0af4a523f91d6c6a157dbf8dfb03
Metadata for module libgmp.so.10 owned by FDO found: {
"type" : "rpm",
"name" : "gmp",
"version" : "6.2.1-3.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libgnutls.so.30 with build-id: 8c68e1b4060e8f9f77fe63960592c7e0199c3e08
Metadata for module libgnutls.so.30 owned by FDO found: {
"type" : "rpm",
"name" : "gnutls",
"version" : "3.8.0-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module liblz4.so.1 with build-id: eaee60fd51c0b90e5bcb6e66e9d1661db90928b2
Metadata for module liblz4.so.1 owned by FDO found: {
"type" : "rpm",
"name" : "lz4",
"version" : "1.9.4-1.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libatomic.so.1 with build-id: 82f84bc9616628576fb5fbe862984cdc0ad26ee3
Found module libnuma.so.1 with build-id: 72ec22b2c066ea65fb3e78b60aed3581b0207c50
Metadata for module libnuma.so.1 owned by FDO found: {
"type" : "rpm",
"name" : "numactl",
"version" : "2.0.14-6.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libsctp.so.1 with build-id: d42909753e274233cc70d4d221352a5c99ead497
Metadata for module libsctp.so.1 owned by FDO found: {
"type" : "rpm",
"name" : "lksctp-tools",
"version" : "1.0.19-2.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libfmt.so.9 with build-id: d3bb801ec0be093b8cefed2618cd01809fcb7d03
Metadata for module libfmt.so.9 owned by FDO found: {
"type" : "rpm",
"name" : "fmt",
"version" : "9.1.0-1.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libcryptopp.so.8 with build-id: dd7d891958b398b97ac6a0f0e4f347849d16b259
Metadata for module libcryptopp.so.8 owned by FDO found: {
"type" : "rpm",
"name" : "cryptopp",
"version" : "8.6.0-2.fc36",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:36"
}
Found module libcares.so.2 with build-id: 24b7eae87e67d0c14eef4196e892662cadf15c0b
Metadata for module libcares.so.2 owned by FDO found: {
"type" : "rpm",
"name" : "c-ares",
"version" : "1.19.0-1.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libboost_system.so.1.78.0 with build-id: 1fde0c0f6c2a67a3c786cf815a5f116da2809240
Metadata for module libboost_system.so.1.78.0 owned by FDO found: {
"type" : "rpm",
"name" : "boost",
"version" : "1.78.0-9.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libboost_thread.so.1.78.0 with build-id: de56dcad487c1c67d3022e884e3e34a9dce45513
Metadata for module libboost_thread.so.1.78.0 owned by FDO found: {
"type" : "rpm",
"name" : "boost",
"version" : "1.78.0-9.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libboost_program_options.so.1.78.0 with build-id: 36ff752af111cacedde64420adc5219c132ed1d6
Metadata for module libboost_program_options.so.1.78.0 owned by FDO found: {
"type" : "rpm",
"name" : "boost",
"version" : "1.78.0-9.fc37",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module scylla with build-id: b1bb4567ca64a3869bc408b9fac400ff34d2de3c
Stack trace of thread 29510:
#0  0x000000000147fc0c _ZN7replica8database18find_column_familyERKN5utils11tagged_uuidI12table_id_tagEE (scylla + 0x127fc0c)
#1  0x00000000019ebdcc _ZSt16__introsort_loopIN9__gnu_cxx17__normal_iteratorIPN10compaction16table_tasks_infoESt6vectorIS3_SaIS3_EEEElNS0_5__ops15_Iter_comp_iterIZNSt6ranges8__detail16__make_comp_projISt7greaterIvEZNS2_15run_table_tasksERN7replica8databaseES7_RN7seastar18condition_variableERNSJ_13lw_shared_ptrIN5tasks12task_manager4taskEEEbE3$_1EEDaRT_RT0_EUlOST_OSV_E_EEEvST_ST_SV_T1_ (scylla + 0x17ebdcc)
#2  0x00000000019f9fb4 _ZN10compaction15run_table_tasksERN7replica8databaseESt6vectorINS_16table_tasks_infoESaIS4_EERN7seastar18condition_variableERNS7_13lw_shared_ptrIN5tasks12task_manager4taskEEEb.resume (scylla + 0x17f9fb4)
#3  0x0000000001128d74 _ZN7seastar8internal21coroutine_traits_baseIvE12promise_type15run_and_disposeEv (scylla + 0xf28d74)
#4  0x00000000033be2d0 _ZN7seastar7reactor14run_some_tasksEv (scylla + 0x31be2d0)
#5  0x00000000033bf264 _ZN7seastar7reactor6do_runEv (scylla + 0x31bf264)
#6  0x00000000033df248 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x31df248)
#7  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#8  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#9  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29516:
#0  0x0000ffff91731f54 read (libc.so.6 + 0xe1f54)
#1  0x00000000033fe2c8 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x31fe2c8)
#2  0x00000000033fe59c _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x31fe59c)
#3  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#4  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#5  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29514:
#0  0x0000ffff91731f54 read (libc.so.6 + 0xe1f54)
#1  0x00000000033fe2c8 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x31fe2c8)
#2  0x00000000033fe59c _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x31fe59c)
#3  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#4  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#5  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29517:
#0  0x0000ffff91731f54 read (libc.so.6 + 0xe1f54)
#1  0x00000000033fe2c8 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x31fe2c8)
#2  0x00000000033fe59c _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x31fe59c)
#3  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#4  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#5  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29515:
#0  0x0000ffff91731f54 read (libc.so.6 + 0xe1f54)
#1  0x00000000033fe2c8 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x31fe2c8)
#2  0x00000000033fe59c _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x31fe59c)
#3  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#4  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#5  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29519:
#0  0x0000ffff91731f54 read (libc.so.6 + 0xe1f54)
#1  0x00000000033fe2c8 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x31fe2c8)
#2  0x00000000033fe59c _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x31fe59c)
#3  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#4  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#5  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29520:
#0  0x0000ffff91731f54 read (libc.so.6 + 0xe1f54)
#1  0x00000000033fe2c8 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x31fe2c8)
#2  0x00000000033fe59c _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x31fe59c)
#3  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#4  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#5  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29518:
#0  0x0000ffff91731f54 read (libc.so.6 + 0xe1f54)
#1  0x00000000033fe2c8 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x31fe2c8)
#2  0x00000000033fe59c _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x31fe59c)
#3  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#4  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#5  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29504:
#0  0x000000000147fbe4 _ZN7replica8database18find_column_familyERKN5utils11tagged_uuidI12table_id_tagEE (scylla + 0x127fbe4)
#1  0x00000000019ebdf8 _ZSt16__introsort_loopIN9__gnu_cxx17__normal_iteratorIPN10compaction16table_tasks_infoESt6vectorIS3_SaIS3_EEEElNS0_5__ops15_Iter_comp_iterIZNSt6ranges8__detail16__make_comp_projISt7greaterIvEZNS2_15run_table_tasksERN7replica8databaseES7_RN7seastar18condition_variableERNSJ_13lw_shared_ptrIN5tasks12task_manager4taskEEEbE3$_1EEDaRT_RT0_EUlOST_OSV_E_EEEvST_ST_SV_T1_ (scylla + 0x17ebdf8)
#2  0x00000000019f9fb4 _ZN10compaction15run_table_tasksERN7replica8databaseESt6vectorINS_16table_tasks_infoESaIS4_EERN7seastar18condition_variableERNS7_13lw_shared_ptrIN5tasks12task_manager4taskEEEb.resume (scylla + 0x17f9fb4)
#3  0x0000000001128d74 _ZN7seastar8internal21coroutine_traits_baseIvE12promise_type15run_and_disposeEv (scylla + 0xf28d74)
#4  0x00000000033be2d0 _ZN7seastar7reactor14run_some_tasksEv (scylla + 0x31be2d0)
#5  0x00000000033bf264 _ZN7seastar7reactor6do_runEv (scylla + 0x31bf264)
#6  0x00000000033be794 _ZN7seastar7reactor3runEv (scylla + 0x31be794)
#7  0x000000000336d5f8 _ZN7seastar12app_template14run_deprecatedEiPPcOSt8functionIFvvEE (scylla + 0x316d5f8)
#8  0x000000000336cac0 _ZN7seastar12app_template3runEiPPcOSt8functionIFNS_6futureIiEEvEE (scylla + 0x316cac0)
#9  0x00000000010dbf30 _ZL11scylla_mainiPPc (scylla + 0xedbf30)
#10 0x00000000010dce88 _ZNKSt8functionIFiiPPcEEclEiS1_ (scylla + 0xedce88)
#11 0x00000000010db2f8 main (scylla + 0xedb2f8)
#12 0x0000ffff9167b588 __libc_start_call_main (libc.so.6 + 0x2b588)
#13 0x0000ffff9167b660 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b660)
#14 0x00000000010d9f30 _start (scylla + 0xed9f30)
Stack trace of thread 29508:
#0  0x000000000147fc0c _ZN7replica8database18find_column_familyERKN5utils11tagged_uuidI12table_id_tagEE (scylla + 0x127fc0c)
#1  0x00000000019ebdcc _ZSt16__introsort_loopIN9__gnu_cxx17__normal_iteratorIPN10compaction16table_tasks_infoESt6vectorIS3_SaIS3_EEEElNS0_5__ops15_Iter_comp_iterIZNSt6ranges8__detail16__make_comp_projISt7greaterIvEZNS2_15run_table_tasksERN7replica8databaseES7_RN7seastar18condition_variableERNSJ_13lw_shared_ptrIN5tasks12task_manager4taskEEEbE3$_1EEDaRT_RT0_EUlOST_OSV_E_EEEvST_ST_SV_T1_ (scylla + 0x17ebdcc)
#2  0x00000000019f9fb4 _ZN10compaction15run_table_tasksERN7replica8databaseESt6vectorINS_16table_tasks_infoESaIS4_EERN7seastar18condition_variableERNS7_13lw_shared_ptrIN5tasks12task_manager4taskEEEb.resume (scylla + 0x17f9fb4)
#3  0x0000000001128d74 _ZN7seastar8internal21coroutine_traits_baseIvE12promise_type15run_and_disposeEv (scylla + 0xf28d74)
#4  0x00000000033be2d0 _ZN7seastar7reactor14run_some_tasksEv (scylla + 0x31be2d0)
#5  0x00000000033bf264 _ZN7seastar7reactor6do_runEv (scylla + 0x31bf264)
#6  0x00000000033df248 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x31df248)
#7  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#8  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#9  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29507:
#0  0x000000000147fc74 _ZN7replica8database18find_column_familyERKN5utils11tagged_uuidI12table_id_tagEE (scylla + 0x127fc74)
#1  0x00000000019ebdcc _ZSt16__introsort_loopIN9__gnu_cxx17__normal_iteratorIPN10compaction16table_tasks_infoESt6vectorIS3_SaIS3_EEEElNS0_5__ops15_Iter_comp_iterIZNSt6ranges8__detail16__make_comp_projISt7greaterIvEZNS2_15run_table_tasksERN7replica8databaseES7_RN7seastar18condition_variableERNSJ_13lw_shared_ptrIN5tasks12task_manager4taskEEEbE3$_1EEDaRT_RT0_EUlOST_OSV_E_EEEvST_ST_SV_T1_ (scylla + 0x17ebdcc)
#2  0x00000000019f9fb4 _ZN10compaction15run_table_tasksERN7replica8databaseESt6vectorINS_16table_tasks_infoESaIS4_EERN7seastar18condition_variableERNS7_13lw_shared_ptrIN5tasks12task_manager4taskEEEb.resume (scylla + 0x17f9fb4)
#3  0x0000000001128d74 _ZN7seastar8internal21coroutine_traits_baseIvE12promise_type15run_and_disposeEv (scylla + 0xf28d74)
#4  0x00000000033be2d0 _ZN7seastar7reactor14run_some_tasksEv (scylla + 0x31be2d0)
#5  0x00000000033bf264 _ZN7seastar7reactor6do_runEv (scylla + 0x31bf264)
#6  0x00000000033df248 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x31df248)
#7  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#8  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#9  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29506:
#0  0x000000000147fbe4 _ZN7replica8database18find_column_familyERKN5utils11tagged_uuidI12table_id_tagEE (scylla + 0x127fbe4)
#1  0x00000000019ebdcc _ZSt16__introsort_loopIN9__gnu_cxx17__normal_iteratorIPN10compaction16table_tasks_infoESt6vectorIS3_SaIS3_EEEElNS0_5__ops15_Iter_comp_iterIZNSt6ranges8__detail16__make_comp_projISt7greaterIvEZNS2_15run_table_tasksERN7replica8databaseES7_RN7seastar18condition_variableERNSJ_13lw_shared_ptrIN5tasks12task_manager4taskEEEbE3$_1EEDaRT_RT0_EUlOST_OSV_E_EEEvST_ST_SV_T1_ (scylla + 0x17ebdcc)
#2  0x00000000019f9fb4 _ZN10compaction15run_table_tasksERN7replica8databaseESt6vectorINS_16table_tasks_infoESaIS4_EERN7seastar18condition_variableERNS7_13lw_shared_ptrIN5tasks12task_manager4taskEEEb.resume (scylla + 0x17f9fb4)
#3  0x0000000001128d74 _ZN7seastar8internal21coroutine_traits_baseIvE12promise_type15run_and_disposeEv (scylla + 0xf28d74)
#4  0x00000000033be2d0 _ZN7seastar7reactor14run_some_tasksEv (scylla + 0x31be2d0)
#5  0x00000000033bf264 _ZN7seastar7reactor6do_runEv (scylla + 0x31bf264)
#6  0x00000000033df248 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x31df248)
#7  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#8  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#9  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
Stack trace of thread 29505:
#0  0x0000000001610260 _ZN11atomic_cellC1ERK13abstract_type16atomic_cell_view (scylla + 0x1410260)
#1  0x00000000016ce288 _ZZNK36collection_mutation_view_description11materializeERK13abstract_typeENK3$_1clERK20collection_type_impl (scylla + 0x14ce288)
#2  0x00000000016c7634 _ZNK36collection_mutation_view_description11materializeERK13abstract_type (scylla + 0x14c7634)
#3  0x000000000166ff9c _ZN18compact_radix_tree4treeI13cell_and_hashjE14weed_from_slotIRZN3row9remove_ifIZNS4_18compact_and_expireERK6schema11column_kind13row_tombstoneNSt6chrono10time_pointI8gc_clockNSB_8durationIlSt5ratioILl1ELl1EEEEEERSt8functionIFb9tombstoneEESI_RK10row_markerP28compaction_garbage_collectorE4$_21EEvOT_EUljRS1_E_EEbRNS2_9node_headEhPS1_SV_j (scylla + 0x146ff9c)
#4  0x000000000166facc _ZN18compact_radix_tree4treeI13cell_and_hashjE14weed_from_slotIRZN3row9remove_ifIZNS4_18compact_and_expireERK6schema11column_kind13row_tombstoneNSt6chrono10time_pointI8gc_clockNSB_8durationIlSt5ratioILl1ELl1EEEEEERSt8functionIFb9tombstoneEESI_RK10row_markerP28compaction_garbage_collectorE4$_21EEvOT_EUljRS1_E_EEbPNS2_13node_head_ptrESV_j (scylla + 0x146facc)
#5  0x000000000163ca50 _ZN3row18compact_and_expireERK6schema11column_kind13row_tombstoneNSt6chrono10time_pointI8gc_clockNS5_8durationIlSt5ratioILl1ELl1EEEEEERSt8functionIFb9tombstoneEESC_RK10row_markerP28compaction_garbage_collector (scylla + 0x143ca50)
#6  0x00000000019c0fac _ZN22compact_mutation_stateIL20compact_for_sstables1EE7consumeIN8sstables26compacted_fragments_writerE33noop_compacted_fragments_consumerEEN7seastar10bool_classINS6_18stop_iteration_tagEEEO14clustering_rowRT_RT0_ (scylla + 0x17c0fac)
#7  0x00000000019bfe00 _ZNO20mutation_fragment_v27consumeIN23flat_mutation_reader_v24impl16consumer_adapterI25compact_for_compaction_v2IN8sstables26compacted_fragments_writerE33noop_compacted_fragments_consumerEEEEEDcRT_ (scylla + 0x17bfe00)
#8  0x00000000019bf980 _ZN23flat_mutation_reader_v24impl26consume_pausable_in_threadISt17reference_wrapperINS0_16consumer_adapterI25compact_for_compaction_v2IN8sstables26compacted_fragments_writerE33noop_compacted_fragments_consumerEEEENS_9no_filterEEEvT_T0_ (scylla + 0x17bf980)
#9  0x00000000019bf6b4 _ZN23flat_mutation_reader_v24impl17consume_in_threadI25compact_for_compaction_v2IN8sstables26compacted_fragments_writerE33noop_compacted_fragments_consumerENS_9no_filterEEEDaT_T0_ (scylla + 0x17bf6b4)
#10 0x00000000019bf57c _ZN23flat_mutation_reader_v217consume_in_threadI25compact_for_compaction_v2IN8sstables26compacted_fragments_writerE33noop_compacted_fragments_consumerENS_9no_filterEEEDaT_T0_ (scylla + 0x17bf57c)
#11 0x00000000019bc6b0 _ZN23flat_mutation_reader_v217consume_in_threadI25compact_for_compaction_v2IN8sstables26compacted_fragments_writerE33noop_compacted_fragments_consumerEEEDaT_ (scylla + 0x17bc6b0)
#12 0x00000000019bc10c _ZZZN8sstables10compaction7consumeEvENUl23flat_mutation_reader_v2E_clES1_ENUlvE_clEv (scylla + 0x17bc10c)
#13 0x00000000019bbe78 _ZZN7seastar5asyncIZZN8sstables10compaction7consumeEvENUl23flat_mutation_reader_v2E_clES3_EUlvE_JEEENS_8futurizeINSt13invoke_resultIT_JDpT0_EE4typeEE4typeENS_17thread_attributesEOS8_DpOS9_ENKUlvE_clEv (scylla + 0x17bbe78)
#14 0x000000000341a2b4 _ZN7seastar14thread_context4mainEv (scylla + 0x321a2b4)
Stack trace of thread 29509:
#0  0x0000ffff9173c268 syscall (libc.so.6 + 0xec268)
#1  0x0000000003403bb8 _ZN7seastar8internal9io_submitEmlPPNS0_9linux_abi4iocbE (scylla + 0x3203bb8)
#2  0x00000000033fef0c _ZN7seastar19aio_storage_context11submit_workEv (scylla + 0x31fef0c)
#3  0x000000000340029c _ZN7seastar19reactor_backend_aio18kernel_submit_workEv (scylla + 0x320029c)
#4  0x00000000033de320 _ZNSt17_Function_handlerIFbvEZN7seastar7reactor6do_runEvE4$_52E9_M_invokeERKSt9_Any_data (scylla + 0x31de320)
#5  0x00000000033bf2ac _ZN7seastar7reactor6do_runEv (scylla + 0x31bf2ac)
#6  0x00000000033df248 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x31df248)
#7  0x00000000033957ec _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x31957ec)
#8  0x0000ffff916d4fc8 start_thread (libc.so.6 + 0x84fc8)
#9  0x0000ffff917407dc thread_start (libc.so.6 + 0xf07dc)
download_instructions=gsutil cp gs://upload.scylladb.com/core.scylla.112.7e0d140229f1404ba1aebbbd550aa8c7.29504.1686977059000000/core.scylla.112.7e0d140229f1404ba1aebbbd550aa8c7.29504.1686977059000000.gz .
gunzip /var/lib/systemd/coredump/core.scylla.112.7e0d140229f1404ba1aebbbd550aa8c7.29504.1686977059000000.gz

@temichus
Copy link
Contributor Author

temichus commented Jun 21, 2023 •
edited

ami

gsutil cp gs://upload.scylladb.com/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000.gz .
gunzip /var/lib/systemd/coredump/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000.gz

2023-06-17 04:28:24.094 <2023-06-17 04:23:19.000>: (CoreDumpEvent Severity.ERROR) period_type=one-time event_id=97144e56-3905-4359-9df9-2958e47e0b36 node=Node rolling-upgrade--null-db-node-bfb39068-3 [3.250.168.87 | 10.4.2.54] (seed: True)
corefile_url=https://storage.cloud.google.com/upload.scylladb.com/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000.gz
backtrace=           PID: 30005 (scylla)
UID: 112 (scylla)
GID: 118 (scylla)
Signal: 11 (SEGV)
Timestamp: Sat 2023-06-17 04:23:19 UTC (2min 24s ago)
Command Line: /usr/bin/scylla --blocked-reactor-notify-ms 500 --abort-on-lsa-bad-alloc 1 --abort-on-seastar-bad-alloc --abort-on-internal-error 1 --log-to-syslog 1 --log-to-stdout 0 --default-log-level info --network-stack posix --io-properties-file=/etc/scylla.d/io_properties.yaml --cpuset 1-7 --lock-memory=1
Executable: /opt/scylladb/libexec/scylla
Control Group: /scylla.slice/scylla-server.slice/scylla-server.service
Unit: scylla-server.service
Slice: scylla-server.slice
Boot ID: bb9c38662c264defa204fa36c901264e
Machine ID: 8c7c593a46884998bb95f12819532856
Hostname: rolling-upgrade--null-db-node-bfb39068-3
Storage: /var/lib/systemd/coredump/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000 (present)
Disk Size: 55.3G
Message: Process 30005 (scylla) of user 112 dumped core.
Found module linux-vdso.so.1 with build-id: cb55ed141f12299197ef6d2ba79f53e793fe7f51
Found module libcrypto.so.3 with build-id: 5f86a956fe1375ca4bcc060da69449c1840d3ddd
Metadata for module libcrypto.so.3 owned by FDO found: {
"type" : "rpm",
"name" : "openssl",
"version" : "3.0.8-1.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libssl.so.3 with build-id: ec66552a3db19f64f2810273283ab3f335f6d9a0
Metadata for module libssl.so.3 owned by FDO found: {
"type" : "rpm",
"name" : "openssl",
"version" : "3.0.8-1.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libzstd.so.1 with build-id: acc023d4e29c24327ef3e1a7ad9cf6185421b16b
Metadata for module libzstd.so.1 owned by FDO found: {
"type" : "rpm",
"name" : "zstd",
"version" : "1.5.5-1.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module liblzma.so.5 with build-id: 229e4304be252acde566b640d512c5daf306b971
Metadata for module liblzma.so.5 owned by FDO found: {
"type" : "rpm",
"name" : "xz",
"version" : "5.4.1-1.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libcap.so.2 with build-id: f3f24bb6e411e3885602e753eda1e764fc1f5bfb
Metadata for module libcap.so.2 owned by FDO found: {
"type" : "rpm",
"name" : "libcap",
"version" : "2.48-5.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libicudata.so.71 with build-id: 47276216e74b87c4b9bd01ac85c7bf332e6f2aed
Metadata for module libicudata.so.71 owned by FDO found: {
"type" : "rpm",
"name" : "icu",
"version" : "71.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libffi.so.8 with build-id: 56594b436dfdeaf3559f3dd0748c0e476cca46de
Metadata for module libffi.so.8 owned by FDO found: {
"type" : "rpm",
"name" : "libffi",
"version" : "3.4.4-1.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module ld.so with build-id: bb6fec54c7521fddc569a2f4e141dfb97bf3acbe
Found module libc.so.6 with build-id: 81daba31ee66dbd63efdc4252a872949d874d136
Found module libgcc_s.so.1 with build-id: bad96a3adc0a3a006e7ef4900ff3ae1ddcc33ed2
Found module libstdc++.so.6 with build-id: 5c63442039be42a72c8722574572171b19f18d66
Found module libboost_unit_test_framework.so.1.78.0 with build-id: a36d99071d10c86578feab1480b17b8842ebf327
Metadata for module libboost_unit_test_framework.so.1.78.0 owned by FDO found: {
"type" : "rpm",
"name" : "boost",
"version" : "1.78.0-9.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libthrift-0.14.0.so with build-id: 17998af2b27e0e5d136b0a16c5b0a380314fac76
Metadata for module libthrift-0.14.0.so owned by FDO found: {
"type" : "rpm",
"name" : "thrift",
"version" : "0.14.0-11.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_low_level_hash.so.2206.0.0 with build-id: fdc2e19d07f096efad1bda8b1cc6bea21d123251
Metadata for module libabsl_low_level_hash.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_bad_variant_access.so.2206.0.0 with build-id: 1f590c0023e04f11b40241a4ddf594ee45aa4beb
Metadata for module libabsl_bad_variant_access.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_city.so.2206.0.0 with build-id: 41317e95f94aab848cc33a5cda517e3f49d71546
Metadata for module libabsl_city.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_hash.so.2206.0.0 with build-id: ff096a0a3c80b19b1ef2943e4260a2e841fcf8e6
Metadata for module libabsl_hash.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_time_zone.so.2206.0.0 with build-id: 0d29b564e560fcc7571511a2374dc92d8f4c372c
Metadata for module libabsl_time_zone.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_log_severity.so.2206.0.0 with build-id: ed0db9c343a3fcba9ca557f201dac37127fa4f8c
Metadata for module libabsl_log_severity.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_raw_logging_internal.so.2206.0.0 with build-id: 72311601321423fbe0059f92782915f80df9c60d
Metadata for module libabsl_raw_logging_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_throw_delegate.so.2206.0.0 with build-id: 932f5e508e1571a7c6667bd86a17aff76ffc4180
Metadata for module libabsl_throw_delegate.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_int128.so.2206.0.0 with build-id: 05d04d47bedd259ccbf9b092769b32fd0d8b765f
Metadata for module libabsl_int128.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_spinlock_wait.so.2206.0.0 with build-id: f8b9f8cc0c1b25ca41377433a64a6550b26907cb
Metadata for module libabsl_spinlock_wait.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_base.so.2206.0.0 with build-id: 089fe509992453bb2d1ce48f76af25b761468153
Metadata for module libabsl_base.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_strings_internal.so.2206.0.0 with build-id: f094d922b90ac4e56294f6b32a2130ff0a895a86
Metadata for module libabsl_strings_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_strings.so.2206.0.0 with build-id: 1c21cdc8941756892ad1b004150d4a39efbbd6c2
Metadata for module libabsl_strings.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_civil_time.so.2206.0.0 with build-id: dc41ccb89909a366a5be4900c4ad3414ed818790
Metadata for module libabsl_civil_time.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_time.so.2206.0.0 with build-id: a7dd777b5bf5cf7438b8fd418396c05ea00d8371
Metadata for module libabsl_time.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_malloc_internal.so.2206.0.0 with build-id: 15fca201e10b00f727694f7bac973d81ac1d7d22
Metadata for module libabsl_malloc_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_demangle_internal.so.2206.0.0 with build-id: e5c07a3c01cb5e97f543ecaa85659de88af66a82
Metadata for module libabsl_demangle_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_debugging_internal.so.2206.0.0 with build-id: 91aad3458461d78f421f83684b9d31ae5ba95764
Metadata for module libabsl_debugging_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_symbolize.so.2206.0.0 with build-id: cacbe0e5704729a2198db9ea87680dc292474c9f
Metadata for module libabsl_symbolize.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_stacktrace.so.2206.0.0 with build-id: 0c356bbf44c196a8964e52aba16bd6fb494dbd9e
Metadata for module libabsl_stacktrace.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_graphcycles_internal.so.2206.0.0 with build-id: e226bdc2aae8a5fb7bc33ee829471bc327562c26
Metadata for module libabsl_graphcycles_internal.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_synchronization.so.2206.0.0 with build-id: 4735025bbc9620497773e101f64c600116766443
Metadata for module libabsl_synchronization.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_exponential_biased.so.2206.0.0 with build-id: 9c52b6b35dd5467d2bdc5742bea8f7223892f249
Metadata for module libabsl_exponential_biased.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_hashtablez_sampler.so.2206.0.0 with build-id: 6de93b940b6f342a03efd7ad4758b9eaed0acbb9
Metadata for module libabsl_hashtablez_sampler.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_bad_optional_access.so.2206.0.0 with build-id: 0baafb3bd65e673b35368a6e339a2b3822de4314
Metadata for module libabsl_bad_optional_access.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libabsl_raw_hash_set.so.2206.0.0 with build-id: b5cdc3a20fcb6192028df8d6abff4c7a45bc5cb8
Metadata for module libabsl_raw_hash_set.so.2206.0.0 owned by FDO found: {
"type" : "rpm",
"name" : "abseil-cpp",
"version" : "20220623.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libsystemd.so.0 with build-id: daf81fef8e9a910d25dbf2312ad2a3670bfedf2c
Metadata for module libsystemd.so.0 owned by FDO found: {
"type" : "rpm",
"name" : "systemd",
"version" : "251.14-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module liblua-5.4.so with build-id: 1b859f8bd50772ce0b191ad7280404d708e6f2dd
Metadata for module liblua-5.4.so owned by FDO found: {
"type" : "rpm",
"name" : "lua",
"version" : "5.4.4-9.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libdeflate.so.0 with build-id: 4a9b9e6426b09c7727eca5906705cd47d6356b52
Metadata for module libdeflate.so.0 owned by FDO found: {
"type" : "rpm",
"name" : "libdeflate",
"version" : "1.9-4.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libxxhash.so.0 with build-id: e9d597d29fee60aa936d42919d5478b1489fcfcd
Metadata for module libxxhash.so.0 owned by FDO found: {
"type" : "rpm",
"name" : "xxhash",
"version" : "0.8.1-3.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libicui18n.so.71 with build-id: f4748e4011f7e0fd328ade31e62bc9167e417b74
Metadata for module libicui18n.so.71 owned by FDO found: {
"type" : "rpm",
"name" : "icu",
"version" : "71.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libicuuc.so.71 with build-id: f0a97a601f057dd0739c60482ff1b33c5e054456
Metadata for module libicuuc.so.71 owned by FDO found: {
"type" : "rpm",
"name" : "icu",
"version" : "71.1-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libboost_regex.so.1.78.0 with build-id: 72db12b143d11d0a1f6b4d087ba66b0bed1b143a
Metadata for module libboost_regex.so.1.78.0 owned by FDO found: {
"type" : "rpm",
"name" : "boost",
"version" : "1.78.0-9.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libboost_date_time.so.1.78.0 with build-id: eb65c4205b9d9fd037e8c33e34d2f0c529041ff2
Metadata for module libboost_date_time.so.1.78.0 owned by FDO found: {
"type" : "rpm",
"name" : "boost",
"version" : "1.78.0-9.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libcrypt.so.2 with build-id: e9a4200cc454d25322877cefcc51815d420ac9aa
Metadata for module libcrypt.so.2 owned by FDO found: {
"type" : "rpm",
"name" : "libxcrypt",
"version" : "4.4.33-4.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libjsoncpp.so.25 with build-id: 81664b30fef3b5f5552d5127aa7df65a5540b19e
Metadata for module libjsoncpp.so.25 owned by FDO found: {
"type" : "rpm",
"name" : "jsoncpp",
"version" : "1.9.5-3.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libsnappy.so.1 with build-id: a7aec4ee674baa81a2a0f445be25f068d676fe4b
Metadata for module libsnappy.so.1 owned by FDO found: {
"type" : "rpm",
"name" : "snappy",
"version" : "1.1.9-5.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libz.so.1 with build-id: d94299d7572e23295ceaf7674110eb6f2689cd91
Metadata for module libz.so.1 owned by FDO found: {
"type" : "rpm",
"name" : "zlib",
"version" : "1.2.12-5.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libyaml-cpp.so.0.6 with build-id: 4b5879027e25c21db9008a81ce6936b85aeb856e
Metadata for module libyaml-cpp.so.0.6 owned by FDO found: {
"type" : "rpm",
"name" : "yaml-cpp",
"version" : "0.6.3-7.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libm.so.6 with build-id: 9ca49f056adbf7edc2bda92b95a74d491abe03f2
Found module libhwloc.so.15 with build-id: dc3323c96c1be89f9270a8b8e4e9623181a59e84
Metadata for module libhwloc.so.15 owned by FDO found: {
"type" : "rpm",
"name" : "hwloc",
"version" : "2.5.0-4.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libp11-kit.so.0 with build-id: eab90567b10ce2fa21b2a7eb4e5a3e097e63b4af
Metadata for module libp11-kit.so.0 owned by FDO found: {
"type" : "rpm",
"name" : "p11-kit",
"version" : "0.24.1-3.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libidn2.so.0 with build-id: 220865bcdf15c803f8dd897650798ecb5c2ef1e6
Metadata for module libidn2.so.0 owned by FDO found: {
"type" : "rpm",
"name" : "libidn2",
"version" : "2.3.4-1.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libtasn1.so.6 with build-id: 98238deb249115cc63cf294d5e3f04a26b204496
Metadata for module libtasn1.so.6 owned by FDO found: {
"type" : "rpm",
"name" : "libtasn1",
"version" : "4.19.0-1.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libhogweed.so.6 with build-id: 6f32d090a6de6b372ab9258d2f9656c808aba96d
Metadata for module libhogweed.so.6 owned by FDO found: {
"type" : "rpm",
"name" : "nettle",
"version" : "3.8-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libnettle.so.8 with build-id: c0f18d9e28d93220296008fe3bc58b22347b1835
Metadata for module libnettle.so.8 owned by FDO found: {
"type" : "rpm",
"name" : "nettle",
"version" : "3.8-2.fc37",
"architecture" : "x86_64",
"osCpe" : "cpe:/o:fedoraproject:fedora:37"
}
Found module libunistring.so.2 with build-id: 0c89f0c5be4a239b6ab72dc3aa015b95fc8ede0d
Stack trace of thread 30008:
#0  0x00000000059a87bf _ZN7seastar3tls7sessionC2ENS1_4typeENS_10shared_ptrINS0_23certificate_credentialsEEESt10unique_ptrINS_3net21connected_socket_implESt14default_deleteIS8_EENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x57a87bf)
#1  0x00000000059a86e5 _ZN7seastar3tls7sessionC2ENS1_4typeENS_10shared_ptrINS0_23certificate_credentialsEEENS_16connected_socketENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x57a86e5)
#2  0x00000000059a85f2 _ZN7seastar13lw_shared_ptrINS_3tls7sessionEE4makeIJNS2_4typeENS_10shared_ptrINS1_23certificate_credentialsEEENS_16connected_socketENS_13basic_sstringIcjLj15ELb1EEEEEES3_DpOT_ (scylla + 0x57a85f2)
#3  0x0000000005986f9c _ZN7seastar3tls11wrap_clientENS_10shared_ptrINS0_23certificate_credentialsEEEONS_16connected_socketENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x5786f9c)
#4  0x00000000059a8506 _ZSt13__invoke_implIN7seastar6futureINS0_16connected_socketEEERZNS0_3tls15tls_socket_impl7connectENS0_14socket_addressES6_NS0_9transportEEUlS2_E_JS2_EET_St14__invoke_otherOT0_DpOT1_ (scylla + 0x57a8506)
#5  0x00000000059a8446 _ZN7seastar8futurizeINS_6futureINS_16connected_socketEEEE22satisfy_with_result_ofIZZNS3_14then_impl_nrvoIZNS_3tls15tls_socket_impl7connectENS_14socket_addressES9_NS_9transportEEUlS2_E_S3_EET0_OT_ENKUlONS_8internal22promise_base_with_typeIS2_EERSB_ONS_12future_stateIS2_EEE_clESI_SJ_SM_EUlvE_EEvSI_SE_ (scylla + 0x57a8446)
#6  0x00000000059a8362 _ZN7seastar12continuationINS_8internal22promise_base_with_typeINS_16connected_socketEEEZNS_3tls15tls_socket_impl7connectENS_14socket_addressES7_NS_9transportEEUlS3_E_ZNS_6futureIS3_E14then_impl_nrvoIS9_SB_EET0_OT_EUlOS4_RS9_ONS_12future_stateIS3_EEE_S3_E15run_and_disposeEv (scylla + 0x57a8362)
#7  0x0000000005616e85 _ZN7seastar7reactor14run_some_tasksEv (scylla + 0x5416e85)
#8  0x0000000005618108 _ZN7seastar7reactor6do_runEv (scylla + 0x5418108)
#9  0x000000000563a8d2 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x543a8d2)
#10 0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#11 0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#12 0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30017:
#0  0x00007f0ca8fbb21c read (libc.so.6 + 0xfb21c)
#1  0x000000000565bde5 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x545bde5)
#2  0x000000000565c0f2 _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x545c0f2)
#3  0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#4  0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#5  0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30016:
#0  0x00007f0ca8fbb21c read (libc.so.6 + 0xfb21c)
#1  0x000000000565bde5 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x545bde5)
#2  0x000000000565c0f2 _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x545c0f2)
#3  0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#4  0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#5  0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30012:
#0  0x00007f0ca8fbb21c read (libc.so.6 + 0xfb21c)
#1  0x000000000565bde5 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x545bde5)
#2  0x000000000565c0f2 _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x545c0f2)
#3  0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#4  0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#5  0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30015:
#0  0x00007f0ca8fbb21c read (libc.so.6 + 0xfb21c)
#1  0x000000000565bde5 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x545bde5)
#2  0x000000000565c0f2 _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x545c0f2)
#3  0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#4  0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#5  0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30018:
#0  0x00007f0ca8fbb21c read (libc.so.6 + 0xfb21c)
#1  0x000000000565bde5 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x545bde5)
#2  0x000000000565c0f2 _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x545c0f2)
#3  0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#4  0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#5  0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30013:
#0  0x00007f0ca8fbb21c read (libc.so.6 + 0xfb21c)
#1  0x000000000565bde5 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x545bde5)
#2  0x000000000565c0f2 _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x545c0f2)
#3  0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#4  0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#5  0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30007:
#0  0x0000000001b9dd34 _ZN16atomic_cell_type9make_liveIN27fragmented_temporary_buffer4viewEEE13managed_byteslRKT_ (scylla + 0x199dd34)
#1  0x0000000001b9dae6 _ZN11atomic_cell9make_liveERK13abstract_typelRKN27fragmented_temporary_buffer4viewEN7seastar10bool_classINS_21collection_member_tagEEE (scylla + 0x199dae6)
#2  0x00000000022d6d3e _ZN8sstables2mx17mp_row_consumer_m14consume_columnERKNS_18column_translation11column_infoESt17basic_string_viewIaSt11char_traitsIaEEN27fragmented_temporary_buffer4viewElNSt6chrono8durationIlSt5ratioILl1ELl1EEEENSC_10time_pointI8gc_clockSG_EEb (scylla + 0x20d6d3e)
#3  0x00000000023137c9 _ZN8sstables2mx27data_consume_rows_context_mINS0_17mp_row_consumer_mEE16do_process_stateEv.resume (scylla + 0x21137c9)
#4  0x00000000022f05d7 _ZN13data_consumer24continuous_data_consumerIN8sstables2mx27data_consume_rows_context_mINS2_17mp_row_consumer_mEEEEclEN7seastar16temporary_bufferIcEE (scylla + 0x20f05d7)
#5  0x00000000022efad7 _ZZN7seastar12input_streamIcE7consumeISt17reference_wrapperIN8sstables2mx27data_consume_rows_context_mINS5_17mp_row_consumer_mEEEEEENS_6futureIvEEOT_ENUlvE_clEv (scylla + 0x20efad7)
#6  0x00000000022f48e3 _ZZZN8sstables2mx26mx_sstable_mutation_reader11fill_bufferEvENKUlvE1_clEvENKUlvE0_clEv (scylla + 0x20f48e3)
#7  0x00000000022fa8da _ZN7seastar8internal14do_until_stateIZZN8sstables2mx26mx_sstable_mutation_reader11fill_bufferEvENKUlvE1_clEvEUlvE_ZZNS4_11fill_bufferEvENKS5_clEvEUlvE0_E15run_and_disposeEv (scylla + 0x20fa8da)
#8  0x0000000005616e85 _ZN7seastar7reactor14run_some_tasksEv (scylla + 0x5416e85)
#9  0x0000000005618108 _ZN7seastar7reactor6do_runEv (scylla + 0x5418108)
#10 0x000000000563a8d2 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x543a8d2)
#11 0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#12 0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#13 0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30005:
#0  0x00007f0ca8fbb2bf __write (libc.so.6 + 0xfb2bf)
#1  0x000000000564100c _ZN7seastar9file_desc5writeEPKvm (scylla + 0x544100c)
#2  0x0000000005639c11 _ZZN7seastar18syscall_work_queue11submit_itemESt10unique_ptrINS0_9work_itemESt14default_deleteIS2_EEEN4$_55clENS_6futureIvEE (scylla + 0x5439c11)
#3  0x00000000056196ef _ZN7seastar18syscall_work_queue11submit_itemESt10unique_ptrINS0_9work_itemESt14default_deleteIS2_EE (scylla + 0x54196ef)
#4  0x00000000055b7033 _ZN7seastar18syscall_work_queue6submitINS_14syscall_resultIiEEEENS_6futureIT_EENS_20noncopyable_functionIFS5_vEEE (scylla + 0x53b7033)
#5  0x00000000056085aa _ZN7seastar7reactor11rename_fileESt17basic_string_viewIcSt11char_traitsIcEES4_ (scylla + 0x54085aa)
#6  0x00000000059e4dc0 _ZN7seastar11rename_fileESt17basic_string_viewIcSt11char_traitsIcEES3_ (scylla + 0x57e4dc0)
#7  0x00000000022955ac _ZN8sstables18filesystem_storage4sealERKNS_7sstableE.resume (scylla + 0x20955ac)
#8  0x000000000128f43b _ZN7seastar8internal21coroutine_traits_baseIvE12promise_type15run_and_disposeEv (scylla + 0x108f43b)
#9  0x0000000005616e85 _ZN7seastar7reactor14run_some_tasksEv (scylla + 0x5416e85)
#10 0x0000000005618108 _ZN7seastar7reactor6do_runEv (scylla + 0x5418108)
#11 0x000000000561744a _ZN7seastar7reactor3runEv (scylla + 0x541744a)
#12 0x00000000055bb366 _ZN7seastar12app_template14run_deprecatedEiPPcOSt8functionIFvvEE (scylla + 0x53bb366)
#13 0x00000000055ba4d9 _ZN7seastar12app_template3runEiPPcOSt8functionIFNS_6futureIiEEvEE (scylla + 0x53ba4d9)
#14 0x00000000012176d4 _ZL11scylla_mainiPPc (scylla + 0x10176d4)
#15 0x0000000001219261 _ZNKSt8functionIFiiPPcEEclEiS1_ (scylla + 0x1019261)
#16 0x0000000001215af8 main (scylla + 0x1015af8)
#17 0x00007f0ca8ee7510 __libc_start_call_main (libc.so.6 + 0x27510)
#18 0x00007f0ca8ee75c9 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x275c9)
#19 0x00000000012136a5 _start (scylla + 0x10136a5)
Stack trace of thread 30006:
#0  0x00007f0ca8fc492d syscall (libc.so.6 + 0x10492d)
#1  0x0000000005661da1 _ZN7seastar8internal13io_pgeteventsEmllPNS0_9linux_abi8io_eventEPK8timespecPK10__sigset_tb (scylla + 0x5461da1)
#2  0x000000000565d9d5 _ZN7seastar19reactor_backend_aio12await_eventsEiPK10__sigset_t (scylla + 0x545d9d5)
#3  0x000000000565e0f0 _ZN7seastar19reactor_backend_aio23wait_and_process_eventsEPK10__sigset_t (scylla + 0x545e0f0)
#4  0x000000000561840d _ZN7seastar7reactor6do_runEv (scylla + 0x541840d)
#5  0x000000000563a8d2 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x543a8d2)
#6  0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#7  0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#8  0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30014:
#0  0x00007f0ca8fbb21c read (libc.so.6 + 0xfb21c)
#1  0x000000000565bde5 _ZN7seastar11thread_pool4workENS_13basic_sstringIcjLj15ELb1EEE (scylla + 0x545bde5)
#2  0x000000000565c0f2 _ZNSt17_Function_handlerIFvvEZN7seastar11thread_poolC1EPNS1_7reactorENS1_13basic_sstringIcjLj15ELb1EEEE3$_0E9_M_invokeERKSt9_Any_data (scylla + 0x545c0f2)
#3  0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#4  0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#5  0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30009:
#0  0x0000000005661cb0 _ZN7seastar8internalL15try_reap_eventsEmllPNS0_9linux_abi8io_eventEPK8timespecb (scylla + 0x5461cb0)
#1  0x0000000005661d6b _ZN7seastar8internal13io_pgeteventsEmllPNS0_9linux_abi8io_eventEPK8timespecPK10__sigset_tb (scylla + 0x5461d6b)
#2  0x000000000565d9d5 _ZN7seastar19reactor_backend_aio12await_eventsEiPK10__sigset_t (scylla + 0x545d9d5)
#3  0x000000000565de1f _ZN7seastar19reactor_backend_aio23reap_kernel_completionsEv (scylla + 0x545de1f)
#4  0x00000000056399e9 _ZNSt17_Function_handlerIFbvEZN7seastar7reactor6do_runEvE4$_52E9_M_invokeERKSt9_Any_data (scylla + 0x54399e9)
#5  0x0000000005618152 _ZN7seastar7reactor6do_runEv (scylla + 0x5418152)
#6  0x000000000563a8d2 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x543a8d2)
#7  0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#8  0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#9  0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30010:
#0  0x000000000565d0d8 _ZN7seastar19aio_storage_context16reap_completionsEb (scylla + 0x545d0d8)
#1  0x000000000565de32 _ZN7seastar19reactor_backend_aio23reap_kernel_completionsEv (scylla + 0x545de32)
#2  0x00000000056399e9 _ZNSt17_Function_handlerIFbvEZN7seastar7reactor6do_runEvE4$_52E9_M_invokeERKSt9_Any_data (scylla + 0x54399e9)
#3  0x0000000005618152 _ZN7seastar7reactor6do_runEv (scylla + 0x5418152)
#4  0x000000000563a8d2 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x543a8d2)
#5  0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#6  0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#7  0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
Stack trace of thread 30011:
#0  0x00000000022dc893 _ZN8sstables24mutation_fragment_filter5applyE26position_in_partition_view9tombstone (scylla + 0x20dc893)
#1  0x00000000022d3610 _ZN8sstables2mx17mp_row_consumer_m17consume_row_startERKSt6vectorI27fragmented_temporary_bufferSaIS3_EE (scylla + 0x20d3610)
#2  0x0000000002315463 _ZN8sstables2mx27data_consume_rows_context_mINS0_17mp_row_consumer_mEE16do_process_stateEv.resume (scylla + 0x2115463)
#3  0x00000000022f05d7 _ZN13data_consumer24continuous_data_consumerIN8sstables2mx27data_consume_rows_context_mINS2_17mp_row_consumer_mEEEEclEN7seastar16temporary_bufferIcEE (scylla + 0x20f05d7)
#4  0x00000000022efad7 _ZZN7seastar12input_streamIcE7consumeISt17reference_wrapperIN8sstables2mx27data_consume_rows_context_mINS5_17mp_row_consumer_mEEEEEENS_6futureIvEEOT_ENUlvE_clEv (scylla + 0x20efad7)
#5  0x00000000022f48e3 _ZZZN8sstables2mx26mx_sstable_mutation_reader11fill_bufferEvENKUlvE1_clEvENKUlvE0_clEv (scylla + 0x20f48e3)
#6  0x00000000022fa8da _ZN7seastar8internal14do_until_stateIZZN8sstables2mx26mx_sstable_mutation_reader11fill_bufferEvENKUlvE1_clEvEUlvE_ZZNS4_11fill_bufferEvENKS5_clEvEUlvE0_E15run_and_disposeEv (scylla + 0x20fa8da)
#7  0x0000000005616e85 _ZN7seastar7reactor14run_some_tasksEv (scylla + 0x5416e85)
#8  0x0000000005618108 _ZN7seastar7reactor6do_runEv (scylla + 0x5418108)
#9  0x000000000563a8d2 _ZNSt17_Function_handlerIFvvEZN7seastar3smp9configureERKNS1_11smp_optionsERKNS1_15reactor_optionsEE4$_96E9_M_invokeERKSt9_Any_data (scylla + 0x543a8d2)
#10 0x00000000055e769b _ZN7seastar12posix_thread13start_routineEPv (scylla + 0x53e769b)
#11 0x00007f0ca8f4b12d start_thread (libc.so.6 + 0x8b12d)
#12 0x00007f0ca8fccbc0 __clone3 (libc.so.6 + 0x10cbc0)
download_instructions=gsutil cp gs://upload.scylladb.com/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000.gz .
gunzip /var/lib/systemd/coredump/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000.gz

@temichus temichus changed the title CoreDumpEvent during rolling upgrade in ami and ami-arm test CoreDumpEvent(Segmentation fault) during rolling upgrade in ami and ami-arm test Jun 21, 2023
@rayakurl rayakurl added the triage/master Looking for assignee label Jun 28, 2023
@rayakurl rayakurl mentioned this issue Jun 29, 2023
Closed
2 tasks
@mykaul
Copy link
Contributor

mykaul commented Jun 29, 2023

@DoronArazii - how did we miss this one? It has master/triaged, but no one looked at it.

@DoronArazii
Copy link

@bhalevy can you please assign to someone who can provide some first assessment

@DoronArazii DoronArazii modified the milestones: 5.4, 5.3 Jul 3, 2023
@mykaul
Copy link
Contributor

mykaul commented Jul 3, 2023

_ZN7seastar3tls7sessionC2ENS1_4typeENS_10shared_ptrINS0_23certificate_credentialsEEESt10unique_ptrINS_3net21connected_socket_implESt14default_deleteIS8_EENS_13basic_sstringIcjLj15ELb1EEE

@DoronArazii - this one is well understood and is a dup, let's not waste time on it (or at least I'm quite sure it's a dup)

@bhalevy
Copy link
Member

bhalevy commented Jul 3, 2023

@tchaikov please look into the logs and analyze the coredump, thanks

@tchaikov
Copy link
Contributor

tchaikov commented Jul 4, 2023 •
edited

#14342 (comment) is a dup of #14299, which should be addressed by #14493 .

EDIT, the 2nd comment is a dup. still looking at the first one.

@mykaul
Copy link
Contributor

mykaul commented Jul 4, 2023

it's a dup of #14299, which should be addressed by #14493 .

@tchaikov - so is #14342 (comment) ? It seems different?

@tchaikov
Copy link
Contributor

tchaikov commented Jul 4, 2023

@mykaul yeah, it seems the first comment is a different issue.

@DoronArazii DoronArazii modified the milestones: 5.3, 5.4 Jul 9, 2023
@tchaikov
Copy link
Contributor

with Artsiom's kind help, i am able to get authorized with gsutil. now running

gsutil cp gs://upload.scylladb.com/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000/core.scylla.112.bb9c38662c264defa204fa36c901264e.30005.1686975799000000.gz .

i kept it running the whole night. but it still running with 100% cpu usage when i was back to work this morning. will take a closer look.

@mykaul
Copy link
Contributor

mykaul commented Oct 22, 2023

@tchaikov - any updates?

@mykaul
Copy link
Contributor

mykaul commented Oct 26, 2023

ping @tchaikov
(also - relevant here - #14744 ?)

@mykaul
Copy link
Contributor

mykaul commented Nov 1, 2023

ping @tchaikov

@mykaul
Copy link
Contributor

mykaul commented Nov 1, 2023

Unrelated probably, but I wonder if the toolchain is missing some update:

Found module libcryptopp.so.8 with build-id: dd7d891958b398b97ac6a0f0e4f347849d16b259
Metadata for module libcryptopp.so.8 owned by FDO found: {
"type" : "rpm",
"name" : "cryptopp",
"version" : "8.6.0-2.fc36",
"architecture" : "aarch64",
"osCpe" : "cpe:/o:fedoraproject:fedora:36"

Unsure why it's coming from Fedora 36, while the rest is Fedora 37.

@tchaikov
Copy link
Contributor

tchaikov commented Nov 2, 2023

@mykaul hi Yaniv, i am tied by other work items. will be back to this one.

@mykaul
Copy link
Contributor

mykaul commented Nov 22, 2023

@roydahan - can we re-run all upgrade tests for RC2?

@roydahan
Copy link

You probably know it by now, but just for the record for others.
Any new RC, automatically triggers artifact-tests, rolling-upgrades and several short longevities.
(There are some dependencies between them, so not all of them are triggered together.
E.g. until artifact-tests pass, rolling upgrades won't start).

@mykaul mykaul modified the milestones: 5.4, 5.4.1 Dec 11, 2023
@mykaul
Copy link
Contributor

mykaul commented Jan 8, 2024

Haven't seen it for a while - closing.

@mykaul mykaul closed this as not planned Won't fix, can't repro, duplicate, stale Jan 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tchaikov tchaikov

@bhalevy bhalevy

Labels
area/rolling upgrades
Projects
None yet
Milestone
5.4.1
Development

No branches or pull requests
7 participants
@tchaikov @temichus @mykaul @bhalevy @roydahan @DoronArazii @rayakurl