Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

asan: flaky replication/replicaset_ro_mostly.test.lua test on 1.10 #189

Open
avtikhon opened this issue Sep 26, 2020 · 0 comments
Open

asan: flaky replication/replicaset_ro_mostly.test.lua test on 1.10 #189

avtikhon opened this issue Sep 26, 2020 · 0 comments
Assignees
@avtikhon
Labels
asan flaky test qa

Comments

@avtikhon
Copy link
Contributor

Tarantool version:
1.10 only

Tarantool 1.10.7-40-gca34edd542
Target: Linux-x86_64-RelWithDebInfo
Build options: cmake . -DCMAKE_INSTALL_PREFIX=/usr/local -DENABLE_BACKTRACE=ON
Compiler: /usr/bin/clang-8 /usr/bin/clang++-8
C_FLAGS: -Wno-unknown-pragmas -fexceptions -funwind-tables -fno-omit-frame-pointer -fno-stack-protector -fno-common -msse2 -fsanitize=address -fsanitize-blacklist=/builds/M4RrgQZ3/0/tarantool/tarantool/asan/asan.supp -std=c11 -Wall -Wextra -Wno-strict-aliasing -Wno-char-subscripts -Wno-gnu-alignof-expression -Werror
CXX_FLAGS: -Wno-unknown-pragmas -fexceptions -funwind-tables -fno-omit-frame-pointer -fno-stack-protector -fno-common -msse2 -fsanitize=address -fsanitize-blacklist=/builds/M4RrgQZ3/0/tarantool/tarantool/asan/asan.supp -std=c++11 -Wall -Wextra -Wno-strict-aliasing -Wno-char-subscripts -Wno-invalid-offsetof -Wno-gnu-alignof-expression -Werror

OS version:
Linux (Debian 10)

Bug description:
https://gitlab.com/tarantool/tarantool/-/jobs/759121030#L3586
https://gitlab.com/tarantool/tarantool/-/jobs/759121030#L3683

artifacts.zip

results file checksum: b2647b5bdbda47efe5b1add57285d226

[063] replication/replicaset_ro_mostly.test.lua       vinyl           
[063] 
[063] [Instance "replica_uuid_ro1" returns with non-zero exit code: 1]
[063] 
[063] Last 15 lines of Tarantool Log file [Instance "replica_uuid_ro1"][/builds/M4RrgQZ3/0/tarantool/tarantool/test/var/063_replication/replica_uuid_ro1.log]:
[063]     tarantool/tarantool#3 0x7d2421 in coio_on_call /builds/M4RrgQZ3/0/tarantool/tarantool/src/coio_task.c:264:16
[063]     tarantool/tarantool#4 0xcc0abe in eio_execute /builds/M4RrgQZ3/0/tarantool/tarantool/third_party/libeio/eio.c:2015:9
[063]     tarantool/tarantool#5 0xcc0abe in etp_proc /builds/M4RrgQZ3/0/tarantool/tarantool/third_party/libeio/etp.c:373
[063]     tarantool/tarantool#6 0x7ffff58b3fa2 in start_thread (/lib/x86_64-linux-gnu/libpthread.so.0+0x7fa2)
[063] 
[063] Indirect leak of 4 byte(s) in 1 object(s) allocated from:
[063]     #0 0x4da9ca in calloc (/builds/M4RrgQZ3/0/tarantool/tarantool/src/tarantool+0x4da9ca)
[063]     tarantool/tarantool#1 0x7e192f in mh_i64ptr_new /builds/M4RrgQZ3/0/tarantool/tarantool/src/lib/salad/mhash.h:411:22
[063]     tarantool/tarantool#2 0x698c24 in vy_recovery_new_f /builds/M4RrgQZ3/0/tarantool/tarantool/src/box/vy_log.c:2173:23
[063]     tarantool/tarantool#3 0x7d2421 in coio_on_call /builds/M4RrgQZ3/0/tarantool/tarantool/src/coio_task.c:264:16
[063]     tarantool/tarantool#4 0xcc0abe in eio_execute /builds/M4RrgQZ3/0/tarantool/tarantool/third_party/libeio/eio.c:2015:9
[063]     tarantool/tarantool#5 0xcc0abe in etp_proc /builds/M4RrgQZ3/0/tarantool/tarantool/third_party/libeio/etp.c:373
[063]     tarantool/tarantool#6 0x7ffff58b3fa2 in start_thread (/lib/x86_64-linux-gnu/libpthread.so.0+0x7fa2)
[063] 
[063] SUMMARY: AddressSanitizer: 892 byte(s) leaked in 21 allocation(s).

Steps to reproduce:

Optional (but very desirable):

  • coredump
  • backtrace
  • netstat
@avtikhon avtikhon self-assigned this Sep 26, 2020
avtikhon referenced this issue in tarantool/tarantool Sep 26, 2020
@avtikhon
Add flaky tests checksums to fragile
a1e5cf3 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/long_row_timeout.test.lua		gh-4351
  replication/qsync_advanced.test.lua		gh-5340
  replication/replicaset_ro_mostly.test.lua	gh-5342
  vinyl/ddl.test.lua				gh-5338
  vinyl/iterator.test.lua			gh-5336
avtikhon referenced this issue in tarantool/tarantool Sep 27, 2020
@avtikhon
Add flaky tests checksums to fragile
3dc0a1d 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344
  replication/qsync_advanced.test.lua		gh-5340
  replication/replicaset_ro_mostly.test.lua	gh-5342
  vinyl/ddl.test.lua				gh-5338
  vinyl/iterator.test.lua			gh-5336
avtikhon referenced this issue in tarantool/tarantool Sep 27, 2020
@avtikhon
Add flaky tests checksums to fragile
7455db1 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344
  replication/qsync_advanced.test.lua		gh-5340
  replication/replicaset_ro_mostly.test.lua	gh-5342
  vinyl/ddl.test.lua				gh-5338
  vinyl/iterator.test.lua			gh-5336
avtikhon referenced this issue in tarantool/tarantool Sep 27, 2020
@avtikhon
Add flaky tests checksums to fragile
d2ff255 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  app-tap/http_client.test.lua			gh-5346
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344
  replication/qsync_advanced.test.lua		gh-5340
  replication/replicaset_ro_mostly.test.lua	gh-5342
  vinyl/ddl.test.lua				gh-5338
  vinyl/iterator.test.lua			gh-5336

t
avtikhon referenced this issue in tarantool/tarantool Sep 27, 2020
@avtikhon
Add flaky tests checksums to fragile
70d5588 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  app-tap/http_client.test.lua			gh-5346
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344
  replication/qsync_advanced.test.lua		gh-5340
  replication/replicaset_ro_mostly.test.lua	gh-5342
  vinyl/ddl.test.lua				gh-5338
  vinyl/iterator.test.lua			gh-5336
avtikhon referenced this issue in tarantool/tarantool Sep 28, 2020
@avtikhon
Add flaky tests checksums to fragile
6eaeb7e 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  app-tap/http_client.test.lua			gh-5346
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344
  replication/qsync_advanced.test.lua		gh-5340
  replication/replicaset_ro_mostly.test.lua	gh-5342
  replication/wal_rw_stress.test.lua		gh-5347
  vinyl/ddl.test.lua				gh-5338
  vinyl/iterator.test.lua			gh-5336
avtikhon referenced this issue in tarantool/tarantool Sep 28, 2020
@avtikhon
Add flaky tests checksums to fragile
2b0e5eb 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  app-tap/http_client.test.lua			gh-5346
  box/lua.test.lua				gh-5351
  replication/autobootstrap.test.lua		gh-4533
  replication/autobootstrap_guest.test.lua	gh-4533
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344, gh-5349
  replication/qsync_advanced.test.lua		gh-5340
  replication/replicaset_ro_mostly.test.lua	gh-5342
  replication/wal_rw_stress.test.lua		gh-5347
  sql-tap/selectG.test.lua			gh-5350
  vinyl/ddl.test.lua				gh-5338
  vinyl/gh-3395-read-prepared-uncommitted.test.lua gh-5197
  vinyl/iterator.test.lua			gh-5336
  xlog/panic_on_wal_error.test.lua		gh-5348
avtikhon referenced this issue in tarantool/tarantool Sep 28, 2020
@avtikhon
Add flaky tests checksums to fragile
4d57eda 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  app-tap/debug.test.lua			gh-5346
  app-tap/http_client.test.lua			gh-5346
  app-tap/inspector.test.lua			gh-5346
  box/hash_collation.test.lua		gh-5247
  box/lua.test.lua				gh-5351
  box/net.box_on_schema_reload-gh-1904.test.lua gh-5354
  box/protocol.test.lua			gh-5247
  box/update.test.lua			gh-5247
  replication/autobootstrap.test.lua		gh-4533
  replication/autobootstrap_guest.test.lua	gh-4533
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3247-misc-iproto-sequence-value-not-replicated.test.lua.test.lua gh-5357
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344, gh-5349
  replication/qsync_advanced.test.lua		gh-5340
  replication/qsync_basic.test.lua		gh-5355
  replication/replicaset_ro_mostly.test.lua	gh-5342
  replication/wal_rw_stress.test.lua		gh-5347
  sql-tap/selectG.test.lua			gh-5350
  vinyl/ddl.test.lua				gh-5338
  vinyl/gh-3395-read-prepared-uncommitted.test.lua gh-5197
  vinyl/iterator.test.lua			gh-5336
  vinyl/write_iterator_rand.test.lua	gh-5356
  xlog/panic_on_wal_error.test.lua		gh-5348
avtikhon referenced this issue in tarantool/tarantool Sep 28, 2020
@avtikhon
Add flaky tests checksums to fragile
ea69103 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  app-tap/debug.test.lua			gh-5346
  app-tap/http_client.test.lua			gh-5346
  app-tap/inspector.test.lua			gh-5346
  box/gh-2763-session-credentials-update.test.lua gh-5363
  box/hash_collation.test.lua			gh-5247
  box/lua.test.lua				gh-5351
  box/net.box_connect_triggers_gh-2858.test.lua	gh-5247
  box/net.box_incompatible_index-gh-1729.test.lua gh-5360
  box/net.box_on_schema_reload-gh-1904.test.lua gh-5354
  box/protocol.test.lua				gh-5247
  box/update.test.lua				gh-5247
  box-tap/net.box.test.lua			gh-5346
  replication/autobootstrap.test.lua		gh-4533
  replication/autobootstrap_guest.test.lua	gh-4533
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3247-misc-iproto-sequence-value-not-replicated.test.lua.test.lua gh-5357
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344, gh-5349
  replication/prune.test.lua			gh-5361
  replication/qsync_advanced.test.lua		gh-5340
  replication/qsync_basic.test.lua		gh-5355
  replication/replicaset_ro_mostly.test.lua	gh-5342
  replication/wal_rw_stress.test.lua		gh-5347
  replication-py/multi.test.py			gh-5362
  sql/prepared.test.lua test			gh-5359
  sql-tap/selectG.test.lua			gh-5350
  vinyl/ddl.test.lua				gh-5338
  vinyl/gh-3395-read-prepared-uncommitted.test.lua gh-5197
  vinyl/iterator.test.lua			gh-5336
  vinyl/write_iterator_rand.test.lua	gh-5356
  xlog/panic_on_wal_error.test.lua		gh-5348
kyukhin referenced this issue in tarantool/tarantool Sep 28, 2020
@avtikhon @kyukhin
Add flaky tests checksums to fragile
75ba744 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  app-tap/debug.test.lua			gh-5346
  app-tap/http_client.test.lua			gh-5346
  app-tap/inspector.test.lua			gh-5346
  box/gh-2763-session-credentials-update.test.lua gh-5363
  box/hash_collation.test.lua			gh-5247
  box/lua.test.lua				gh-5351
  box/net.box_connect_triggers_gh-2858.test.lua	gh-5247
  box/net.box_incompatible_index-gh-1729.test.lua gh-5360
  box/net.box_on_schema_reload-gh-1904.test.lua gh-5354
  box/protocol.test.lua				gh-5247
  box/update.test.lua				gh-5247
  box-tap/net.box.test.lua			gh-5346
  replication/autobootstrap.test.lua		gh-4533
  replication/autobootstrap_guest.test.lua	gh-4533
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3247-misc-iproto-sequence-value-not-replicated.test.lua.test.lua gh-5357
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344, gh-5349
  replication/prune.test.lua			gh-5361
  replication/qsync_advanced.test.lua		gh-5340
  replication/qsync_basic.test.lua		gh-5355
  replication/replicaset_ro_mostly.test.lua	gh-5342
  replication/wal_rw_stress.test.lua		gh-5347
  replication-py/multi.test.py			gh-5362
  sql/prepared.test.lua test			gh-5359
  sql-tap/selectG.test.lua			gh-5350
  vinyl/ddl.test.lua				gh-5338
  vinyl/gh-3395-read-prepared-uncommitted.test.lua gh-5197
  vinyl/iterator.test.lua			gh-5336
  vinyl/write_iterator_rand.test.lua	gh-5356
  xlog/panic_on_wal_error.test.lua		gh-5348
kyukhin referenced this issue in tarantool/tarantool Sep 28, 2020
@avtikhon @kyukhin
Add flaky tests checksums to fragile
5eec6fc 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  app-tap/debug.test.lua			gh-5346
  app-tap/http_client.test.lua			gh-5346
  app-tap/inspector.test.lua			gh-5346
  box/gh-2763-session-credentials-update.test.lua gh-5363
  box/hash_collation.test.lua			gh-5247
  box/lua.test.lua				gh-5351
  box/net.box_connect_triggers_gh-2858.test.lua	gh-5247
  box/net.box_incompatible_index-gh-1729.test.lua gh-5360
  box/net.box_on_schema_reload-gh-1904.test.lua gh-5354
  box/protocol.test.lua				gh-5247
  box/update.test.lua				gh-5247
  box-tap/net.box.test.lua			gh-5346
  replication/autobootstrap.test.lua		gh-4533
  replication/autobootstrap_guest.test.lua	gh-4533
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3247-misc-iproto-sequence-value-not-replicated.test.lua.test.lua gh-5357
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344, gh-5349
  replication/prune.test.lua			gh-5361
  replication/qsync_advanced.test.lua		gh-5340
  replication/qsync_basic.test.lua		gh-5355
  replication/replicaset_ro_mostly.test.lua	gh-5342
  replication/wal_rw_stress.test.lua		gh-5347
  replication-py/multi.test.py			gh-5362
  sql/prepared.test.lua test			gh-5359
  sql-tap/selectG.test.lua			gh-5350
  vinyl/ddl.test.lua				gh-5338
  vinyl/gh-3395-read-prepared-uncommitted.test.lua gh-5197
  vinyl/iterator.test.lua			gh-5336
  vinyl/write_iterator_rand.test.lua	gh-5356
  xlog/panic_on_wal_error.test.lua		gh-5348

(cherry picked from commit 75ba744)
kyukhin referenced this issue in tarantool/tarantool Sep 28, 2020
@avtikhon @kyukhin
Add flaky tests checksums to fragile
2dc0efa 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  app-tap/debug.test.lua			gh-5346
  app-tap/http_client.test.lua			gh-5346
  app-tap/inspector.test.lua			gh-5346
  box/gh-2763-session-credentials-update.test.lua gh-5363
  box/hash_collation.test.lua			gh-5247
  box/lua.test.lua				gh-5351
  box/net.box_connect_triggers_gh-2858.test.lua	gh-5247
  box/net.box_incompatible_index-gh-1729.test.lua gh-5360
  box/net.box_on_schema_reload-gh-1904.test.lua gh-5354
  box/protocol.test.lua				gh-5247
  box/update.test.lua				gh-5247
  box-tap/net.box.test.lua			gh-5346
  replication/autobootstrap.test.lua		gh-4533
  replication/autobootstrap_guest.test.lua	gh-4533
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3247-misc-iproto-sequence-value-not-replicated.test.lua.test.lua gh-5357
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344, gh-5349
  replication/prune.test.lua			gh-5361
  replication/qsync_advanced.test.lua		gh-5340
  replication/qsync_basic.test.lua		gh-5355
  replication/replicaset_ro_mostly.test.lua	gh-5342
  replication/wal_rw_stress.test.lua		gh-5347
  replication-py/multi.test.py			gh-5362
  sql/prepared.test.lua test			gh-5359
  sql-tap/selectG.test.lua			gh-5350
  vinyl/ddl.test.lua				gh-5338
  vinyl/gh-3395-read-prepared-uncommitted.test.lua gh-5197
  vinyl/iterator.test.lua			gh-5336
  vinyl/write_iterator_rand.test.lua	gh-5356
  xlog/panic_on_wal_error.test.lua		gh-5348

(cherry picked from commit 75ba744)
kyukhin referenced this issue in tarantool/tarantool Sep 28, 2020
@avtikhon @kyukhin
Add flaky tests checksums to fragile
18f2bc8 
Added for tests with issues:
  app/fiber.test.lua				gh-5341
  app-tap/debug.test.lua			gh-5346
  app-tap/http_client.test.lua			gh-5346
  app-tap/inspector.test.lua			gh-5346
  box/gh-2763-session-credentials-update.test.lua gh-5363
  box/hash_collation.test.lua			gh-5247
  box/lua.test.lua				gh-5351
  box/net.box_connect_triggers_gh-2858.test.lua	gh-5247
  box/net.box_incompatible_index-gh-1729.test.lua gh-5360
  box/net.box_on_schema_reload-gh-1904.test.lua gh-5354
  box/protocol.test.lua				gh-5247
  box/update.test.lua				gh-5247
  box-tap/net.box.test.lua			gh-5346
  replication/autobootstrap.test.lua		gh-4533
  replication/autobootstrap_guest.test.lua	gh-4533
  replication/ddl.test.lua			gh-5337
  replication/gh-3160-misc-heartbeats-on-master-changes.test.lua gh-4940
  replication/gh-3247-misc-iproto-sequence-value-not-replicated.test.lua.test.lua gh-5357
  replication/gh-3637-misc-error-on-replica-auth-fail.test.lua gh-5343
  replication/long_row_timeout.test.lua		gh-4351
  replication/on_replace.test.lua		gh-5344, gh-5349
  replication/prune.test.lua			gh-5361
  replication/qsync_advanced.test.lua		gh-5340
  replication/qsync_basic.test.lua		gh-5355
  replication/replicaset_ro_mostly.test.lua	gh-5342
  replication/wal_rw_stress.test.lua		gh-5347
  replication-py/multi.test.py			gh-5362
  sql/prepared.test.lua test			gh-5359
  sql-tap/selectG.test.lua			gh-5350
  vinyl/ddl.test.lua				gh-5338
  vinyl/gh-3395-read-prepared-uncommitted.test.lua gh-5197
  vinyl/iterator.test.lua			gh-5336
  vinyl/write_iterator_rand.test.lua	gh-5356
  xlog/panic_on_wal_error.test.lua		gh-5348

(cherry picked from commit 75ba744)
@NickVolynkin NickVolynkin mentioned this issue Mar 15, 2022
Open
@ylobankov ylobankov transferred this issue from tarantool/tarantool Apr 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@avtikhon avtikhon

Labels
asan flaky test qa
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@avtikhon