Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TiKV crash loop during EBS recovery #16549

Closed
v01dstar opened this issue Feb 21, 2024 · 1 comment
Closed

TiKV crash loop during EBS recovery #16549

v01dstar opened this issue Feb 21, 2024 · 1 comment
Assignees
@v01dstar
Labels
affects-6.5 affects-7.1 affects-7.5 component/rocksdb Component: RocksDB engine needs-cherry-pick-release-6.5 severity/major type/bug Type: Issue - Confirmed a bug

Comments

@v01dstar
Copy link
Contributor

Bug Report

What version of TiKV are you using?

What operating system and CPU are you using?

Steps to reproduce

What did you expect?

What did happened?
@v01dstar v01dstar added the type/bug Type: Issue - Confirmed a bug label Feb 21, 2024
@v01dstar v01dstar self-assigned this Feb 21, 2024
@v01dstar v01dstar mentioned this issue Feb 21, 2024
Merged
9 tasks
ti-chi-bot bot pushed a commit that referenced this issue Feb 28, 2024
@v01dstar @tonyxuqqi
rocksdb: Expose track-and-verify-wals-in-manifest config (#16546)
9fa462a 
ref #16549

Expose track-and-verify-wals-in-manifest config.

For further investigating corrupted WAL issue happened during EBS restore process.

Signed-off-by: v01dstar <yang.zhang@pingcap.com>

Co-authored-by: tonyxuqqi <tonyxuqi@outlook.com>
ti-chi-bot pushed a commit to ti-chi-bot/tikv that referenced this issue Feb 28, 2024
@v01dstar @ti-chi-bot
This is an automated cherry-pick of tikv#16546
34528ee 
ref tikv#16549

Signed-off-by: ti-chi-bot <ti-community-prow-bot@tidb.io>
@ti-chi-bot ti-chi-bot mentioned this issue Feb 28, 2024
Closed
9 tasks
ti-chi-bot pushed a commit to ti-chi-bot/tikv that referenced this issue Feb 28, 2024
@v01dstar @ti-chi-bot
This is an automated cherry-pick of tikv#16546
9da28cc 
ref tikv#16549

Signed-off-by: ti-chi-bot <ti-community-prow-bot@tidb.io>
@ti-chi-bot ti-chi-bot mentioned this issue Feb 28, 2024
Open
9 tasks
v01dstar added a commit to v01dstar/tikv that referenced this issue Feb 28, 2024
@v01dstar @tonyxuqqi
rocksdb: Expose track-and-verify-wals-in-manifest config (tikv#16546)
0cf4d1e 
ref tikv#16549

Expose track-and-verify-wals-in-manifest config.

For further investigating corrupted WAL issue happened during EBS restore process.

Signed-off-by: v01dstar <yang.zhang@pingcap.com>

Co-authored-by: tonyxuqqi <tonyxuqi@outlook.com>
@v01dstar v01dstar mentioned this issue Feb 28, 2024
Merged
9 tasks
ti-chi-bot bot pushed a commit that referenced this issue Mar 8, 2024
@v01dstar
rocksdb: Expose track-and-verify-wals-in-manifest config (#16578)
54f21ab 
ref #16549

Expose track-and-verify-wals-in-manifest config.

For further investigating corrupted WAL issue happened during EBS restore process.

Signed-off-by: Yang Zhang <yang.zhang@pingcap.com>
dbsid pushed a commit to dbsid/tikv that referenced this issue Mar 24, 2024
@v01dstar @tonyxuqqi @dbsid
rocksdb: Expose track-and-verify-wals-in-manifest config (tikv#16546)
2bfd8e3 
ref tikv#16549

Expose track-and-verify-wals-in-manifest config.

For further investigating corrupted WAL issue happened during EBS restore process.

Signed-off-by: v01dstar <yang.zhang@pingcap.com>

Co-authored-by: tonyxuqqi <tonyxuqi@outlook.com>
Signed-off-by: dbsid <chenhuansheng@pingcap.com>
v01dstar added a commit to v01dstar/tikv that referenced this issue Apr 9, 2024
@v01dstar @tonyxuqqi
rocksdb: Expose track-and-verify-wals-in-manifest config (tikv#16546)
fbb7f25 
ref tikv#16549

Expose track-and-verify-wals-in-manifest config.

For further investigating corrupted WAL issue happened during EBS restore process.

Signed-off-by: v01dstar <yang.zhang@pingcap.com>

Co-authored-by: tonyxuqqi <tonyxuqi@outlook.com>
@v01dstar v01dstar mentioned this issue Apr 9, 2024
Merged
9 tasks
v01dstar added a commit to v01dstar/tikv that referenced this issue Apr 9, 2024
@v01dstar @tonyxuqqi
rocksdb: Expose track-and-verify-wals-in-manifest config (tikv#16546)
581d9ec 
ref tikv#16549

Expose track-and-verify-wals-in-manifest config.

For further investigating corrupted WAL issue happened during EBS restore process.

Signed-off-by: v01dstar <yang.zhang@pingcap.com>

Co-authored-by: tonyxuqqi <tonyxuqi@outlook.com>
Signed-off-by: Yang Zhang <yang.zhang@pingcap.com>
ti-chi-bot pushed a commit to ti-chi-bot/tikv that referenced this issue Apr 11, 2024
@v01dstar @ti-chi-bot
This is an automated cherry-pick of tikv#16546
a54e0b9 
ref tikv#16549

Signed-off-by: ti-chi-bot <ti-community-prow-bot@tidb.io>
@ti-chi-bot ti-chi-bot mentioned this issue Apr 11, 2024
Closed
9 tasks
v01dstar added a commit to v01dstar/tikv that referenced this issue Apr 18, 2024
@v01dstar @tonyxuqqi
rocksdb: Expose track-and-verify-wals-in-manifest config (tikv#16546)
096476a 
ref tikv#16549

Expose track-and-verify-wals-in-manifest config.

For further investigating corrupted WAL issue happened during EBS restore process.

Signed-off-by: v01dstar <yang.zhang@pingcap.com>

Co-authored-by: tonyxuqqi <tonyxuqi@outlook.com>
@v01dstar v01dstar mentioned this issue Apr 18, 2024
Merged
9 tasks
ti-chi-bot bot pushed a commit that referenced this issue Apr 18, 2024
@v01dstar
rocksdb: Expose track-and-verify-wals-in-manifest config (#16869)
f941b2c 
ref #16549

Expose track-and-verify-wals-in-manifest config.

For further investigating corrupted WAL issue happened during EBS restore process.

Signed-off-by: Yang Zhang <yang.zhang@pingcap.com>
@zhangjinpeng87
Copy link
Member

close it since #16869 already fixed this issue.

mittalrishabh pushed a commit to mittalrishabh/tikv that referenced this issue May 8, 2024
@v01dstar @tonyxuqqi
rocksdb: Expose track-and-verify-wals-in-manifest config (tikv#16546) (…
1924816 
…tikv#18)

ref tikv#16549

Expose track-and-verify-wals-in-manifest config.

For further investigating corrupted WAL issue happened during EBS restore process.

Co-authored-by: Yang Zhang <yang.zhang@pingcap.com>
Co-authored-by: tonyxuqqi <tonyxuqi@outlook.com>
ti-chi-bot bot pushed a commit that referenced this issue May 20, 2024
@v01dstar @zhangjinpeng87 @tonyxuqqi
rocksdb: Expose track-and-verify-wals-in-manifest config (#16546) (#1…
31c050d 
…6784)

ref #16549

Expose track-and-verify-wals-in-manifest config.

For further investigating corrupted WAL issue happened during EBS restore process.

Signed-off-by: v01dstar <yang.zhang@pingcap.com>
Signed-off-by: Yang Zhang <yang.zhang@pingcap.com>

Co-authored-by: Jinpeng Zhang <zzzhangjinpeng@gmail.com>
Co-authored-by: tonyxuqqi <tonyxuqi@outlook.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@v01dstar v01dstar

Labels
affects-6.5 affects-7.1 affects-7.5 component/rocksdb Component: RocksDB engine needs-cherry-pick-release-6.5 severity/major type/bug Type: Issue - Confirmed a bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@tonyxuqqi @v01dstar @zhangjinpeng87 @ti-chi-bot