Skip to content
This repository has been archived by the owner on Jul 24, 2024. It is now read-only.

Lightning failed to import DDL "Error 9007: Write conflict" #1290

Closed
Tammyxia opened this issue Jun 28, 2021 · 0 comments · Fixed by #1294
Closed

Lightning failed to import DDL "Error 9007: Write conflict" #1290

Tammyxia opened this issue Jun 28, 2021 · 0 comments · Fixed by #1294

Comments

@Tammyxia
Copy link

Tammyxia commented Jun 28, 2021

Please answer these questions before submitting your issue. Thanks!

  1. What did you do?
    If possible, provide a recipe for reproducing the error.
  • Edit lightning.toml :
    image

  • Import DDL: tiup tidb-lightning -config lightning.toml

  • Meanwhile, sysbench write to other database.

  • After a few minutes, lightning failed with error message:
    image

  • 16GB memoryy tidb OOM after 4w+ tables has been written.

  1. What did you expect to see?
  • Lightning import all DDL&DML successfully.
  1. What did you see instead?
  • Fail to import data, Error 9007: Write conflict
  1. What version of BR and TiDB/TiKV/PD are you using?

br -V
tidb-lightning -V
[release-version=v5.1.0] [git-hash=512e1ff98ea70fa45c4f2c27a690079b783bfefa] [git-branch=heads/refs/tags/v5.1.0] [go-version=go1.16.4] [utc-build-time="2021-06-17 07:20:57"] [race-enabled=false]

tidb-server -V
Release Version: v5.0.2
Edition: Community
Git Commit Hash: dc40a093a0058b95fc859f60d4b84337dbdff9f6
Git Branch: heads/refs/tags/v5.0.2
UTC Build Time: 2021-06-07 08:42:39
GoVersion: go1.13
Race Enabled: false
TiKV Min Version: v3.0.0-60965b006877ca7234adaced7890d7b029ed1306
Check Table Before Drop: false

tikv-server -V
TiKV
Release Version: 5.0.2
Edition: Community
Git Commit Hash: 52f335601d4806b44454fb631a006d7fed5b4a50
Git Commit Branch: cloud-cdc-5.0
UTC Build Time: 2021-06-23 08:59:38
Rust Version: rustc 1.51.0-nightly (bc39d4d9c 2021-01-15)
Enable Features: jemalloc mem-profiling portable sse protobuf-codec test-engines-rocksdb cloud-aws cloud-gcp
Profile: dist_release

pd-server -V
Release Version: v5.0.2
Edition: Community
Git Commit Hash: 2b5ada0d1fbfb559bb31cbba759df9793bd140d2
Git Branch: heads/refs/tags/v5.0.2
UTC Build Time: 2021-06-07 08:41:12

-->

  1. Operation logs

    • Please upload br.log for BR if possible
    • Please upload tidb-lightning.log for TiDB-Lightning if possible
    • Please upload tikv-importer.log from TiKV-Importer if possible
    • Other interesting logs
  2. Configuration of the cluster and the task

    • tidb-lightning.toml for TiDB-Lightning if possible
    • tikv-importer.toml for TiKV-Importer if possible
    • topology.yml if deployed by TiUP
  3. Screenshot/exported-PDF of Grafana dashboard or metrics' graph in Prometheus if possible

@Tammyxia Tammyxia added the type/bug Something isn't working label Jun 28, 2021
@glorv glorv changed the title Lightning failed to import DDL "Error 9007: Write conflict, txnStartTS=425943120583852120, conflictStartTS=425943120583852040, conflictCommitTS=425943120754245652" Lightning failed to import DDL "Error 9007: Write conflict" Jun 28, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants