Upgrade from v7.1.2 to nightly with add index causing data inconsistency.

[aytrack]

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

1. deploy a v7.1.2 cluster with 3 tidb nodes
2. prepare some sysbench data
3. do add index
4. upgrade cluster to nightly
5. admin check table

2. What did you expect to see? (Required)

upgrade cluster success and check table pass

3. What did you see instead (Required)

data inconsistency

[reporter.go:274] ["admin check found data inconsistency"] [conn=1816133640] [session_alias=] [table_name=sbtest2] [index_name=idxc] [row_id=5134965] [index=] [row="handle: 5134965, values: [KindString 51805948245-42706668787-74019086281-21421209855-90524333169-22748166771-90705931858-74657119130-69448777101-43606288622 KindString 71802481523-76953625420-82708868336-72533977128-61438746201]"] [row_mvcc="{\"decoded\":{\"441556045448085505\":{\"c\":\"51805948245-42706668787-74019086281-21421209855-90524333169-22748166771-90705931858-74657119130-69448777101-43606288622\",\"k\":\"2468087\",\"pad\":\"71802481523-76953625420-82708868336-72533977128-61438746201\"}},\"key\":\"7480000000000000E85F7280000000004E5A75\",\"mvcc\":{\"info\":{\"writes\":[{\"start_ts\":441556045448085505,\"commit_ts\":441556045500776451,\"short_value\":\"gAADAAAAAgMEBAB7ALYA96glADUxODA1OTQ4MjQ1LTQyNzA2NjY4Nzg3LTc0MDE5MDg2MjgxLTIxNDIxMjA5ODU1LTkwNTI0MzMzMTY5LTIyNzQ4MTY2NzcxLTkwNzA1OTMxODU4LTc0NjU3MTE5MTMwLTY5NDQ4Nzc3MTAxLTQzNjA2Mjg4NjIyNzE4MDI0ODE1MjMtNzY5NTM2MjU0MjAtODI3MDg4NjgzMzYtNzI1MzM5NzcxMjgtNjE0Mzg3NDYyMDE=\"}]}},\"regionID\":747}"] [stack="github.com/pingcap/tidb/pkg/util/logutil/consistency.(*Reporter).ReportAdminCheckInconsistent\n\t/workspace/source/tidb/pkg/util/logutil/consistency/reporter.go:273\ngithub.com/pingcap/tidb/pkg/executor.(*checkIndexWorker).HandleTask\n\t/workspace/source/tidb/pkg/executor/executor.go:2729\ngithub.com/pingcap/tidb/pkg/resourcemanager/pool/workerpool.(*WorkerPool[...]).handleTaskWithRecover\n\t/workspace/source/tidb/pkg/resourcemanager/pool/workerpool/workerpool.go:131\ngithub.com/pingcap/tidb/pkg/resourcemanager/pool/workerpool.(*WorkerPool[...]).runAWorker.func1\n\t/workspace/source/tidb/pkg/resourcemanager/pool/workerpool/workerpool.go:147\ngithub.com/pingcap/tidb/pkg/util.(*WaitGroupWrapper).Run.func1\n\t/workspace/source/tidb/pkg/util/wait_group_wrapper.go:157"]

you can find the log and metric from clinic https://clinic.pingcap.com.cn/portal/#/orgs/33/clusters/7354281705551035091?from=1712295703&to=1712302903

4. What is your TiDB version? (Required)

v7.1.2
master(555ce02)