Tracking issue for end 2 end row level checksum consistency

[3AceShowHand]

Background

This aims to support each row checksum mechanism and is consistent among TiDB / TiCDC / Kafka Consumer. This issue tracks all things that should be supported by the TiCDC.

TiCDC support checksum calculation

• Mounter support checksum calculation #8777
• TiCDC add new knobs to control checksum calculation #8776
• Canal-JSON support checksum #8775
• Avro support checksum #8788
• Open-Protocol support checksum #8789
• avro schema order fields by the column id #8804
• refactor avro by renaming avro fields to make it easy #8846
• add avro decoder to support e2e verification #8849
• e2e checksum only works for kafka sink changefeed #8854
• adjust decoder interface to reduce make it resuable #8861
• add watermark event to the avro encoder to support kafka consumer sink #8869
• checksum mistmatch since the column is not ordered by the column id at the mounter #8916
• add more unit test to cover checksum functionality #8991

Testing

• Add new unit test in the mounter to cover checksum calculation #8791
• add avro integration test to cover checksum functionality #8934
• Canal-JSON cover checksum calculation
• Avro cover checksum calculation
• Open-Protocol cover checksum calculation

Development tracking for the TiDB part

• Implement end to end checksum for TiDB and TiCDC tidb#42747

Development tracking for the TiKV part

• Tracking issue: E2E checksum support tikv/tikv#14528