[SUPPORT] About data delay Timeline problem

[duyuqiu2021]

Hello everyone.

Now in my business scenario, the system generates a transaction at 10:00. This data is stored in the hudi's table. At 10:05, the customer pays for the order and the warehouse delivers it at 10:10. However, the shipment record data of 10:10 is written to the hudi's table at 10:12, and the payment record of 10:05 is written to the hudi's table at 10:15.

Now, when I query the hudi's table, I can only find the payment record at 10:05.

I saw the description of the timeline on your official website. It mentioned data delay, but there is no specific solution.

Excuse me, how to deal with this situation?

Any help would be greatly apreciated.

Thanks very much

Environment Description

Hudi version : 0.8.0

Spark version : 2.4.7

Hadoop version : 2.7.7

Storage (HDFS/S3/GCS..) : HDFS

Running on Docker? (yes/no) : no

[duyuqiu2021]

When my data was written into the hudi database, the "ts" timestamp was specified, and the time stamp of the shipment record was after the payment record.