Skip to content

[Bug] A S3 load job will be submitted successfully with duplicated label of the former failed job, which causes a normal cancel falied #19215

@Hastyshell

Description

@Hastyshell

Search before asking

  • I had searched in the issues and found no similar issues.

Version

master

What's Wrong?

As seen below, load job with the duplicate label will still submitted sucessfully, which cause the later cancel failed.

mysql> show load;
+-------+---------------+-----------+-------------------+--------+---------+-----------------------------------------------------+----------------------------------------------------------------------------------------------------------+---------------------+---------------------+---------------------+---------------------+---------------------+------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------+--------------+------+---------+
| JobId | Label         | State     | Progress          | Type   | EtlInfo | TaskInfo                                            | ErrorMsg                                                                                                 | CreateTime          | EtlStartTime        | EtlFinishTime       | LoadStartTime       | LoadFinishTime      | URL  | JobDetails                                                                                                                                                                                                                         | TransactionId | ErrorTablets | User | Comment |
+-------+---------------+-----------+-------------------+--------+---------+-----------------------------------------------------+----------------------------------------------------------------------------------------------------------+---------------------+---------------------+---------------------+---------------------+---------------------+------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------+--------------+------+---------+
| 11001 | lineitem_load | CANCELLED | ETL:N/A; LOAD:N/A | BROKER | NULL    | cluster:N/A; timeout(s):14400; max_filter_ratio:0.0 | type:ETL_RUN_FAIL; msg:errCode = 2, detailMessage = Scan bytes per file scanner exceed limit: 3221225472 | 2023-04-28 20:50:28 | NULL                | NULL                | NULL                | 2023-04-28 20:50:35 | NULL | {"Unfinished backends":{},"ScannedRows":0,"TaskNumber":0,"LoadBytes":0,"All backends":{},"FileNumber":1,"FileSize":7895697364}                                                                                                     | 2             | {}           | root |         |
| 11004 | lineitem_load | CANCELLED | ETL:N/A; LOAD:N/A | BROKER | NULL    | cluster:N/A; timeout(s):14400; max_filter_ratio:0.0 | type:ETL_RUN_FAIL; msg:errCode = 2, detailMessage = Scan bytes per file scanner exceed limit: 5368709120 | 2023-04-28 20:52:49 | NULL                | NULL                | NULL                | 2023-04-28 20:52:54 | NULL | {"Unfinished backends":{},"ScannedRows":0,"TaskNumber":0,"LoadBytes":0,"All backends":{},"FileNumber":1,"FileSize":7895697364}                                                                                                     | 3             | {}           | root |         |
| 11007 | lineitem_load | LOADING   | ETL:100%; LOAD:3% | BROKER | NULL    | cluster:N/A; timeout(s):14400; max_filter_ratio:0.0 | NULL                                                                                                     | 2023-04-28 20:53:22 | 2023-04-28 20:53:23 | 2023-04-28 20:53:23 | 2023-04-28 20:53:23 | NULL                | NULL | {"Unfinished backends":{"1fb727df9d134e05-b2fde24e8a2e1acf":[10011]},"ScannedRows":1682496,"TaskNumber":1,"LoadBytes":305841896,"All backends":{"1fb727df9d134e05-b2fde24e8a2e1acf":[10011]},"FileNumber":1,"FileSize":7895697364} | 4             | {}           | root |         |
+-------+---------------+-----------+-------------------+--------+---------+-----------------------------------------------------+----------------------------------------------------------------------------------------------------------+---------------------+---------------------+---------------------+---------------------+---------------------+------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------+--------------+------+---------+
3 rows in set (0.00 sec)

mysql> CANCEL LOAD FROM test WHERE LABEL = "lineitem_load";
ERROR 1105 (HY000): errCode = 2, detailMessage = Cancel load job [11001] fail, label=[lineitem_load] failed msg=errCode = 2, detailMessage = Job could not be cancelled when job is finished or cancelled

What You Expected?

No job will be submitted successfully with a duplicated load label.

How to Reproduce?

Make a S3 load fail, and submit a sucessful job with the same label, it will run normally. Then try to cancel it then failure occurs as shown.

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions