[Feature]: Support detail page for Optimizing Process

[wangtaohz]

Description

Currently, the Optimizing Process page only displays rough information for each process, like

However, the information are insufficient, especially when troubleshooting optimizing performance issues, causing great inconvenience.

We should introduce a Detail page for each process to facilitate viewing the execution details of the process.

Use case/motivation

Displaying the detailed information for each task in the process can provide us with assistance when troubleshooting, including the execution time for each task, which optimizer executed it, retry attempts, fail reason, and most importantly, the metrics_summary, which shows how many files the task processed.

The detailed infomation for tasks are as follows

+---------------+---------+-----------+----------------+-------------------------+-------------------------+-----------+---------+-------------+--------------------------------------+-----------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| process_id    | task_id | retry_num | partition_data | start_time              | end_time                | cost_time | status  | fail_reason | optimizer_token                      | thread_id | metrics_summary                                                                                                                                                                                                                |
+---------------+---------+-----------+----------------+-------------------------+-------------------------+-----------+---------+-------------+--------------------------------------+-----------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 1689081754410 |       1 |         0 | dt=20220204    | 2023-07-11 21:22:35.759 | 2023-07-11 21:22:35.807 |        97 | SUCCESS | NULL        | 20beb80f-1adf-4bc7-9d73-ccfe430833f1 |         0 | {"newFileSize":1037,"newFileCnt":1,"rewriteDataSize":1790,"rewritePosDataSize":0,"equalityDeleteSize":0,"positionalDeleteSize":0,"rewriteDataFileCnt":2,"reRowDeletedDataFileCnt":0,"eqDeleteFileCnt":0,"posDeleteFileCnt":0}  |
| 1689081754410 |       2 |         0 | dt=20220203    | 2023-07-11 21:22:34.712 | 2023-07-11 21:22:35.689 |      1955 | SUCCESS | NULL        | 20beb80f-1adf-4bc7-9d73-ccfe430833f1 |         0 | {"newFileSize":1087,"newFileCnt":1,"rewriteDataSize":1784,"rewritePosDataSize":0,"equalityDeleteSize":0,"positionalDeleteSize":0,"rewriteDataFileCnt":2,"reRowDeletedDataFileCnt":0,"eqDeleteFileCnt":0,"posDeleteFileCnt":0}  |
| 1689081755930 |       1 |         0 | dt=20220206    | 2023-07-11 21:22:36.109 | 2023-07-11 21:22:36.183 |       149 | SUCCESS | NULL        | 20beb80f-1adf-4bc7-9d73-ccfe430833f1 |         0 | {"newFileSize":928,"newFileCnt":1,"rewriteDataSize":1827,"rewritePosDataSize":0,"equalityDeleteSize":709,"positionalDeleteSize":0,"rewriteDataFileCnt":2,"reRowDeletedDataFileCnt":0,"eqDeleteFileCnt":1,"posDeleteFileCnt":0} |
| 1695184639123 |       1 |         0 |                | 2023-09-20 12:37:19.334 | 2023-09-20 12:37:20.349 |      2030 | SUCCESS | NULL        | 5ea74f24-0cb4-4b47-9415-abdb233ed48d |         0 | {"newFileSize":647,"newFileCnt":1,"rewriteDataSize":3101,"rewritePosDataSize":0,"equalityDeleteSize":0,"positionalDeleteSize":0,"rewriteDataFileCnt":5,"reRowDeletedDataFileCnt":0,"eqDeleteFileCnt":0,"posDeleteFileCnt":0}   |
+---------------+---------+-----------+----------------+-------------------------+-------------------------+-----------+---------+-------------+--------------------------------------+-----------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

Describe the solution

We have make some design in #1535, and we can enter this page by clicking on the process id in the Optimizing page.

Subtasks

• [Subtask]: Dashboard supports displaying detailed information for optimizing tasks on Web UI #2115
• [Subtask]: Supports Http interface for getting details of optimizing tasks #2117

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct