[SPARK-44367][SQL][UI] Show error message on UI for each failed query

[yaooqinn]

What changes were proposed in this pull request?

This PR adds an 'error message' col to the failed query execution table on the SQL/DataFrame tab of UI.

Why are the changes needed?

The SQL tab of UI is not helping to detect SQL errors. This PR will provide users with a clear understanding of why their queries have failed.

Does this PR introduce any user-facing change?

SQL tab of UI shows errors for failed queries

How was this patch tested?

built and tested locally

[yaooqinn]

cc @cloud-fan @dongjoon-hyun @HyukjinKwon @sarutak thanks

[cloud-fan]

what's the old way to know the query error in the UI?

[yaooqinn]

@cloud-fan

• check the related failed job IDs for physical failures but not logical ones
• (STS-specific) ThriftServer Page
• Attach a custom UITab

[cloud-fan]

If we click one query and enter the detail query page, will we see the error message before this PR?

[yaooqinn]

If we click one query and enter the detail query page, will we see the error message before this PR?

NO

[yaooqinn]

Hi @cloud-fan, Do you have any other concerns?

[cloud-fan]

I'm not good at UI design but it seems a bit overkill to put the full error message in a column. Shall we only put the error class name (or java exception class name) in the column, and put the full error message in the query details page?

[yaooqinn]

We can follow the task error on StagePage and the execution error on ThriftPage, display the first line which can be used to represent the error class, and toggle to show the collapsed details. WDYT?

[yaooqinn]

How about this?

[yaooqinn]

Thanks, merged to master and 3.5.

PS, K8s IT failures are irrelevant.