Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-45749][CORE][WEBUI] Fix Spark History Server to sort Duration column properly #43613

Closed
wants to merge 1 commit into from

Conversation

dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Nov 1, 2023

What changes were proposed in this pull request?

This PR aims to fix an UI regression at Apache Spark 3.2.0 caused by SPARK-34123.

From Apache Spark 3.2.0 to 3.5.0, Spark History Server cannot sort Duration column.

After this PR, Spark History Server can sort Duration column properly like Apache Spark 3.1.3 and before.

Why are the changes needed?

Before SPARK-34123, Apache Spark had the title attribute for sorting.

<td><span title="{{durationMillisec}}">{{duration}}</span></td>

Without title, title-numeric doesn't work.

Does this PR introduce any user-facing change?

No. This is a bug fix.

How was this patch tested?

Manual test. Please use Safari Private Browsing or Chrome Incognito mode.

Screenshot 2023-10-31 at 5 47 34 PM Screenshot 2023-10-31 at 5 47 29 PM

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun
Copy link
Member Author

Could you review this, @yaooqinn and @LuciferYang ?

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-45749][CORE][WEBUI] Fix Spark History Server to sort Duration column properly [SPARK-45749][CORE][WEBUI] Fix Spark History Server to sort Duration column properly Nov 1, 2023
@yaooqinn yaooqinn closed this in f72510c Nov 1, 2023
yaooqinn pushed a commit that referenced this pull request Nov 1, 2023
…on` column properly

### What changes were proposed in this pull request?

This PR aims to fix an UI regression at Apache Spark 3.2.0 caused by SPARK-34123.

From Apache Spark **3.2.0** to **3.5.0**, `Spark History Server` cannot sort `Duration` column.

After this PR, Spark History Server can sort `Duration` column properly like Apache Spark 3.1.3 and before.

### Why are the changes needed?

Before SPARK-34123, Apache Spark had the `title` attribute for sorting.
- #31191
```
<td><span title="{{durationMillisec}}">{{duration}}</span></td>
```

Without `title`, `title-numeric` doesn't work.

### Does this PR introduce _any_ user-facing change?

No. This is a bug fix.

### How was this patch tested?

Manual test. Please use `Safari Private Browsing ` or `Chrome Incognito` mode.

<img width="96" alt="Screenshot 2023-10-31 at 5 47 34 PM" src="https://github.com/apache/spark/assets/9700541/8c8464d2-c58b-465c-8f98-edab1ec2317d">

<img width="94" alt="Screenshot 2023-10-31 at 5 47 29 PM" src="https://github.com/apache/spark/assets/9700541/03e8373d-bda3-4835-90ad-9a45670e853a">

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #43613 from dongjoon-hyun/SPARK-45749.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit f72510c)
Signed-off-by: Kent Yao <yao@apache.org>
yaooqinn pushed a commit that referenced this pull request Nov 1, 2023
…on` column properly

### What changes were proposed in this pull request?

This PR aims to fix an UI regression at Apache Spark 3.2.0 caused by SPARK-34123.

From Apache Spark **3.2.0** to **3.5.0**, `Spark History Server` cannot sort `Duration` column.

After this PR, Spark History Server can sort `Duration` column properly like Apache Spark 3.1.3 and before.

### Why are the changes needed?

Before SPARK-34123, Apache Spark had the `title` attribute for sorting.
- #31191
```
<td><span title="{{durationMillisec}}">{{duration}}</span></td>
```

Without `title`, `title-numeric` doesn't work.

### Does this PR introduce _any_ user-facing change?

No. This is a bug fix.

### How was this patch tested?

Manual test. Please use `Safari Private Browsing ` or `Chrome Incognito` mode.

<img width="96" alt="Screenshot 2023-10-31 at 5 47 34 PM" src="https://github.com/apache/spark/assets/9700541/8c8464d2-c58b-465c-8f98-edab1ec2317d">

<img width="94" alt="Screenshot 2023-10-31 at 5 47 29 PM" src="https://github.com/apache/spark/assets/9700541/03e8373d-bda3-4835-90ad-9a45670e853a">

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #43613 from dongjoon-hyun/SPARK-45749.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit f72510c)
Signed-off-by: Kent Yao <yao@apache.org>
yaooqinn pushed a commit that referenced this pull request Nov 1, 2023
…on` column properly

### What changes were proposed in this pull request?

This PR aims to fix an UI regression at Apache Spark 3.2.0 caused by SPARK-34123.

From Apache Spark **3.2.0** to **3.5.0**, `Spark History Server` cannot sort `Duration` column.

After this PR, Spark History Server can sort `Duration` column properly like Apache Spark 3.1.3 and before.

### Why are the changes needed?

Before SPARK-34123, Apache Spark had the `title` attribute for sorting.
- #31191
```
<td><span title="{{durationMillisec}}">{{duration}}</span></td>
```

Without `title`, `title-numeric` doesn't work.

### Does this PR introduce _any_ user-facing change?

No. This is a bug fix.

### How was this patch tested?

Manual test. Please use `Safari Private Browsing ` or `Chrome Incognito` mode.

<img width="96" alt="Screenshot 2023-10-31 at 5 47 34 PM" src="https://github.com/apache/spark/assets/9700541/8c8464d2-c58b-465c-8f98-edab1ec2317d">

<img width="94" alt="Screenshot 2023-10-31 at 5 47 29 PM" src="https://github.com/apache/spark/assets/9700541/03e8373d-bda3-4835-90ad-9a45670e853a">

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #43613 from dongjoon-hyun/SPARK-45749.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit f72510c)
Signed-off-by: Kent Yao <yao@apache.org>
@yaooqinn
Copy link
Member

yaooqinn commented Nov 1, 2023

Thanks @dongjoon-hyun Merged to master for 4.0.0 and 3.5.1,3.4.2,3.3.4 for the maintenance releases.

@dongjoon-hyun
Copy link
Member Author

Thank you so much, @yaooqinn !

@dongjoon-hyun dongjoon-hyun deleted the SPARK-45749 branch November 1, 2023 02:18
@LuciferYang
Copy link
Contributor

late LGTM

@dongjoon-hyun
Copy link
Member Author

Thank you, @LuciferYang .

szehon-ho pushed a commit to szehon-ho/spark that referenced this pull request Feb 7, 2024
…on` column properly

### What changes were proposed in this pull request?

This PR aims to fix an UI regression at Apache Spark 3.2.0 caused by SPARK-34123.

From Apache Spark **3.2.0** to **3.5.0**, `Spark History Server` cannot sort `Duration` column.

After this PR, Spark History Server can sort `Duration` column properly like Apache Spark 3.1.3 and before.

### Why are the changes needed?

Before SPARK-34123, Apache Spark had the `title` attribute for sorting.
- apache#31191
```
<td><span title="{{durationMillisec}}">{{duration}}</span></td>
```

Without `title`, `title-numeric` doesn't work.

### Does this PR introduce _any_ user-facing change?

No. This is a bug fix.

### How was this patch tested?

Manual test. Please use `Safari Private Browsing ` or `Chrome Incognito` mode.

<img width="96" alt="Screenshot 2023-10-31 at 5 47 34 PM" src="https://github.com/apache/spark/assets/9700541/8c8464d2-c58b-465c-8f98-edab1ec2317d">

<img width="94" alt="Screenshot 2023-10-31 at 5 47 29 PM" src="https://github.com/apache/spark/assets/9700541/03e8373d-bda3-4835-90ad-9a45670e853a">

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#43613 from dongjoon-hyun/SPARK-45749.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit f72510c)
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit ed3a74d)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants