Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-31967][UI][2.4] Downgrade to vis.js 4.21.0 to fix Jobs UI loading time regression #28813

Closed
wants to merge 2 commits into from

Conversation

gengliangwang
Copy link
Member

What changes were proposed in this pull request?

After #28192, the job list page becomes very slow.
For example, after the following operation, the UI loading can take >40 sec.

(1 to 1000).foreach(_ => sc.parallelize(1 to 10).collect) 

This is caused by a performance issue of vis-timeline. The serious issue affects both branch-3.0 and branch-2.4

I tried a different version 4.21.0 from https://cdnjs.com/libraries/vis
The infinite drawing issue seems also fixed if the zoom is disabled as default.

Why are the changes needed?

Fix the serious perf issue in web UI by falling back vis-timeline-graph2d to an ealier version.

Does this PR introduce any user-facing change?

Yes, fix the UI perf regression

How was this patch tested?

Manual test

@gengliangwang
Copy link
Member Author

This PR backports #28806 to branch-2.4

@SparkQA
Copy link

SparkQA commented Jun 12, 2020

Test build #123910 has finished for PR 28813 at commit 6bf1da7.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

Ya. We also hit this issue and revert the original PR internally. Thanks.

BTW, if the root cause was due to upgrading vis.js 4.16.1 to vis-timeline 7.3.4, this is downgrading it back to 4.21.0, right?

@dongjoon-hyun
Copy link
Member

cc @dbtsai and @holdenk

@dongjoon-hyun dongjoon-hyun changed the title [2.4][SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds [2.4][SPARK-31967][UI] Downgrade to vis.js 4.21.0 to fix Jobs UI loading time regression Jun 12, 2020
@dongjoon-hyun dongjoon-hyun changed the title [2.4][SPARK-31967][UI] Downgrade to vis.js 4.21.0 to fix Jobs UI loading time regression [SPARK-31967][UI][2.4] Downgrade to vis.js 4.21.0 to fix Jobs UI loading time regression Jun 12, 2020
@gengliangwang
Copy link
Member Author

BTW, if the root cause was due to upgrading vis.js 4.16.1 to vis-timeline 7.3.4, this is downgrading it back to 4.21.0, right?

@dongjoon-hyun yes

@holdenk
Copy link
Contributor

holdenk commented Jun 12, 2020

Oh awesome, thanks for fixing this @gengliangwang :)
This looks good to me, but maybe having someone who's done more stuff in the web frontend would be good as well.

@gengliangwang
Copy link
Member Author

Merging to branch-2.4

gengliangwang added a commit that referenced this pull request Jun 13, 2020
…ing time regression

### What changes were proposed in this pull request?

After #28192, the job list page becomes very slow.
For example, after the following operation, the UI loading can take >40 sec.
```
(1 to 1000).foreach(_ => sc.parallelize(1 to 10).collect)
```

This is caused by a  [performance issue of `vis-timeline`](visjs/vis-timeline#379). The serious issue affects both branch-3.0 and branch-2.4

I tried a different version 4.21.0 from https://cdnjs.com/libraries/vis
The infinite drawing issue seems also fixed if the zoom is disabled as default.

### Why are the changes needed?

Fix the serious perf issue in web UI by falling back vis-timeline-graph2d to an ealier version.

### Does this PR introduce _any_ user-facing change?

Yes, fix the UI perf regression

### How was this patch tested?

Manual test

Closes #28813 from gengliangwang/vis2.4.

Authored-by: Gengliang Wang <gengliang.wang@databricks.com>
Signed-off-by: Gengliang Wang <gengliang.wang@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
5 participants