Skip to content
This repository has been archived by the owner on Jun 6, 2024. It is now read-only.

Rest-Server Job API Perf Tests and Improvements #5027

Open
suiguoxin opened this issue Oct 29, 2020 · 0 comments
Open

Rest-Server Job API Perf Tests and Improvements #5027

suiguoxin opened this issue Oct 29, 2020 · 0 comments
Labels

Comments

@suiguoxin
Copy link
Member

suiguoxin commented Oct 29, 2020

DB table framework & frameworkHistory store the snapshot of framework as text. When the snapshot is used by Rest API, rest-server need to parse it as JSON and convert it to required schema. This can be very slow when the snapshot is large.

We test the performance of get job detail API after this fix in int bed and have the following results:

image

In the function convertFrameworkDetail , rest-server convert the framework snapshot to the required response schema.
This process is very slow. When lots of job/detail pages opened in the web-portal, rest-server can be overloaded.

Potential solutions:

  • move the convert process to client side
  • convert before write to DB
  • ...
@suiguoxin suiguoxin changed the title Rest-server API get job detail efficiency DB framework / Rest-Server Job inconsistency Oct 29, 2020
@yqwang-ms yqwang-ms changed the title DB framework / Rest-Server Job inconsistency Rest-Server Job API Perf Tests and Improvements Oct 29, 2020
This was referenced Nov 2, 2020
This was referenced Nov 30, 2020
@debuggy debuggy mentioned this issue Jan 4, 2021
14 tasks
@debuggy debuggy mentioned this issue Jan 15, 2021
55 tasks
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

1 participant