Skip to content

fix(schema): loading table detail costs too much time#2626

Merged
yhilmare merged 1 commit intodev/4.3.0from
fix/shanlu_add_cache_db_browser
Jun 4, 2024
Merged

fix(schema): loading table detail costs too much time#2626
yhilmare merged 1 commit intodev/4.3.0from
fix/shanlu_add_cache_db_browser

Conversation

@yhilmare
Copy link
Copy Markdown
Contributor

@yhilmare yhilmare commented Jun 3, 2024

What type of PR is this?

type-bug

What this PR does / why we need it:

we parse table's ddl too many times which is not necessary, I add a cache to let a ddl only be parsed once.

the time consuming reduced by 90% (20s+ -> 1.44s)

Which issue(s) this PR fixes:

Fixes #2440

Special notes for your reviewer:

Additional documentation e.g., usage docs, etc.:


@yhilmare yhilmare added the type-bug Something isn't working label Jun 3, 2024
@yhilmare yhilmare added this to the ODC 4.3.0 milestone Jun 3, 2024
@yhilmare yhilmare self-assigned this Jun 3, 2024
@yhilmare yhilmare linked an issue Jun 3, 2024 that may be closed by this pull request
@yhilmare yhilmare requested a review from yizhouxw June 3, 2024 13:41
Copy link
Copy Markdown
Contributor

@yizhouxw yizhouxw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how! so much improvement!

@yhilmare
Copy link
Copy Markdown
Contributor Author

yhilmare commented Jun 3, 2024

how! so much improvement!

😂This performance improvement is tested based on user examples and is not universal.
Before optimization, it takes 20s+ to be completely serverless. After optimization, it can reach 1.44s when all caches are hit.

@yhilmare yhilmare merged commit 7899b47 into dev/4.3.0 Jun 4, 2024
@yhilmare yhilmare deleted the fix/shanlu_add_cache_db_browser branch June 4, 2024 07:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type-bug Something isn't working

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

[Bug]: getting table details cost too much time

3 participants