Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve the performance of analyze coprocessor #14231

Open
xuyifangreeneyes opened this issue Feb 15, 2023 · 0 comments
Open

Improve the performance of analyze coprocessor #14231

xuyifangreeneyes opened this issue Feb 15, 2023 · 0 comments
Labels
type/enhancement Type: Issue - Enhancement

Comments

@xuyifangreeneyes
Copy link
Contributor

Development Task

When coprocessor handles analyze requests, it needs to scan all the data, do some encode/decode work, sample data, maintain fmsketch and so on, which is time-consuming. We hope to improve the performance of handling analyze requests.
@xuyifangreeneyes xuyifangreeneyes added the type/enhancement Type: Issue - Enhancement label Feb 15, 2023
@xuyifangreeneyes xuyifangreeneyes mentioned this issue Feb 15, 2023
Merged
ti-chi-bot pushed a commit that referenced this issue Feb 16, 2023
@xuyifangreeneyes
coprocessor: use mur3 to calculate fmsketch (#14204)
bbe06e9 
ref #14231

Signed-off-by: xuyifan <675434007@qq.com>
@xuyifangreeneyes xuyifangreeneyes mentioned this issue Feb 25, 2023
Merged
ti-chi-bot pushed a commit that referenced this issue Feb 26, 2023
@xuyifangreeneyes
coprocessor: avoid unnecessary vec allocation in collect_column_stats (…
5f5bb76 
…#14280)

ref #14231

When collect_column_stats handles each row, reuse column_vals and collation_key_vals to avoid allocating many small objects.

Signed-off-by: xuyifan <675434007@qq.com>
This was referenced Mar 3, 2023
Open
Merged
ti-chi-bot added a commit that referenced this issue Mar 6, 2023
@xuyifangreeneyes @ti-chi-bot
coprocessor: avoid fmsketch calculation for single-column index (#14345)
199e63f 
ref #14231

Signed-off-by: xuyifan <675434007@qq.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
This was referenced Mar 8, 2023
Open
Merged
ti-chi-bot pushed a commit that referenced this issue Mar 10, 2023
@xuyifangreeneyes
coprocessor: reuse EvalContext in collect_column_stats (#14376)
64a41f0 
ref #14231

Signed-off-by: xuyifan <675434007@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/enhancement Type: Issue - Enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@xuyifangreeneyes