Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize the query performance on wide table #12979

Open
zz-jason opened this issue Oct 28, 2019 · 3 comments
Open

Optimize the query performance on wide table #12979

zz-jason opened this issue Oct 28, 2019 · 3 comments
Labels
feature/accepted This feature request is accepted by product managers sig/execution SIG execution type/enhancement type/feature-request This is a feature requests on the product

Comments

@zz-jason
Copy link
Member

zz-jason commented Oct 28, 2019

Description

There is a wide table which can be summarized as:

  • There is an empty table, no data inside it.
  • It has 200 columns, each column is defined as VARCHAR(120).
  • It has an int primary key.

The workload is quite simple, which can be summarized as:
select c0, c1, .. from tbl where ${pk} = ${value}

We’ve wrote a sysbench script for this case, see the Wide Table benchmark for more details. After deploying a TiDB cluster, you can simply run the following commands to do all the tests:

# prepare table
./wide_point_select.lua --table-size=1000 --db-driver=mysql --mysql-socket=/tmp/mysql.sock --mysql-user=root --columns=200 prepare 

# run benchmark
./wide_point_select.lua --table-size=1000 --db-driver=mysql --mysql-socket=/tmp/mysql.sock --mysql-user=root --columns=200 run 

Your goal is to improve 50% of the total QPS.

Difficulty

  • Medium

Score

  • 3000

Mentor(s)

Recommended Skills

  • Sysbench
  • tidb-ansible
  • TiDB Query Execution
  • Golang Profiling
  • Golang Internals, GC, Scheduling
@zz-jason zz-jason added this to TODO/Easy in Challenge Program via automation Oct 28, 2019
@zz-jason zz-jason moved this from TODO/Easy to TODO/Medium in Challenge Program Oct 28, 2019
@sre-bot sre-bot added the PCP-S1 label Nov 4, 2019
@you06 you06 changed the title PCP-10: Optimize the query performance on wide table Optimize the query performance on wide table Feb 29, 2020
@zz-jason zz-jason added the type/feature-request This is a feature requests on the product label May 28, 2020
@github-actions github-actions bot added this to Issue Backlog: Need Triage in SIG Runtime Kanban May 28, 2020
@github-actions github-actions bot added this to Need Triage in Feature Request Kanban May 28, 2020
@scsldb scsldb added the Priority/P1 Features that will be implemented in the latest or next major/minor version label Jun 12, 2020
@scsldb scsldb added this to the v5.0-alpha.1 milestone Jun 12, 2020
@SunRunAway SunRunAway removed the Priority/P1 Features that will be implemented in the latest or next major/minor version label Jun 30, 2020
@zz-jason zz-jason moved this from Need Triage to Requirement: Scheduled in Feature Request Kanban Jul 9, 2020
@scsldb scsldb modified the milestones: v5.0.0-alpha.1, pools Jul 15, 2020
@scsldb scsldb added the feature/reviewing This feature request is reviewing by product managers label Jul 16, 2020
@zz-jason zz-jason removed their assignment Jul 16, 2020
@zz-jason zz-jason removed the feature/reviewing This feature request is reviewing by product managers label Jul 22, 2020
@scsldb scsldb moved this from Accepted: Priority/P0 to Accepted: Priority/Unknown in Feature Request Kanban Jul 29, 2020
@scsldb scsldb moved this from Accepted: Priority/Unknown to Accepted in Feature Request Kanban Jul 29, 2020
@zz-jason zz-jason added the feature/accepted This feature request is accepted by product managers label Jul 29, 2020
@Patrick0308
Copy link
Contributor

/pick-up

@ti-challenge-bot
Copy link

It is not a pickable issue!

Details

Tip : If you want this issue to be picked, you need to add a challenge-program label to it.

Warning: None

@hidehalo
Copy link
Contributor

hidehalo commented Apr 8, 2021

@zz-jason Hi, could I pick up this issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature/accepted This feature request is accepted by product managers sig/execution SIG execution type/enhancement type/feature-request This is a feature requests on the product
Projects
Challenge Program
  
TODO/Medium
SIG Runtime Kanban
  
Issue Backlog: Need Triage
Development

No branches or pull requests

8 participants