Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The innodb sort buffer should be optimized for large tables #2567

Closed
cigamit opened this issue Mar 24, 2019 · 1 comment
Closed

The innodb sort buffer should be optimized for large tables #2567

cigamit opened this issue Mar 24, 2019 · 1 comment
Labels
enhancement General tag for an enhancement installer Installation issue resolved A fixed issue
Milestone

Comments

@cigamit
Copy link
Member

cigamit commented Mar 24, 2019

Describe the bug
When you have over several hundred thousand Data Sources or Graphs, additional sort variables should be tuned including 'innodb_sort_buffer_size' and 'sort_buffer_size' to have the sort indexes created in memory.

To Reproduce
Steps to reproduce the behavior:

  1. Source Data Sources by Name Cache for very large number of Data Sources
  2. Adjust the innodb_sort_buffer_size to a larger number like 200M
  3. Restart mariadb and warm up the table
  4. Sort again and see the performance difference

Expected behavior
Better performance.

Additional context
There are notes that starting with MySQL 5.6, the sort buffer size is dynamic upto the max settings, so it does not have the same significant effect as it used to have in prior MySQL versions.

@cigamit cigamit added enhancement General tag for an enhancement installer Installation issue labels Mar 26, 2019
@cigamit cigamit modified the milestones: v1.2.3, v1.3.0 Mar 26, 2019
@cigamit cigamit added the v1.3.0 label Nov 9, 2019
@netniV netniV removed the v1.3.0 label Dec 27, 2019
@TheWitness TheWitness added the resolved A fixed issue label Oct 17, 2022
@TheWitness TheWitness modified the milestones: v1.3.0, v1.2.23 Oct 17, 2022
@TheWitness
Copy link
Member

We have a recommendation for this right now, but since it's a client setting, we have to be careful. Therefore, I'm considering this one closed/complete.

@netniV netniV changed the title For large systems, the sort buffer should be optimized for large tables The innodb sort buffer should be optimized for large tables Dec 31, 2022
@github-actions github-actions bot locked and limited conversation to collaborators Apr 2, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement General tag for an enhancement installer Installation issue resolved A fixed issue
Projects
None yet
Development

No branches or pull requests

3 participants