Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add indices to Block table to improve query performance #4171

Merged
merged 1 commit into from
May 10, 2020

Conversation

warwickmm
Copy link
Member

@warwickmm warwickmm commented Apr 11, 2020

The index on Block.Size improves the performance of the query that checks that the user has not altered the block size of the backup configuration.

The index on Block.Hash and Block.VolumeID improves the performance of the query that obtains the blocklists.

There are anecdotes that these indices can drastically improve performance (queries that used to take hours completed in seconds with the index):

https://forum.duplicati.com/t/repairing-a-big-database/8174/4
#3884 (comment)

This fixes issue #3884.

The index on Block.Size improves the performance of the query that
checks that the user has not altered the block size of the backup
configuration.

The index on Block.Hash and Block.VolumeID improves the performance of
the query that obtains the blocklists.

There are anecdotes that these indices can drastically improve
performance (queries that used to take hours completed in seconds with
the index):

https://forum.duplicati.com/t/repairing-a-big-database/8174/4
duplicati#3884 (comment)

This fixes issue duplicati#3884.
@duplicatibot
Copy link

This pull request has been mentioned on Duplicati. There might be relevant details there:

https://forum.duplicati.com/t/repairing-a-big-database/8174/13

@duplicatibot
Copy link

This pull request has been mentioned on Duplicati. There might be relevant details there:

https://forum.duplicati.com/t/performance-tips-what-is-normal/6471/13

@duplicatibot
Copy link

This pull request has been mentioned on Duplicati. There might be relevant details there:

https://forum.duplicati.com/t/ideas-about-system-argumentnullexception-value-cannot-be-null-parameter-name-path/9425/20

@kenkendk kenkendk merged commit e8833c2 into duplicati:master May 10, 2020
@warwickmm warwickmm deleted the add_block_indices branch May 10, 2020 19:51
@duplicatibot
Copy link

This pull request has been mentioned on Duplicati. There might be relevant details there:

https://forum.duplicati.com/t/restore-why-is-loading-directories-for-restore-so-impossibly-slow/11893/9

@ts678 ts678 mentioned this pull request Jan 17, 2024
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants