Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

services/fs: Use separate dedicated thread pool instead #42

Merged
merged 3 commits into from
Feb 23, 2022

Conversation

Xuanwo
Copy link
Member

@Xuanwo Xuanwo commented Feb 23, 2022

Signed-off-by: Xuanwo github@xuanwo.io

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

This PR intends to replace the tokio::fs, see benchmark in #40.

In general, we will set up a separate thread pool to do blocking IO instead of relying on tokio's.

In the future, we will implement a real async fs backend support based on io_uring or aio, please keep tuned.


Current PR benchmark:

image

main branch:

image

Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
@Xuanwo Xuanwo merged commit 6596476 into apache:main Feb 23, 2022
@Xuanwo Xuanwo deleted the blocking branch February 23, 2022 05:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant