Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

write anything beyond 4k to be written in 4k pages #19269

Merged
merged 1 commit into from Mar 15, 2024

Conversation

harshavardhana
Copy link
Member

@harshavardhana harshavardhana commented Mar 15, 2024

Community Contribution License

All community contributions in this pull request are licensed to the project maintainers
under the terms of the Apache 2 license.
By creating this pull request I represent that I have the right to license the
contributions to the project maintainers under the Apache 2 license.

Description

write anything beyond 4k to be written in 4k pages

Motivation and Context

we were prematurely not writing 4k pages while we
could have because most buffers would be multiples
of 4k up to some number, and there shall be some
remainder.

We only need to write the remainder without O_DIRECT
not the entire buffer.

How to test this PR?

CI/CD must test everything end-to-end

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Optimization (provides speedup with no functional changes)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • Fixes a regression (If yes, please add commit-id or PR # here)
  • Unit tests added/updated
  • Internal documentation updated
  • Create a documentation update request here

Copy link
Contributor

@klauspost klauspost left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can make this "sharper".

internal/ioutil/ioutil.go Outdated Show resolved Hide resolved
internal/ioutil/ioutil.go Outdated Show resolved Hide resolved
internal/ioutil/ioutil.go Show resolved Hide resolved
Copy link
Contributor

@klauspost klauspost left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍🏼 Should reduce syscalls nicely!

@harshavardhana harshavardhana force-pushed the write-unaligned branch 2 times, most recently from e941d06 to 7330376 Compare March 15, 2024 17:36
we were prematurely not writing 4k pages while we
could have due to the fact that most buffers would
be multiples of 4k upto some number and there shall
be some remainder.

We only need to write the remainder without O_DIRECT.
@harshavardhana harshavardhana merged commit c201d8b into minio:master Mar 15, 2024
20 checks passed
@harshavardhana harshavardhana deleted the write-unaligned branch March 15, 2024 19:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants