Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vlog.go: Fix wrongly maintain the offset of file in memory #640

Merged
merged 6 commits into from Jun 20, 2019

Conversation

july2993
Copy link
Contributor

@july2993 july2993 commented Jun 19, 2019

What problem does this PR solve?

Fix wrongly maintain the offset of file in memory

What is changed and how it works?

When the write fails but may successfully write some part of data
but we don't added the offset that we maintain, later successfully
write request will get a wrong offset.

Add a test mimic test case by mount a specify space tmpfs, but
currently only can run in linux platform(no tmpfs in mac), and
need root privilege.

Add a test when no disk space fail to write and should recover after disk space are free up
set file size resource limit to make it write fail like no disk space

Check List

Tests

  • Unit test
    Code changes

Side effects

Related changes

  • Need to cherry-pick to the release branch
  • Need to be included in the release note

When the write file but may successfully write some part of data
but we don's add the offset that we maintain, later successfully
write request will get a wrong offset.

Add a test minic test case by mount a specify space tmpfs, but
currently only can run in linux platform(no tmpfs in mac), and
need root privilege.
@july2993
Copy link
Contributor Author

/run-unit-test

@july2993
Copy link
Contributor Author

/run-unit-test

1 similar comment
@july2993
Copy link
Contributor Author

/run-unit-test

@july2993 july2993 requested a review from kennytm June 19, 2019 09:58
pump/storage/vlog_linux_test.go Outdated Show resolved Hide resolved
pump/storage/vlog_linux_test.go Outdated Show resolved Hide resolved
pump/storage/vlog_linux_test.go Outdated Show resolved Hide resolved
@july2993
Copy link
Contributor Author

/run-all-tests

Copy link
Contributor

@kennytm kennytm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@csuzhangxc csuzhangxc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@july2993 july2993 merged commit 68e94b8 into pingcap:master Jun 20, 2019
@july2993 july2993 deleted the hjh/test_space branch June 20, 2019 02:36
july2993 added a commit to july2993/tidb-binlog that referenced this pull request Jun 20, 2019
When the write file but may successfully write some part of data
but we don's added the offset that we maintain, later successfully
write request will get a wrong offset.

Add a test when no disk space fail to write and should recover after disk space are free up
set file size resource limit to make it write fail like no disk space
july2993 added a commit that referenced this pull request Jun 20, 2019
When the write file but may successfully write some part of data
but we don's added the offset that we maintain, later successfully
write request will get a wrong offset.

Add a test when no disk space fail to write and should recover after disk space are free up
set file size resource limit to make it write fail like no disk space
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants