Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

log-backup: preventing OOM when restoring huge data set #38404

Closed
YuJuncen opened this issue Oct 11, 2022 · 0 comments · Fixed by #38386
Closed

log-backup: preventing OOM when restoring huge data set #38404

YuJuncen opened this issue Oct 11, 2022 · 0 comments · Fixed by #38386
Labels
type/enhancement The issue or PR belongs to an enhancement.

Comments

@YuJuncen
Copy link
Contributor

Enhancement

For now, we need to load all file metadata to main memory, which may cause OOM when there are many files backed up.
We can load them lazily to prevent OOM.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

log-backup: using streaming to load metadata for preventing OOM YuJuncen/tidb
1 participant
@YuJuncen