Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PostgreSQL - Reduce memory usage by not tracking metadata of the files backed up #1101

Merged
merged 3 commits into from
Nov 25, 2021

Commits on Nov 24, 2021

  1. PostgreSQL - Reduce memory usage by not tracking metadata of the file…

    …s backed up
    
    By default, WAL-G tracks metadata of the files backed up. If millions of files are backed up (typically in case of hundreds of databases and thousands of tables in each database), tracking this metadata alone would require GBs of memory.
    
    If `--reduce-memory-usage` or `WALG_REDUCE_MEMORY_USAGE` is enabled, WAL-G does not track metadata of the files backed up. This significantly reduces the memory usage on instances with `> 100k` files.
    
    Limitations
    
    * Cannot be used with `rating-composer`, `copy-composer`
    * Cannot be used with `delta-from-user-data`, `delta-from-name`, `add-user-data`
    krnaveen14 authored and usernamedt committed Nov 24, 2021
    Configuration menu
    Copy the full SHA
    9ce92ed View commit details
    Browse the repository at this point in the history
  2. Rename --reduce-memory-usage (WALG_REDUCE_MEMORY_USAGE) flag to --wit…

    …hout-files-metadata (WALG_WITHOUT_FILES_METADATA)
    krnaveen14 authored and usernamedt committed Nov 24, 2021
    Configuration menu
    Copy the full SHA
    7c9558d View commit details
    Browse the repository at this point in the history
  3. Minor fixes

    usernamedt committed Nov 24, 2021
    Configuration menu
    Copy the full SHA
    b7abd11 View commit details
    Browse the repository at this point in the history