Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

transformer workaround memory leak when processing large models #3253

Merged
merged 14 commits into from
Feb 22, 2022
Merged

transformer workaround memory leak when processing large models #3253

merged 14 commits into from
Feb 22, 2022

Commits on Feb 16, 2022

  1. use async query on primary connection for detect deletions to prevent… 

    … horrible sync memory usage
    @MichaelBelousov
    MichaelBelousov committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    ecb5017 View commit details
    Browse the repository at this point in the history

  2. save changes in the target every 500mgb, this will be configurable ev… 

    …entually
    @MichaelBelousov
    MichaelBelousov committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    21879d8 View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2022

  1. add sessionChangesetSizeSaveThreshold configuration of transformer, a… 

    …nd use async query on primary connection in hot loops to support larger iModels
    @MichaelBelousov
    MichaelBelousov committed Feb 18, 2022
    Configuration menu
    Copy the full SHA
    47d25bd View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2022

  1. created memory issue reproducing test

    @MichaelBelousov
    MichaelBelousov committed Feb 19, 2022
    Configuration menu
    Copy the full SHA
    cd338f1 View commit details
    Browse the repository at this point in the history

  2. tighten mv reproduction

    @MichaelBelousov
    MichaelBelousov committed Feb 19, 2022
    Configuration menu
    Copy the full SHA
    284b48e View commit details
    Browse the repository at this point in the history

  3. deterministic end and don't need primary connection

    @MichaelBelousov
    MichaelBelousov committed Feb 19, 2022
    Configuration menu
    Copy the full SHA
    c620c63 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2022

  1. separate getInstanceProps loop

    @MichaelBelousov
    MichaelBelousov committed Feb 20, 2022
    Configuration menu
    Copy the full SHA
    0cf9afc View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2022

  1. more leak test changes 

    run with `--trace_gc --trace_gc_ignore_scavenger --max_old_space_size=128 --max_semi_space_size=128`,
    @MichaelBelousov
    MichaelBelousov committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    5252423 View commit details
    Browse the repository at this point in the history

  2. restore working process size measure

    @MichaelBelousov
    MichaelBelousov committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    fe2e0d3 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2022

  1. remove test since there is now an mvr here: nodejs/node-addon-api#1140

    @MichaelBelousov
    MichaelBelousov committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    e835f1b View commit details
    Browse the repository at this point in the history

  2. revert this branch

    @MichaelBelousov
    MichaelBelousov committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    ae29ed6 View commit details
    Browse the repository at this point in the history

  3. add manual setImmediates to known large loops

    @MichaelBelousov
    MichaelBelousov committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    053b08d View commit details
    Browse the repository at this point in the history

  4. rush change

    @MichaelBelousov
    MichaelBelousov committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    2debe9d View commit details
    Browse the repository at this point in the history

  5. revert loop style change

    @MichaelBelousov
    MichaelBelousov committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    de7666e View commit details
    Browse the repository at this point in the history