Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix(multiprocessing): Reset pool if tasks are not completed #315

Merged
merged 8 commits into from
Dec 11, 2023
Merged

fix(multiprocessing): Reset pool if tasks are not completed #315

merged 8 commits into from
Dec 11, 2023

Commits on Dec 10, 2023

  1. fix(multiprocessing): Reset pool if tasks are not completed 

    If multiprocessing tasks are not completed within the timeout specified,
we need to reset the pool to avoid state being carried over between
assignments.

This change also defers the initial creation of the multiprocessing pool
until the first message is received, which moves it out of the assignment
callback (which needs to be fast).
    @lynnagara
    lynnagara committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    433045a View commit details
    Browse the repository at this point in the history

  2. undo lazy pool creation

    @lynnagara
    lynnagara committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    b177f56 View commit details
    Browse the repository at this point in the history

  3. undo

    @lynnagara
    lynnagara committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    630ec08 View commit details
    Browse the repository at this point in the history

  4. ensure pool is never create in recovation callback

    @lynnagara
    lynnagara committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    e63acfa View commit details
    Browse the repository at this point in the history

  5. update comment

    @lynnagara
    lynnagara committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    daf3c8a View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. add metric

    @lynnagara
    lynnagara committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    db3c392 View commit details
    Browse the repository at this point in the history

  2. .

    @lynnagara
    lynnagara committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    9115788 View commit details
    Browse the repository at this point in the history

  3. one more test

    @lynnagara
    lynnagara committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    4abc6e5 View commit details
    Browse the repository at this point in the history