Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fixed size ThreadPool scheduler #20808

Merged
merged 69 commits into from
Jun 7, 2024
Merged

Fixed size ThreadPool scheduler #20808

merged 69 commits into from
Jun 7, 2024

Commits on Apr 4, 2024

  1. ThreadPool + tests.

    @maierlars
    maierlars committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    353c06a View commit details
    Browse the repository at this point in the history

  2. Added more tests.

    @maierlars
    maierlars committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    7b059ae View commit details
    Browse the repository at this point in the history

  3. Experiment with new scheduler.

    @maierlars
    maierlars committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    d2994c5 View commit details
    Browse the repository at this point in the history

  4. Increase number of threads.

    @maierlars
    maierlars committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    85bdc63 View commit details
    Browse the repository at this point in the history

  5. Sort out min-max-confusion.

    @maierlars
    maierlars committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    8d3b74a View commit details
    Browse the repository at this point in the history

  6. Fixing statistics and queue times.

    @maierlars
    maierlars committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    5d44080 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. Implement toVelocyPack to fix dump and restore tests.

    @maierlars
    maierlars committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    6ad55c7 View commit details
    Browse the repository at this point in the history

  2. Fix thread names in scheduler.

    @maierlars
    maierlars committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    b84c4ef View commit details
    Browse the repository at this point in the history

  3. Move scheduler metrics in to a shared struct.

    @maierlars
    maierlars committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    7c8b4dc View commit details
    Browse the repository at this point in the history

  4. Fix compilation. Set metrics value.

    @maierlars
    maierlars committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    6ee7eac View commit details
    Browse the repository at this point in the history

  5. Remove metrics.

    @maierlars
    maierlars committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    2648b4b View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'origin/devel' into feature/thread-pool-… 

    …scheduler
    @maierlars
    maierlars committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    137ead3 View commit details
    Browse the repository at this point in the history

  7. Temporarily disable logging.

    @maierlars
    maierlars committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    5e4028a View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2024

  1. Merge branch 'devel' into feature/thread-pool-scheduler

    @maierlars
    maierlars committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    b185fed View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. Merge remote-tracking branch 'origin/devel' into feature/thread-pool-… 

    …scheduler
    @maierlars
    maierlars committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    70e467f View commit details
    Browse the repository at this point in the history

  2. Fixing lane assignment.

    @maierlars
    maierlars committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    949882d View commit details
    Browse the repository at this point in the history

  3. Swallow exceptions in thread pool.

    @maierlars
    maierlars committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    ac40adc View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Add queue length metrics.

    @maierlars
    maierlars committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    5c08e33 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. Refactor test

    @mpoeter
    mpoeter committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    0d52975 View commit details
    Browse the repository at this point in the history

  2. Rename ThreadPool to SimpleThreadPool

    @mpoeter
    mpoeter committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    78c8c3c View commit details
    Browse the repository at this point in the history

  3. Adapt tests and add performance comparison tests

    @mpoeter
    mpoeter committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    6637afb View commit details
    Browse the repository at this point in the history

  4. Extend tests and revert now unneeded changes

    @mpoeter
    mpoeter committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    5ac752b View commit details
    Browse the repository at this point in the history

  5. Add LockfreeThreadPool

    @mpoeter
    mpoeter committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    57636c3 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. Fix tests and add WorkStealingThreadPool

    @mpoeter
    mpoeter committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    696521b View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Improve tests

    @mpoeter
    mpoeter committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    59f6e1f View commit details
    Browse the repository at this point in the history

  2. Improve WorkStealingThreadPool

    @mpoeter
    mpoeter committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    649143a View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Extend tests

    @mpoeter
    mpoeter committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    450b134 View commit details
    Browse the repository at this point in the history

  2. Shutdown pools explicitly

    @mpoeter
    mpoeter committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    2da9631 View commit details
    Browse the repository at this point in the history

  3. Improve tests

    @mpoeter
    mpoeter committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    dbe04aa View commit details
    Browse the repository at this point in the history

  4. Improve WorkStealingScheduler

    @mpoeter
    mpoeter committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    30b38cf View commit details
    Browse the repository at this point in the history

  5. Maintain metrics in WorkStealingThreadPool

    @mpoeter
    mpoeter committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    8da412b View commit details
    Browse the repository at this point in the history

  6. Use WorkStealingThreadPool in ThreadPoolScheduler

    @mpoeter
    mpoeter committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    27363b7 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'devel' into feature/thread-pool-scheduler

    @mpoeter
    mpoeter committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    06c0d97 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Fix log ids and test build

    @mpoeter
    mpoeter committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    c732191 View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. Fix statistics

    @mpoeter
    mpoeter committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    9785790 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'devel' into feature/thread-pool-scheduler

    @mpoeter
    mpoeter committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    fffe6d3 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Merge branch 'devel' into feature/thread-pool-scheduler

    @mpoeter
    mpoeter committed May 7, 2024
    Configuration menu
    Copy the full SHA
    43cbe2f View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Small improvements

    @mpoeter
    mpoeter committed May 14, 2024
    Configuration menu
    Copy the full SHA
    a102c26 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'devel' into feature/thread-pool-scheduler

    @mpoeter
    mpoeter committed May 14, 2024
    Configuration menu
    Copy the full SHA
    e7fec54 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Add queue time histograms for all scheduler queues

    @mpoeter
    mpoeter committed May 16, 2024
    Configuration menu
    Copy the full SHA
    b8317cf View commit details
    Browse the repository at this point in the history

  2. Fix LockfreeThreadPool

    @mpoeter
    mpoeter committed May 16, 2024
    Configuration menu
    Copy the full SHA
    d1a3e84 View commit details
    Browse the repository at this point in the history

  3. Add ThreadPoolMetrics to LockfreeThreadPool (still needs some wiring … 

    …though)
    @mpoeter
    mpoeter committed May 16, 2024
    Configuration menu
    Copy the full SHA
    de348ef View commit details
    Browse the repository at this point in the history

  4. Improve the WorkStealingThreadPool

    @mpoeter
    mpoeter committed May 16, 2024
    Configuration menu
    Copy the full SHA
    19d2098 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'devel' into feature/thread-pool-scheduler

    @mpoeter
    mpoeter committed May 16, 2024
    Configuration menu
    Copy the full SHA
    1d9f948 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. More tweaks to the WorkStealingThreadPool

    @mpoeter
    mpoeter committed May 17, 2024
    Configuration menu
    Copy the full SHA
    5fb9ffa View commit details
    Browse the repository at this point in the history

  2. Add documentation for new dequeue histograms

    @mpoeter
    mpoeter committed May 17, 2024
    Configuration menu
    Copy the full SHA
    def2e1c View commit details
    Browse the repository at this point in the history

  3. Add option to select scheduler type at startup

    @mpoeter
    mpoeter committed May 17, 2024
    Configuration menu
    Copy the full SHA
    ba515cd View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Increase resource class for cluster server_parameters test

    @mpoeter
    mpoeter committed May 22, 2024
    Configuration menu
    Copy the full SHA
    ebfb6e9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'devel' into feature/thread-pool-scheduler

    @mpoeter
    mpoeter committed May 22, 2024
    Configuration menu
    Copy the full SHA
    45c2bc7 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Merge branch 'devel' into feature/thread-pool-scheduler

    @mpoeter
    mpoeter committed May 23, 2024
    Configuration menu
    Copy the full SHA
    0ca67ef View commit details
    Browse the repository at this point in the history

  2. Address review comments

    @mpoeter
    mpoeter committed May 23, 2024
    Configuration menu
    Copy the full SHA
    655f185 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Address more review comments

    @mpoeter
    mpoeter committed May 24, 2024
    Configuration menu
    Copy the full SHA
    3e97de4 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. Add some debug output

    @mpoeter
    mpoeter committed May 27, 2024
    Configuration menu
    Copy the full SHA
    d367707 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'devel' into feature/thread-pool-scheduler

    @mpoeter
    mpoeter committed May 27, 2024
    Configuration menu
    Copy the full SHA
    e5f8e27 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Introduce alias to make it easier to switch pool implementation in Th… 

    …readPoolScheduler
    @mpoeter
    mpoeter committed May 28, 2024
    Configuration menu
    Copy the full SHA
    e75e384 View commit details
    Browse the repository at this point in the history

  2. Shutdown thread pools in scheduler shutdown

    @mpoeter
    mpoeter committed May 28, 2024
    Configuration menu
    Copy the full SHA
    f3cd3da View commit details
    Browse the repository at this point in the history

  3. Fix debug output

    @mpoeter
    mpoeter committed May 28, 2024
    Configuration menu
    Copy the full SHA
    ffcfff2 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Merge branch 'devel' into feature/thread-pool-scheduler

    @mpoeter
    mpoeter committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    398be7c View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Default to SupervisedScheduler

    @mpoeter
    mpoeter committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    933e248 View commit details
    Browse the repository at this point in the history

  2. Change scheduler parameter to "threadpools"

    @mpoeter
    mpoeter committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    d8f7f76 View commit details
    Browse the repository at this point in the history

  3. Use shorter name for maintenance threads 

    The longer name exceeded the limit so setting the thread name failed.
    @mpoeter
    mpoeter committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    f43b53e View commit details
    Browse the repository at this point in the history

  4. Use ThreadPoolScheduler as default

    @mpoeter
    mpoeter committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    4d6b467 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'devel' into feature/thread-pool-scheduler

    @mpoeter
    mpoeter committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    3039601 View commit details
    Browse the repository at this point in the history

  6. Default to SupervisedScheduler

    @mpoeter
    mpoeter committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    959b559 View commit details
    Browse the repository at this point in the history

  7. Implement more tracking functions

    @mpoeter
    mpoeter committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    1b78e70 View commit details
    Browse the repository at this point in the history

  8. Add comment

    @mpoeter
    mpoeter committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    778ce53 View commit details
    Browse the repository at this point in the history

  9. Revert unintentional changes

    @mpoeter
    mpoeter committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    cc9b5d8 View commit details
    Browse the repository at this point in the history

  10. Update arangod/Scheduler/ThreadPoolScheduler.cpp

    @jsteemann
    jsteemann committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    7e6003d View commit details
    Browse the repository at this point in the history

  11. Merge branch 'devel' into feature/thread-pool-scheduler

    @jsteemann
    jsteemann committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    0098ace View commit details
    Browse the repository at this point in the history