Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Asynchronous loading of tables #49351

Merged
merged 180 commits into from Dec 4, 2023
Merged

Asynchronous loading of tables #49351

merged 180 commits into from Dec 4, 2023

Commits on Apr 19, 2023

  1. wip AsyncLoader

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    ccf2c4e View commit details
    Browse the repository at this point in the history

  2. make t work, add simple test

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    df1f48d View commit details
    Browse the repository at this point in the history

  3. fix style

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    dad9d27 View commit details
    Browse the repository at this point in the history

  4. add dependency cycle detection

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    53e5350 View commit details
    Browse the repository at this point in the history

  5. add simple randomized test

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    e59e127 View commit details
    Browse the repository at this point in the history

  6. add tests for job status/wait/cancel

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    3e936cc View commit details
    Browse the repository at this point in the history

  7. add more tests for cancel

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    46a9b9a View commit details
    Browse the repository at this point in the history

  8. fix remove of executing tasks + add test

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    569f765 View commit details
    Browse the repository at this point in the history

  9. allow cancels on RandomTasks test shutdown

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    15f1962 View commit details
    Browse the repository at this point in the history

  10. add concurrency test

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    7605f51 View commit details
    Browse the repository at this point in the history

  11. add overload test

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    0024feb View commit details
    Browse the repository at this point in the history

  12. test deps are completed + refactoring

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    a83fc81 View commit details
    Browse the repository at this point in the history

  13. add LoadStatus::CANCELED

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    78d5a4d View commit details
    Browse the repository at this point in the history

  14. fix scheduling of jobs with dependencies on finished jobs

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    8584f7f View commit details
    Browse the repository at this point in the history

  15. add ScheduleJobWithCanceledDependencies test

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    3dfe950 View commit details
    Browse the repository at this point in the history

  16. fix worker shutdown

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    42ad5f3 View commit details
    Browse the repository at this point in the history

  17. add random test with dependent tasks

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    35daa18 View commit details
    Browse the repository at this point in the history

  18. make performance-inefficient-vector-operation,-warnings-as-errors happy

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    8835245 View commit details
    Browse the repository at this point in the history

  19. add test for static priorities

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    d34aeab View commit details
    Browse the repository at this point in the history

  20. fix test

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    05c63bc View commit details
    Browse the repository at this point in the history

  21. allow to change max number of workers in runtime

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    2b99aee View commit details
    Browse the repository at this point in the history

  22. add a good comment

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    1d590fd View commit details
    Browse the repository at this point in the history

  23. fix

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    4636a45 View commit details
    Browse the repository at this point in the history

  24. Update src/Common/AsyncLoader.h

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    feb690d View commit details
    Browse the repository at this point in the history

  25. Update src/Common/AsyncLoader.h

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    eab312e View commit details
    Browse the repository at this point in the history

  26. split AsyncLoader into .h and .cpp files + more docs

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    b55d5a8 View commit details
    Browse the repository at this point in the history

  27. fix comment

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    883f5c4 View commit details
    Browse the repository at this point in the history

  28. fix double finish() during cancellation of a job with multiple paths

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    241c476 View commit details
    Browse the repository at this point in the history

  29. add test for dynamic prioritization

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    e7dcf91 View commit details
    Browse the repository at this point in the history

  30. fix tidy build

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    28f1129 View commit details
    Browse the repository at this point in the history

  31. fix data race in test

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    d08fc90 View commit details
    Browse the repository at this point in the history

  32. fix typos

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    b07b243 View commit details
    Browse the repository at this point in the history

  33. fix more comments

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    6edd7a7 View commit details
    Browse the repository at this point in the history

  34. better job shutdown

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    8ae2f72 View commit details
    Browse the repository at this point in the history

  35. typo

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    cf7a341 View commit details
    Browse the repository at this point in the history

  36. Update src/Common/AsyncLoader.h 

    Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
    @serxa @antonio2368
    serxa and antonio2368 committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    d6a83ba View commit details
    Browse the repository at this point in the history

  37. review fixes

    @serxa
    serxa committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    f3c68fb View commit details
    Browse the repository at this point in the history

  38. Update src/Common/AsyncLoader.h 

    Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
    @serxa @antonio2368
    serxa and antonio2368 committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    f74864f View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2023

  1. improve AsyncLoader interface

    @serxa
    serxa committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    198b992 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2023

  1. wip async tables loading

    @serxa
    serxa committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    3546699 View commit details
    Browse the repository at this point in the history

  2. more work

    @serxa
    serxa committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    8612240 View commit details
    Browse the repository at this point in the history

  3. fix build

    @serxa
    serxa committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    879a6e0 View commit details
    Browse the repository at this point in the history

  4. fix tidy build

    @serxa
    serxa committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    1dd81b2 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2023

  1. fix tidy build

    @serxa
    serxa committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    7b484c7 View commit details
    Browse the repository at this point in the history

  2. log progress in AsyncLoader

    @serxa
    serxa committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    6c88f3c View commit details
    Browse the repository at this point in the history

  3. working on async loading in TablesLoader

    @serxa
    serxa committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    37ee4db View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2023

  1. schedule() jobs recursively with its dependencies

    @serxa
    serxa committed Apr 30, 2023
    Configuration menu
    Copy the full SHA
    e26d1b2 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2023

  1. more helpers for AsyncLoader

    @serxa
    serxa committed May 1, 2023
    Configuration menu
    Copy the full SHA
    036ae9d View commit details
    Browse the repository at this point in the history

  2. integrate with Server and TablesLoader

    @serxa
    serxa committed May 1, 2023
    Configuration menu
    Copy the full SHA
    abaf732 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed May 1, 2023
    Configuration menu
    Copy the full SHA
    8dab49f View commit details
    Browse the repository at this point in the history

  4. fix typo

    @serxa
    serxa committed May 1, 2023
    Configuration menu
    Copy the full SHA
    9e115e1 View commit details
    Browse the repository at this point in the history

  5. cleanup

    @serxa
    serxa committed May 1, 2023
    Configuration menu
    Copy the full SHA
    85d6698 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2023

  1. improve helper functions

    @serxa
    serxa committed May 2, 2023
    Configuration menu
    Copy the full SHA
    c518101 View commit details
    Browse the repository at this point in the history

  2. implement async loading interface in database engines

    @serxa
    serxa committed May 2, 2023
    Configuration menu
    Copy the full SHA
    6eda6e8 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2023

  1. add AsyncLoader introspection

    @serxa
    serxa committed May 3, 2023
    Configuration menu
    Copy the full SHA
    53dbdab View commit details
    Browse the repository at this point in the history

  2. add system.async_loader table

    @serxa
    serxa committed May 3, 2023
    Configuration menu
    Copy the full SHA
    d834ffd View commit details
    Browse the repository at this point in the history

  3. Update src/Common/AsyncLoader.cpp 

    Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
    @serxa @antonio2368
    serxa and antonio2368 committed May 3, 2023
    Configuration menu
    Copy the full SHA
    defdd2a View commit details
    Browse the repository at this point in the history

  4. Update src/Common/AsyncLoader.h 

    Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
    @serxa @antonio2368
    serxa and antonio2368 committed May 3, 2023
    Configuration menu
    Copy the full SHA
    8edb318 View commit details
    Browse the repository at this point in the history

  5. Update src/Common/AsyncLoader.h 

    Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
    @serxa @antonio2368
    serxa and antonio2368 committed May 3, 2023
    Configuration menu
    Copy the full SHA
    55e530f View commit details
    Browse the repository at this point in the history

  6. Update src/Common/AsyncLoader.h 

    Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
    @serxa @antonio2368
    serxa and antonio2368 committed May 3, 2023
    Configuration menu
    Copy the full SHA
    935b094 View commit details
    Browse the repository at this point in the history

  7. do not pollute unittests output with progress

    @serxa
    serxa committed May 3, 2023
    Configuration menu
    Copy the full SHA
    93a4f7f View commit details
    Browse the repository at this point in the history

  8. fix style

    @serxa
    serxa committed May 3, 2023
    Configuration menu
    Copy the full SHA
    8539882 View commit details
    Browse the repository at this point in the history

  9. fix style, get rid of DatabaseOrdinaryThreads* metrics

    @serxa
    serxa committed May 3, 2023
    Configuration menu
    Copy the full SHA
    3327c0f View commit details
    Browse the repository at this point in the history

Commits on May 9, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed May 9, 2023
    Configuration menu
    Copy the full SHA
    b479637 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed May 9, 2023
    Configuration menu
    Copy the full SHA
    1198f1f View commit details
    Browse the repository at this point in the history

Commits on May 10, 2023

  1. start loader, fix helpers, fix deadlock

    @serxa
    serxa committed May 10, 2023
    Configuration menu
    Copy the full SHA
    6bbc061 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2023

  1. fix startup of database w/o tables

    @serxa
    serxa committed May 11, 2023
    Configuration menu
    Copy the full SHA
    a7f514e View commit details
    Browse the repository at this point in the history

  2. fix LocalServer fast-tests

    @serxa
    serxa committed May 11, 2023
    Configuration menu
    Copy the full SHA
    529a702 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2023

  1. temporarily disable JobFailure test

    @serxa
    serxa committed May 12, 2023
    Configuration menu
    Copy the full SHA
    f0921f2 View commit details
    Browse the repository at this point in the history

  2. fix disable test

    @serxa
    serxa committed May 12, 2023
    Configuration menu
    Copy the full SHA
    3c1ae12 View commit details
    Browse the repository at this point in the history

  3. add async_load_databases server setting

    @serxa
    serxa committed May 12, 2023
    Configuration menu
    Copy the full SHA
    4d31051 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed May 12, 2023
    Configuration menu
    Copy the full SHA
    426184e View commit details
    Browse the repository at this point in the history

  5. fix

    @serxa
    serxa committed May 12, 2023
    Configuration menu
    Copy the full SHA
    576a27a View commit details
    Browse the repository at this point in the history

  6. fix metrics docs

    @serxa
    serxa committed May 12, 2023
    Configuration menu
    Copy the full SHA
    e1761a0 View commit details
    Browse the repository at this point in the history

  7. refact

    @serxa
    serxa committed May 12, 2023
    Configuration menu
    Copy the full SHA
    9bf5292 View commit details
    Browse the repository at this point in the history

  8. fix

    @serxa
    serxa committed May 12, 2023
    Configuration menu
    Copy the full SHA
    646bc6b View commit details
    Browse the repository at this point in the history

Commits on May 14, 2023

  1. fix style

    @serxa
    serxa committed May 14, 2023
    Configuration menu
    Copy the full SHA
    e14acdf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed May 14, 2023
    Configuration menu
    Copy the full SHA
    e2c1581 View commit details
    Browse the repository at this point in the history

  3. fix conflicts after merge

    @serxa
    serxa committed May 14, 2023
    Configuration menu
    Copy the full SHA
    ec7f4fb View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. fix UNKNOWN_TABLE problem during async startup

    @serxa
    serxa committed May 22, 2023
    Configuration menu
    Copy the full SHA
    4127599 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed May 22, 2023
    Configuration menu
    Copy the full SHA
    994cfaf View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. fix style

    @serxa
    serxa committed May 23, 2023
    Configuration menu
    Copy the full SHA
    edbc9ba View commit details
    Browse the repository at this point in the history

  2. refactoring

    @serxa
    serxa committed May 23, 2023
    Configuration menu
    Copy the full SHA
    a9db6bd View commit details
    Browse the repository at this point in the history

  3. fix tidy build

    @serxa
    serxa committed May 23, 2023
    Configuration menu
    Copy the full SHA
    87a16d8 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed May 26, 2023
    Configuration menu
    Copy the full SHA
    fe172f5 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed May 31, 2023
    Configuration menu
    Copy the full SHA
    9b64c6b View commit details
    Browse the repository at this point in the history

  2. rework async loader initialization and reconfiguration for bg/fg pools

    @serxa
    serxa committed May 31, 2023
    Configuration menu
    Copy the full SHA
    e1045f7 View commit details
    Browse the repository at this point in the history

  3. use pool ids instead of priorities in load jobs

    @serxa
    serxa committed May 31, 2023
    Configuration menu
    Copy the full SHA
    5048050 View commit details
    Browse the repository at this point in the history

  4. add helpers for prioritize+wait calls and fix build

    @serxa
    serxa committed May 31, 2023
    Configuration menu
    Copy the full SHA
    303e3f0 View commit details
    Browse the repository at this point in the history

  5. fix system.async_loader

    @serxa
    serxa committed May 31, 2023
    Configuration menu
    Copy the full SHA
    d364cd0 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed May 31, 2023
    Configuration menu
    Copy the full SHA
    eba55cc View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2023

  1. fix server

    @serxa
    serxa committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    aceca2e View commit details
    Browse the repository at this point in the history

  2. fix clickhouse-local

    @serxa
    serxa committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    866c9df View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    3ee782a View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2023

  1. wait db load before DROP table from Atomic Database

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    301dfc0 View commit details
    Browse the repository at this point in the history

  2. clean

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    47d70db View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    6aadcff View commit details
    Browse the repository at this point in the history

  4. Merge branch 'async-loader-integration' of github.com:ClickHouse/Clic… 

    …kHouse into async-loader-integration
    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    1f5b238 View commit details
    Browse the repository at this point in the history

  5. add utils/async_loader_graph graph rendering tool

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    e2ae501 View commit details
    Browse the repository at this point in the history

  6. fix usage

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    5509749 View commit details
    Browse the repository at this point in the history

  7. introduce unique job_id in async_loader

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    443ec12 View commit details
    Browse the repository at this point in the history

  8. reply on job_id instead of job name

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    27b7196 View commit details
    Browse the repository at this point in the history

  9. fix style

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    1dcf097 View commit details
    Browse the repository at this point in the history

  10. add async_laoder deadlock detection on job waiting

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    34ef633 View commit details
    Browse the repository at this point in the history

  11. fix style

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    261f496 View commit details
    Browse the repository at this point in the history

  12. spell

    @serxa
    serxa committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    bacf1d6 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jun 4, 2023
    Configuration menu
    Copy the full SHA
    0d9e6aa View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    cb37506 View commit details
    Browse the repository at this point in the history

  2. fix

    @serxa
    serxa committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    ea70d57 View commit details
    Browse the repository at this point in the history

  3. do not use table uuid in TablesLoader

    @serxa
    serxa committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    4dd026e View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    0cbcff9 View commit details
    Browse the repository at this point in the history

  2. typos

    @serxa
    serxa committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    6567901 View commit details
    Browse the repository at this point in the history

  3. add deadlock resolution of "blocked pool"

    @serxa
    serxa committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    6351dc2 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. unlimit queues and threads in ThreadPool

    @serxa
    serxa committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    3512390 View commit details
    Browse the repository at this point in the history

  2. more testing for suspendend workers

    @serxa
    serxa committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    0bd3b46 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. fix reverse locking problem

    @serxa
    serxa committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    a1fde35 View commit details
    Browse the repository at this point in the history

  2. add test for subjobs

    @serxa
    serxa committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    5b050da View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    02e0d7e View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. fix "wait for not scheduled" deadlock in loadMetadata()

    @serxa
    serxa committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    a78eec6 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    e2798b5 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. use current priority for waits from load jobs

    @serxa
    serxa committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    31b4417 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    b9b0076 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. fix prioritization/schedule race

    @serxa
    serxa committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    a9c9acf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    bbb5850 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    850ab23 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2023

  1. add auto-resolution for all resolvable deadlock types

    @serxa
    serxa committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    6bca79f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    b8a46ff View commit details
    Browse the repository at this point in the history

  3. avoid using bg pool during non-async start

    @serxa
    serxa committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    02fc66d View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. remove debug print

    @serxa
    serxa committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    38b6fba View commit details
    Browse the repository at this point in the history

  2. cleanup

    @serxa
    serxa committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    bdcae64 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2023

  1. fix

    @serxa
    serxa committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    4e52c88 View commit details
    Browse the repository at this point in the history

  2. fix: schedule all the jobs before waiting one-by-one

    @serxa
    serxa committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    8c1688b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    8eaf3b6 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    e4ae2ec View commit details
    Browse the repository at this point in the history

  2. fix build

    @serxa
    serxa committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    7c34fb6 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. add simple integrational tests

    @serxa
    serxa committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    80ec3d2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    432d359 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    2c47bb2 View commit details
    Browse the repository at this point in the history

  4. Automatic style fix

    @robot-clickhouse
    robot-clickhouse committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    a0cf23c View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. fix style

    @serxa
    serxa committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    eecd9a0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'async-loader-integration' of github.com:ClickHouse/Clic… 

    …kHouse into async-loader-integration
    @serxa
    serxa committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    953a73d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    f35c686 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    c10e42c View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. Update src/Storages/System/StorageSystemAsyncLoader.h

    @serxa
    serxa committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    aac5b03 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. working on review comments

    @serxa
    serxa committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    a2f8f6b View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. rename settings

    @serxa
    serxa committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    28e6588 View commit details
    Browse the repository at this point in the history

  2. add explanations for helper functions

    @serxa
    serxa committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    93cf15d View commit details
    Browse the repository at this point in the history

  3. do CREATE query async

    @serxa
    serxa committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    2920f04 View commit details
    Browse the repository at this point in the history

  4. fix style

    @serxa
    serxa committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    fabd233 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. fix spell check

    @serxa
    serxa committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    f2900e9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    12c71be View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    0e17da2 View commit details
    Browse the repository at this point in the history

  2. create async_loader once

    @serxa
    serxa committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    e214b73 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. add startup waits in all DDL queries and global DDL worker

    @serxa
    serxa committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    d3f54a2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    749cdb9 View commit details
    Browse the repository at this point in the history

  3. get rid of atomics

    @serxa
    serxa committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    02b6497 View commit details
    Browse the repository at this point in the history

  4. fix build

    @serxa
    serxa committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    08e63f2 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    a5d7c2b View commit details
    Browse the repository at this point in the history

  2. fix conflicts

    @serxa
    serxa committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    62f5116 View commit details
    Browse the repository at this point in the history

  3. implement waits inside tables iterator

    @serxa
    serxa committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    be11170 View commit details
    Browse the repository at this point in the history

  4. remove wrong waits

    @serxa
    serxa committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    59c0f4c View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. fix

    @serxa
    serxa committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    9f954ec View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    e97edf5 View commit details
    Browse the repository at this point in the history

  3. add AsyncLoaderWaitMicroseconds profile event

    @serxa
    serxa committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    1fe344c View commit details
    Browse the repository at this point in the history

  4. DatabaseCatalog::getTable() should also wait

    @serxa
    serxa committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    c1c3903 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2023

  1. wait for db to be started iff it was async-started

    @serxa
    serxa committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    d0b93d9 View commit details
    Browse the repository at this point in the history

  2. better

    @serxa
    serxa committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    7e22018 View commit details
    Browse the repository at this point in the history

  3. randomize async_load_databases in stress tests

    @serxa
    serxa committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    77dc2e6 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2023

  1. fix defaults for new pools in server config.xml

    @serxa
    serxa committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    28128d3 View commit details
    Browse the repository at this point in the history

  2. rename metrics for new pools to match settings

    @serxa
    serxa committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    6babc8e View commit details
    Browse the repository at this point in the history

  3. rework AsyncLoaderPoolId.h to match settings and metrics

    @serxa
    serxa committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    d507478 View commit details
    Browse the repository at this point in the history

  4. fix ddl worker startup

    @serxa
    serxa committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    96c902b View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. comment

    @serxa
    serxa committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    24f8878 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    19aa137 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Nov 19, 2023
    Configuration menu
    Copy the full SHA
    9023f61 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2023

  1. fix

    @serxa
    serxa committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    135f3e0 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2023

  1. Merge branch 'master' into async-loader-integration

    @serxa
    serxa committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    0fc25fb View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2023

  1. wait for database to load before shutdown

    @serxa
    serxa committed Nov 25, 2023
    Configuration menu
    Copy the full SHA
    6937c0d View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2023

  1. do not rethrow load errors during db shutdown

    @serxa
    serxa committed Nov 26, 2023
    Configuration menu
    Copy the full SHA
    9d6a9d3 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2023

  1. get rid of defaults to make clang-tidy happy

    @serxa
    serxa committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    8d8418a View commit details
    Browse the repository at this point in the history