Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[pull] master from ClickHouse:master #3767

Merged
merged 80 commits into from
Mar 31, 2022
Merged

[pull] master from ClickHouse:master #3767

merged 80 commits into from
Mar 31, 2022

Commits on Jan 27, 2022

  1. Add groupSortedArray() function

    @palegre-tiny
    palegre-tiny committed Jan 27, 2022
    Configuration menu
    Copy the full SHA
    e813f64 View commit details
    Browse the repository at this point in the history

Commits on Feb 4, 2022

  1. fixup! Add groupSortedArray() function 

    - Fix memory access
- Support any type as sorting parameter
- Fix tests
- Rewrite/simplify function addBatchSinglePlace
    @palegre-tiny
    palegre-tiny committed Feb 4, 2022
    Configuration menu
    Copy the full SHA
    7f553d5 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2022

  1. fixup! Add groupSortedArray() function

    @palegre-tiny
    palegre-tiny committed Feb 8, 2022
    Configuration menu
    Copy the full SHA
    9c38b1a View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2022

  1. fixup! Add groupSortedArray() function 

    fixup! Add groupSortedArray() function

fixup! Add groupSortedArray() function
    @palegre-tiny
    palegre-tiny committed Feb 10, 2022
    Configuration menu
    Copy the full SHA
    de7bbc7 View commit details
    Browse the repository at this point in the history

  2. fixup! Add groupSortedArray() function

    @palegre-tiny
    palegre-tiny committed Feb 10, 2022
    Configuration menu
    Copy the full SHA
    1e4b504 View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2022

  1. fixup! Evolve to TinySum

    @palegre-tiny
    palegre-tiny committed Feb 11, 2022
    Configuration menu
    Copy the full SHA
    c65eaa5 View commit details
    Browse the repository at this point in the history

  2. fixup! Evolve to TinySum

    @palegre-tiny
    palegre-tiny committed Feb 11, 2022
    Configuration menu
    Copy the full SHA
    3e537a7 View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2022

  1. add simple sanity checks for server startup

    @serxa
    serxa committed Feb 13, 2022
    Configuration menu
    Copy the full SHA
    2b0b032 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2022

  1. Merge branch 'master' into groupSortedArray

    @mergify
    mergify[bot] committed Feb 14, 2022
    Configuration menu
    Copy the full SHA
    aab54f4 View commit details
    Browse the repository at this point in the history

  2. Apply suggestions from code review 

    Co-authored-by: alesapin <alesapin@clickhouse.com>
    @serxa @alesapin
    serxa and alesapin committed Feb 14, 2022
    Configuration menu
    Copy the full SHA
    3d66acc View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2022

  1. avoid unhandled exceptions on sanity checks at server startup

    @serxa
    serxa committed Feb 15, 2022
    Configuration menu
    Copy the full SHA
    a819cb7 View commit details
    Browse the repository at this point in the history

  2. fix style

    @serxa
    serxa committed Feb 15, 2022
    Configuration menu
    Copy the full SHA
    7ea3c00 View commit details
    Browse the repository at this point in the history

  3. support determine available memory for FreeBSD

    @serxa
    serxa committed Feb 15, 2022
    Configuration menu
    Copy the full SHA
    0f66743 View commit details
    Browse the repository at this point in the history

  4. fixup! Add groupSortedArray() function

    @palegre-tiny
    palegre-tiny committed Feb 15, 2022
    Configuration menu
    Copy the full SHA
    9466aaf View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2022

  1. fixup! fixup! Add groupSortedArray() function

    @palegre-tiny
    palegre-tiny committed Feb 24, 2022
    Configuration menu
    Copy the full SHA
    74f99f7 View commit details
    Browse the repository at this point in the history

Commits on Feb 25, 2022

  1. Merge branch 'master' into groupSortedArray

    @mergify
    mergify[bot] committed Feb 25, 2022
    Configuration menu
    Copy the full SHA
    cd6f1d8 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2022

  1. Merge branch 'master' into groupSortedArray

    @mergify
    mergify[bot] committed Mar 21, 2022
    Configuration menu
    Copy the full SHA
    5df84df View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2022

  1. fix style and darwin build

    @serxa
    serxa committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    c7cf14e View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2022

  1. deduce hdfs config path

    @taiyang-li
    taiyang-li committed Mar 24, 2022
    Configuration menu
    Copy the full SHA
    6eccd09 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into startup-sanity-checks

    @alesapin
    alesapin committed Mar 24, 2022
    Configuration menu
    Copy the full SHA
    93d1b1d View commit details
    Browse the repository at this point in the history

  3. Fix style

    @alesapin
    alesapin committed Mar 24, 2022
    Configuration menu
    Copy the full SHA
    d3fbd9b View commit details
    Browse the repository at this point in the history

  4. remote std::cout

    @taiyang-li
    taiyang-li committed Mar 24, 2022
    Configuration menu
    Copy the full SHA
    c0eb9f7 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into startup-sanity-checks

    @mergify
    mergify[bot] committed Mar 24, 2022
    Configuration menu
    Copy the full SHA
    394fdb4 View commit details
    Browse the repository at this point in the history

  6. cosmetic bugfix

    @serxa
    serxa committed Mar 24, 2022
    Configuration menu
    Copy the full SHA
    041e348 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'startup-sanity-checks' of github.com:ClickHouse/ClickHo… 

    …use into startup-sanity-checks
    @serxa
    serxa committed Mar 24, 2022
    Configuration menu
    Copy the full SHA
    2e2a1c0 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2022

  1. fix darwin build

    @serxa
    serxa committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    85f2ed1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into hdfs_config_prefix

    @taiyang-li
    taiyang-li committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    c013cd0 View commit details
    Browse the repository at this point in the history

  3. only deduce absolute path of hdfs config when it's relative path do n… 

    …ot exists
    @taiyang-li
    taiyang-li committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    fbadd8f View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2022

  1. Merge branch 'master' into groupSortedArray

    @mergify
    mergify[bot] committed Mar 28, 2022
    Configuration menu
    Copy the full SHA
    bf5a9dc View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2022

  1. Merge branch 'master' into hdfs_config_prefix

    @taiyang-li
    taiyang-li committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    7731424 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into startup-sanity-checks

    @alesapin
    alesapin committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    ed2c461 View commit details
    Browse the repository at this point in the history

  3. Fix build

    @alesapin
    alesapin committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    4db85e2 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/startup-sanity-checks' into star… 

    …tup-sanity-checks
    @alesapin
    alesapin committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    842c0b8 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into hdfs_config_prefix

    @taiyang-li
    taiyang-li committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    631352b View commit details
    Browse the repository at this point in the history

  6. run stateful tests in parallel

    @tavplubix
    tavplubix committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    c37945b View commit details
    Browse the repository at this point in the history

  7. Fix

    @kssenii
    kssenii committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    a2e950b View commit details
    Browse the repository at this point in the history

  8. Followup

    @alesapin
    alesapin committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    c6c0c91 View commit details
    Browse the repository at this point in the history

  9. fix some flaky tests

    @tavplubix
    tavplubix committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    6191eaa View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2022

  1. Merge branch 'master' into hdfs_config_prefix

    @taiyang-li
    taiyang-li committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    9ffb42d View commit details
    Browse the repository at this point in the history

  2. respect remote_url_allow_hosts for hive

    @taiyang-li
    taiyang-li committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    16bb4c4 View commit details
    Browse the repository at this point in the history

  3. fix black_style

    @taiyang-li
    taiyang-li committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    f2779ea View commit details
    Browse the repository at this point in the history

  4. Use same IOThreadPool for URL and S3

    @antonio2368
    antonio2368 committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    1173eab View commit details
    Browse the repository at this point in the history

  5. Fix black style

    @antonio2368
    antonio2368 committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    f047560 View commit details
    Browse the repository at this point in the history

  6. Remove setup and cleanup

    @antonio2368
    antonio2368 committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    de2c668 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' into parallel_stateful

    @mergify
    mergify[bot] committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    9a391f2 View commit details
    Browse the repository at this point in the history

  8. Update 00170_s3_cache.sql

    @tavplubix
    tavplubix committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    531942c View commit details
    Browse the repository at this point in the history

  9. Fix bug in conversion from custom types to string

    @Avogar
    Avogar committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    af4bfec View commit details
    Browse the repository at this point in the history

  10. Create CallbackRunner in Storage

    @antonio2368
    antonio2368 committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    a3ad99b View commit details
    Browse the repository at this point in the history

  11. Update 00170_s3_cache.reference

    @tavplubix
    tavplubix committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    cf8332e View commit details
    Browse the repository at this point in the history

  12. Merge master

    @kssenii
    kssenii committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    c1ae581 View commit details
    Browse the repository at this point in the history

  13. Merge branch 'master' into startup-sanity-checks

    @mergify
    mergify[bot] committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    78bcf26 View commit details
    Browse the repository at this point in the history

  14. clickhouse-keeper: correctly handle closed client connection 

    This will avoid noisy message like:

    DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
    @azat
    azat committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    9820230 View commit details
    Browse the repository at this point in the history

  15. Fix

    @kssenii
    kssenii committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    ac4897f View commit details
    Browse the repository at this point in the history

  16. clickhouse-keeper: fix implementation of server with poll() 

    Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
    @azat
    azat committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    38873d7 View commit details
    Browse the repository at this point in the history

  17. ci: replace directory system log tables artifacts with tsv 

    Changelog:
- remove query_thread_log (query_log should be enough)
- for s3 storage there /var/lib/clickhouse/data/system/*_log cannot be
  used, replace them with plain TSVWithNamesAndTypes, also note, that
  after schema inference it is even pretty easy to use
- support replicated database env correctly

Co-authored-by: tavplubix <tavplubix@clickhouse.com>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
    @azat @tavplubix
    azat and tavplubix committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    8b84829 View commit details
    Browse the repository at this point in the history

  18. One more try to resurrect build hash

    @alesapin
    alesapin committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    10db099 View commit details
    Browse the repository at this point in the history

  19. Merge pull request #35720 from ClickHouse/parallel_stateful 

    Try to run stateful tests in parallel
    @alesapin
    alesapin committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    5a55913 View commit details
    Browse the repository at this point in the history

  20. Merge pull request #35755 from Avogar/fix-custom-to-string 

    Fix bug in conversion from custom types to string
    @Avogar
    Avogar committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    4ec3c35 View commit details
    Browse the repository at this point in the history

  21. Merge branch 'master' into startup-sanity-checks

    @alesapin
    alesapin committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    81ce991 View commit details
    Browse the repository at this point in the history

  22. Merge pull request #34055 from palegre-tiny/groupSortedArray 

    Add groupSortedArray() function
    @evillique
    evillique committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    f055d7b View commit details
    Browse the repository at this point in the history

  23. Fix logs space check

    @alesapin
    alesapin committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    ae3bcbb View commit details
    Browse the repository at this point in the history

  24. Merge branch 'startup-sanity-checks' of github.com:ClickHouse/ClickHo… 

    …use into startup-sanity-checks
    @alesapin
    alesapin committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    b078288 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2022

  1. Merge branch 'master' into remote_filter_for_hive

    @taiyang-li
    taiyang-li committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    c11f563 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into hdfs_config_prefix

    @taiyang-li
    taiyang-li committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    f6ccda8 View commit details
    Browse the repository at this point in the history

  3. remove ATOMIC_FLAG_INIT: depreciated in C++20 and warns in clang-14

    @justnoise
    justnoise committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    87fff8b View commit details
    Browse the repository at this point in the history

  4. clickhouse-keeper: finish session on client EOF (fixes heap-use-after… 

    …-free)

CI founds [1]:

    WARNING: ThreadSanitizer: heap-use-after-free (pid=1)
      Read of size 8 at 0x7b48001e0088 by thread T7 (mutexes: write M2588):
        ...
        1 DB::KeeperTCPHandler::runImpl()::$_0::operator()() const build_docker/../src/Server/KeeperTCPHandler.cpp:384:14 (clickhouse+0x194f974f)
        ...
        8 DB::KeeperDispatcher::setResponse() build_docker/../src/Coordination/KeeperDispatcher.cpp:222:9 (clickhouse+0x1999de82)
        9 DB::KeeperDispatcher::responseThread() build_docker/../src/Coordination/KeeperDispatcher.cpp:161:18 (clickhouse+0x1999d7a7)
        10 DB::KeeperDispatcher::initialize()::$_1::operator()() const build_docker/../src/Coordination/KeeperDispatcher.cpp:273:54 (clickhouse+0x199a55d1)

      Previous write of size 8 at 0x7b48001e0088 by thread T3:
        0 operator delete(void*, unsigned long) <null> (clickhouse+0xa0dad50)
        1 DB::KeeperTCPHandler::~KeeperTCPHandler() build_docker/../src/Server/KeeperTCPHandler.cpp:648:1 (clickhouse+0x194f8ee6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35772/38873d726d22b15d4c5a284410956927b2e2f95f/integration_tests__thread__actions__[4/4].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
    @azat
    azat committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    ff0e46c View commit details
    Browse the repository at this point in the history

  5. Merge pull request #35746 from ClickHouse/use-common-io-thread-pool 

    Use common IOThreadPool for S3 and URL
    @antonio2368
    antonio2368 committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    cdedcee View commit details
    Browse the repository at this point in the history

  6. Merge pull request #35743 from bigo-sg/remote_filter_for_hive 

    Respect remote_url_allow_hosts for hive
    @antonio2368
    antonio2368 committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    13b4fab View commit details
    Browse the repository at this point in the history

  7. Merge pull request #35727 from kssenii/fix-any-all 

    Fix any/all(subquery)
    @kssenii
    kssenii committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    0b20329 View commit details
    Browse the repository at this point in the history

  8. Merge pull request #35572 from bigo-sg/hdfs_config_prefix 

    Deduce absolute hdfs config path
    @kssenii
    kssenii committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    a711fc0 View commit details
    Browse the repository at this point in the history

  9. Merge pull request #35773 from azat/stateless-tests-artifacts 

    ci: replace directory system log tables artifacts with tsv
    @tavplubix
    tavplubix committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    5680f53 View commit details
    Browse the repository at this point in the history

  10. Merge pull request #34566 from ClickHouse/startup-sanity-checks 

    add simple sanity checks for server startup
    @alesapin
    alesapin committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    2365bbf View commit details
    Browse the repository at this point in the history

  11. Merge pull request #35774 from ClickHouse/ressurect_build_hash_v2 

    One more try to resurrect build hash
    @alesapin
    alesapin committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    8f0919d View commit details
    Browse the repository at this point in the history

  12. Added support for schema inference for hdfsCluster (#35602)

    @nikitamikhaylov
    nikitamikhaylov committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    f6bfdcc View commit details
    Browse the repository at this point in the history

  13. Merge pull request #35772 from azat/keeper-eof 

    clickhouse-keeper: correctly handle closed client connection
    @alesapin
    alesapin committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    bd2ab32 View commit details
    Browse the repository at this point in the history

  14. Revert "Added support for schema inference for hdfsCluster (#35602)" 

    This reverts commit f6bfdcc.
    @nikitamikhaylov
    nikitamikhaylov committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    5f27f69 View commit details
    Browse the repository at this point in the history

  15. Merge pull request #35802 from ClickHouse/revert-35602-schema-inferen… 

    …ce-hdfs-cluster

Revert "Added support for schema inference for `hdfsCluster`"
    @tavplubix
    tavplubix committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    f3f335d View commit details
    Browse the repository at this point in the history

  16. Fix docs

    @evillique
    evillique committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    13f464a View commit details
    Browse the repository at this point in the history

  17. Merge pull request #35804 from evillique/fix-docs 

    Fix docs
    @evillique
    evillique committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    d472235 View commit details
    Browse the repository at this point in the history

  18. Merge pull request #35785 from justnoise/remove-atomic-flag-init 

    remove ATOMIC_FLAG_INIT: depreciated in C++20 and warns in clang-14
    @antonio2368
    antonio2368 committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    1d48017 View commit details
    Browse the repository at this point in the history