Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

23.3.13 Pre-release #310

Merged
merged 93 commits into from
Oct 5, 2023
Merged

23.3.13 Pre-release #310

merged 93 commits into from
Oct 5, 2023

Commits on Jun 13, 2023

  1. Make builds and tests possible in Altinity's infrastructure

    add comment and rename github robot token
    add clickhouse instance password parameter
    use Altinity's s3 bucket
    Use altinityinfra dockerhub images and minor adjustments (#135)
    Allow CI to be triggered on PR
    Proper error reporting during docker pull and lowercase version name
    allow `altinitystable` git tags
    Download specific MinIO version instead of latest - same as upstream master
    remove stale chmod
    More stable CI/CD builds:
    - Rebuilding all docker images
    - Reduced number of docker images
    - Rerunning functional tests even if those were already executed in previous run
    Added missing dependencies for stateful tests
    Re-generating _pb2 files on each test run
    Changed hardcoded docker images name prefixes from `clickhouse/` to `altinityinfra/`
    Pushing images as :latest too to avoid some test failures
    reverted back to use clickhouse/jdbc-bridge
    Fixed how version is generated: taking into account VERSION_TWEAK and VERSION_FLAVOUR
    Pushing checks events data to "gh-data" instead of "default"
    Using secrets for managing AWS access
    Fixed tag checking code to allow altinitystable version suffix
    Bumped Go version to get some CVE fixes
    Do not install clickhouse-diagnostics due to numerous CVEs in go runtime
    Removed unneeded docker images from list: codebrowser, sqlancer-test, keeper-jespen, keeper-jepsen-test, testflows-runner, fuzzer
    Using ccache instead of sccache
    Fixed ClickHouseVersion.get_version_from_string for some cases, fixed getting version flavour
    Enmk committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    0048545 View commit details
    Browse the repository at this point in the history
  2. Fixed getting github token

    Enmk committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    91115cc View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. Merge pull request ClickHouse#48838 from amosbird/issue_48735

    Fix key condition on duplicate primary keys
    robot-clickhouse-ci-1 authored and Enmk committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    e112350 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2023

  1. Merge pull request ClickHouse#48299 from CurtizJ/do-not-build-unneces…

    …sary-sets
    
    Do not build sets for skip indexes if they are not used
    robot-clickhouse-ci-1 authored and Enmk committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    b9988bb View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. Configuration menu
    Copy the full SHA
    75d27bb View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2023

  1. Merge pull request #277 from Altinity/23.3_fix_DockerServerImages

    23.3 Fix of DockerServerImages
    Enmk committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    2428d8f View commit details
    Browse the repository at this point in the history
  2. Merge pull request #276 from Altinity/backports/23.3.3/48299_do_not_b…

    …uild_skip_indices_if_not_used
    
    23.3 backport of ClickHouse#48299 Do not build skip indices if not used
    Enmk committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    66f4a1e View commit details
    Browse the repository at this point in the history
  3. Merge pull request #275 from Altinity/backports/23.3.3/48838_fix_key_…

    …condition_crash
    
    23.3 backport of ClickHouse#48838 Fix crash with key condition on duplicate primary keys
    Enmk committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    4693c0a View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. Merge pull request #269 from Altinity/22.8.15_source_upload

    Uploading src tgz and regression improvements
    MyroTk authored and Enmk committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    783f68e View commit details
    Browse the repository at this point in the history
  2. Merge pull request #266 from Altinity/22.8.15_sha256

    SignRelease cherrypick
    MyroTk authored and Enmk committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    9a1a5ef View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2023

  1. Merge pull request #279 from Altinity/23.3_source_upload

    23.3 port of #269 source upload
    Enmk committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    a20ff50 View commit details
    Browse the repository at this point in the history
  2. Fixed SignRelease script and re-arranged jobs a little

    Changed order of jobs to make SignRelease start earlier than tests, and tests start after SignRelease
    Enmk committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    1369ff0 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2023

  1. Merge pull request #280 from Altinity/23.3_sign_binaries

    23.3 Port of #266 Signing binaries
    Enmk committed Jun 24, 2023
    Configuration menu
    Copy the full SHA
    a1972b6 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. Merge remote-tracking branch 'altinity/customizations/23.3.3' into cu…

    …stomizations/23.3.5
    Enmk committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    14d071b View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2023

  1. Merge remote-tracking branch 'altinity/customizations/23.3.5' into cu…

    …stomizations/23.3.8
    Enmk committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    03a6d8e View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2023

  1. Update release_branches.yml

    MyroTk committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    83b4f02 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2023

  1. Update release_branches.yml

    MyroTk committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    0ae7b4b View commit details
    Browse the repository at this point in the history
  2. Update release_branches.yml

    MyroTk committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    b14c2d9 View commit details
    Browse the repository at this point in the history
  3. Update release_branches.yml

    MyroTk committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    4022cc7 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2023

  1. Update release_branches.yml

    MyroTk committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    31023f1 View commit details
    Browse the repository at this point in the history
  2. Update release_branches.yml

    MyroTk committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    dc7ec6e View commit details
    Browse the repository at this point in the history
  3. Update release_branches.yml

    MyroTk committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    0f5dacc View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2023

  1. Update release_branches.yml

    MyroTk committed Aug 11, 2023
    Configuration menu
    Copy the full SHA
    64d21cd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3658f96 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2023

  1. fix dns tests

    arthurpassos committed Aug 12, 2023
    Configuration menu
    Copy the full SHA
    952b3e0 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2023

  1. Configuration menu
    Copy the full SHA
    b0d1e48 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2023

  1. Merge pull request #296 from Altinity/backports/23.3.8/53286_dns_test…

    …s_coredns_version
    
    23.3 Backport of ClickHouse#53286 - Bring back **garbage** dns tests
    Enmk committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    7ed789a View commit details
    Browse the repository at this point in the history
  2. trigger ci

    arthurpassos committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    6acb6d4 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    11ee3e2 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    3e753df View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    f25375f View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    95d07ab View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    3f4f9b3 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    f10f391 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    6928b8f View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    a256f86 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    a028d58 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    68f320c View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    9cae0c9 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2023

  1. Merge pull request #295 from Altinity/backports/23.3.8/52634_init_and…

    …_destroy_ares_channel_on_demand
    
    23.3 Backport of ClickHouse#52634 - init and destroy ares channel on demand.
    Enmk committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    fe3d80a View commit details
    Browse the repository at this point in the history
  2. retrigger

    MyroTk committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    d3fbe03 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2023

  1. Update release_branches.yml

    MyroTk committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    ec1c343 View commit details
    Browse the repository at this point in the history
  2. Update release_branches.yml

    MyroTk committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    e5f6490 View commit details
    Browse the repository at this point in the history
  3. Update release_branches.yml

    MyroTk committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    6215331 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. Update release_branches.yml

    MyroTk committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    2e2d3ac View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Update release_branches.yml

    MyroTk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    fe5d41b View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. Update ci-runner.py

    MyroTk committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    98d7e84 View commit details
    Browse the repository at this point in the history
  2. Update release_branches.yml

    MyroTk committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    d02b46d View commit details
    Browse the repository at this point in the history
  3. Update release_branches.yml

    MyroTk committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    839e58c View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. Update release_branches.yml

    MyroTk committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    763e036 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. Update release_branches.yml

    MyroTk committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    440ce15 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. Update release_branches.yml

    MyroTk committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    70ebe6b View commit details
    Browse the repository at this point in the history
  2. Create action.yml

    MyroTk committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    9fdcc64 View commit details
    Browse the repository at this point in the history
  3. Add files via upload

    MyroTk committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    041f53c View commit details
    Browse the repository at this point in the history
  4. Update release_branches.yml

    MyroTk committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    310010c View commit details
    Browse the repository at this point in the history
  5. Update action.yml

    MyroTk committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    ddd7d06 View commit details
    Browse the repository at this point in the history
  6. chmod

    MyroTk committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    646f455 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. Update release_branches.yml

    MyroTk committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    dbf7641 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Update release_branches.yml

    MyroTk committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    435b6b8 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. Merge pull request #300 from Altinity/backports/23.3.8/47640_row_poli…

    …cy_for_database
    
    23.3 Backport of ClickHouse#47640 - Row policy for database
    Enmk committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    17182bf View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Configuration menu
    Copy the full SHA
    851c02c View commit details
    Browse the repository at this point in the history
  2. fix

    arthurpassos committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    ae9d044 View commit details
    Browse the repository at this point in the history
  3. docs

    arthurpassos committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    d8c47fb View commit details
    Browse the repository at this point in the history
  4. add test

    arthurpassos committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    af0392a View commit details
    Browse the repository at this point in the history
  5. remove useless comments

    arthurpassos committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    9852102 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    47b1407 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. Update release_branches.yml

    MyroTk committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    db84892 View commit details
    Browse the repository at this point in the history
  2. Update release_branches.yml

    MyroTk committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    a62986b View commit details
    Browse the repository at this point in the history
  3. Update release_branches.yml

    MyroTk committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    020542a View commit details
    Browse the repository at this point in the history
  4. Update release_branches.yml

    MyroTk committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    82bc8ca View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    5324f79 View commit details
    Browse the repository at this point in the history
  6. Update release_branches.yml

    MyroTk committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    7d9f75b View commit details
    Browse the repository at this point in the history
  7. Update release_branches.yml

    MyroTk committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    6dc7df3 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Merge pull request ClickHouse#51368 from ClickHouse/disable-compile-e…

    …xpressions
    
    Disable "compile_expressions" setting by default
    nikitamikhaylov authored and Enmk committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    f9393da View commit details
    Browse the repository at this point in the history
  2. Fix excessive memory usage for FINAL (due to too much streams usage) (C…

    …lickHouse#50429)
    
    Previously it could create MergeTreeInOrder for each mark, however this
    could be very suboptimal, due to each MergeTreeInOrder has some memory
    overhead.
    
    Now, by collapsing all marks for one part together it is more memory
    effiecient.
    
    I've tried the query from the altinity wiki [1] and it decreases memory
    usage twice:
    
        SELECT * FROM repl_tbl FINAL WHERE key IN (SELECT toUInt32(number) FROM numbers(1000000) WHERE number % 50000 = 0) FORMAT Null
    
    - upstream: MemoryTracker: Peak memory usage (for query): 520.27 MiB.
    - patched:  MemoryTracker: Peak memory usage (for query): 260.95 MiB.
    
      [1]: https://kb.altinity.com/engines/mergetree-table-engine-family/replacingmergetree/#multiple-keys
    
    And it could be not 2x and even more or less, it depends on the gaps in
    marks for reading (for example in my setup the memory usage increased a
    lot, from ~16GiB of RAM to >64GiB due to lots of marks and gaps).
    
    Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
    azat authored and Enmk committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    a5c9dc5 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. Merge pull request #306 from Altinity/backports/23.3.8/51368_disable_…

    …compile_expressions
    
    23.3 Backport of ClickHouse#51368 - Disable "compile_expressions" setting by default
    Enmk committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    f105dc0 View commit details
    Browse the repository at this point in the history
  2. Fixes required for tests to work on Hetzner Cloud

    other IPv6 addr, explicit 8.8.8.8 dns
    
    (cherry-picked a028c29)
    ilejn authored and Enmk committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    6a7e191 View commit details
    Browse the repository at this point in the history
  3. Merge pull request #303 from Altinity/backports/23.3.8/54370_fix_parq…

    …uet_array_inconsistent_offsets
    
    23.3 Backport of ClickHouse#54370 - fix parquet array inconsistent offsets
    Enmk committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    f47dddd View commit details
    Browse the repository at this point in the history
  4. Merge pull request #307 from Altinity/backports/23.3.8/50429_fix-fina…

    …l-memory-usage
    
    23.3 Backport of ClickHouse#50429 - Fix excessive memory usage for FINAL (due to too much streams usage)
    Enmk committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    c709951 View commit details
    Browse the repository at this point in the history
  5. Merge pull request #294 from Altinity/runner-labels

    Updating labels for on-demand runners
    MyroTk committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    d24ca35 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. Merge remote-tracking branch 'altinity/customizations/23.3.8' into cu…

    …stomizations/23.3.13
    Enmk committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    a3b7bbb View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. Attempt to fix build issues

    Enmk committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    8ca3201 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2023

  1. ARM Changes

    MyroTk committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    568e9e2 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Configuration menu
    Copy the full SHA
    6dab14b View commit details
    Browse the repository at this point in the history
  2. Merge pull request #312 from Altinity/23.3.13_fix_02780_final_streams…

    …_data_skipping_index
    
    Fixed tests for queries/0_stateless/02780_final_streams_data_skipping…
    Enmk committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    c123aef View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2023

  1. Update release_branches.yml

    MyroTk committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    7c21f60 View commit details
    Browse the repository at this point in the history
  2. Cherry-picked merge-commit of ClickHouse#54934

    Fix FINAL produces invalid read ranges in a rare case
    nickitat authored and Enmk committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    0101001 View commit details
    Browse the repository at this point in the history
  3. Merge pull request #313 from Altinity/backports/23.3/54934_fix_final_…

    …invalid_read_ranges
    
    Backport of ClickHouse#54934 Fix `FINAL` produces invalid read ranges in a rare case
    Enmk committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    fcba523 View commit details
    Browse the repository at this point in the history
  4. Update release_branches.yml

    MyroTk committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    59ebba1 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Update release_branches.yml

    MyroTk committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    7f7fc8d View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Merge pull request #311 from Altinity/23.3.13_arm

    23.3.13 ARM
    MyroTk committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    2391eb0 View commit details
    Browse the repository at this point in the history
  2. Merge pull request ClickHouse#49660 from CurtizJ/fix-sparse-columns-r…

    …eload
    
    Fix reading from sparse columns after restart
    alexey-milovidov authored and Enmk committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    0eff70f View commit details
    Browse the repository at this point in the history
  3. Merge pull request #314 from Altinity/backports/23.3/49660_fix-sparse…

    …-columns-reload
    
    23.3 Backport of ClickHouse#49660 - fix sparse columns reload
    Enmk committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    bac54d0 View commit details
    Browse the repository at this point in the history