2.5.8

v2.5.8

IMPROVEMENTS

• added OCI compliant labels to containers, thanks @denisok
• increased default clickhouse queries timeout from 5m to 30m for allow freeze very large tables with object disks

BUG FIXES

• fix corner cases for ResumeOperationsAfterRestart and keep_backup_local: -1 behavior
• fix wrong file extension recognition during download for access and configs , fix #921

2.5.7

v2.5.7

BUG FIXES

• wrong skip tables by engine when empty variables value CLICKHOUSE_SKIP_TABLE_ENGINES=engine, instead of CLICKHOUSE_SKIP_TABLE_ENGINES=engine fix 915
• restore stop works, if RBAC objects present in backup but user which used for connect to clickhouse don't have RBAC GRANTS or access_management, 2.5.0+ affected, fix 914

2.5.6

v2.5.6

BUG FIXES

• skip ValidateObjectDiskConfig for --diff-from-remote when object disk doesn't contains data fix 910

2.5.5

v2.5.5

IMPROVEMENTS

• added object_disk_server_side_copy_concurrency with default value 32, to avoid slow create or restore backup process which was restricted by upload_concurrency or download_concurrency options, fix 903

BUG FIXES

• fixed create --rbac behavior when /var/lib/clickhouse/access not exists but present only replicated system.user_directories, fix 904

2.5.4

v2.5.4

IMPROVEMENTS

• add info logging for uploadObjectDiskParts and downloadObjectDiskParts operation

2.5.3

v2.5.3

BUG FIXES

• fixed Unknown setting base_backup for use_embedded_backup_restore: true and create --diff-from-remote, affected 2.5.0+ versions, fix 735

2.5.2

v2.5.2

BUG FIXES

• fixed issue after 865 we can't use create_remote --diff-from-remote for remote_storage: custom, affected versions 2.5.0, 2.5.1, fix 900

2.5.1

v2.5.1

BUG FIXES

• fixed issue when set both AWS_ROLE_ARN and S3_ASSUME_ROLE_ARN then S3_ASSUME_ROLE_ARN shall have more priority than AWS_ROLE_ARN fix 898

2.5.0

v2.5.0

IMPROVEMENTS

• complete removed support for legacy backups, created with version prior v1.0
• removed disable_progress_bar config option and related progress bar code
• added --delete-source parameter for upload and create_remote commands to explicitly delete local backup during upload, fix 777
• added support for --env ENV_NAME=value cli parameter for allow dynamically override any config parameter, fix 821
• added support for use_embedded_backup_restore: true with empty embedded_backup_disk value, tested on S3/GCS over S3/AzureBlobStorage, fix 695
• --rbac, --rbac-only, --configs, --configs-only now works with use_embedded_backup_restore: true
  -- --data for restore with use_embedded_backup_restore: true will use allow_non_empty_tables=true to allow fix 756
• added --diff-from-remote parameter for create command, will copy only new data parts object disk data, also allows to download properly object disk data from required backup during restore, fix 865
• added support of native Clickhouse incremental backup for use_embedded_backup_restore: true fix 735
• added GCS_CHUNK_SIZE config parameter, try to speedup GCS upload fix 874, thanks @dermasmid
• added --remote-backup cli parameter to tables command and GET /backup/table, fix 778
• added rbac_always_backup: true option to default config, will create backup for RBAC objects automatically, restore still require --rbac to avoid destructive actions, fix 793
• added rbac_conflict_resolution: recreate option for RBAC object name conflicts during restore, fix 851
• added upload_max_bytes_per_seconds and download_max_bytes_per_seconds config options to allow throttling without CAP_SYS_NICE, fix 817
• added clickhouse_backup_in_progress_commands metric, fix 836
• switched to golang 1.22
• updated all third-party SDK to latest versions
• added clickhouse/clickhouse-server:24.3 to CI/CD

BUG FIXES

• continue S3_MAX_PARTS_COUNT default value from 2000 to 4000 to continue decrease memory usage for S3
• changed minimal part size for multipart upload in CopyObject from 5Mb to 10Mb
• restore SQL UDF functions after restore tables
• execute ALTER TABLE ... DROP PARTITION instead of DROP TABLE for restore and restore_remote with parameters --data --partitions=..., fix 756
• fix wrong behavior for freeze_by_part + freeze_by_part_where, fix 855
• apply CLICKHOUSE_SKIP_TABLES_ENGINES during create command
• fixed behavior for upload / download when .inner. table missing for MATERIALIZED VIEW by table pattern, fix 765
• fixed ObjectDisks + CLICKHOUSE_USE_EMBEDDED_BACKUP_RESTORE: true - shall skip upload object disk content, fix 799
• fixed connection to clickhouse-server behavior when long clickhouse-server startup time and docker-entrypoint.d processing, will infinite reconnect each 5 seconds, until success, fix 857
• fixed USE_EMBEDDED_BACKUP_RESTORE=true behavior to allow use backup disk with type local, fix 882
• fixed wrong list command behavior, it shall scann all system.disks path not only default disk to find pratially created backups, fix 873
• fixed create --rbac behavior, don't create access folder if no RBAC objects is present
• fixed behavior when system.disks contains disk which not present in any storage_policies, fix 845

2.4.35

v2.4.35

IMPROVEMENTS

• set part size for s3:CopyObject minimum 128Mb, look details https://repost.aws/questions/QUtW2_XaALTK63wv9XLSywiQ/s3-sync-command-is-slow-to-start-on-some-data