Skip to content

Refactor postgresql-tuned Benchmark: Optimize Data Insertion with Column Padding Alignment#310

Merged
rschu1ze merged 9 commits intoClickHouse:mainfrom
somratdutta:patch-2
Feb 26, 2025
Merged

Refactor postgresql-tuned Benchmark: Optimize Data Insertion with Column Padding Alignment#310
rschu1ze merged 9 commits intoClickHouse:mainfrom
somratdutta:patch-2

Conversation

@somratdutta
Copy link
Copy Markdown
Contributor

@somratdutta somratdutta commented Feb 25, 2025

Overview

This PR refactors the PostgreSQL benchmark to enhance performance by implementing column padding alignment during the data insertion process.

Resolves #234

Changes

  • Optimized create.sql:
    The create.sql file has been optimized using column padding alignment to improve table structure and ensure better data insertion performance.
  • Updated COPY Command in benchmark.sh:
    The COPY command in benchmark.sh now explicitly maps columns from the dataset to ensure proper alignment during data insertion.

Performance Improvement

Before Padding Alignment

real        8m21.641s
user        0m13.737s
sys        1m36.977s

After Padding Alighnment

real        6m52.399s
user        0m14.043s
sys        1m41.489s

Host Environment

Ubuntu 24.04 LTS
16vCPU
32GiB RAM
500GiB Disk

The percentage improvement from 8m21.641s to 6m52.399s is approximately 17.79% on our system.

@somratdutta somratdutta changed the title Refactor postgresql-tuned benchmark : Implement Column Padding Alignment for Improved Data Insertion Performance Refactor postgresql-tuned Benchmark: Optimize Data Insertion with Column Padding Alignment Feb 25, 2025
@rschu1ze
Copy link
Copy Markdown
Member

@somratdutta Thanks, I re-ran "postgresql-tuned" in the appropriate VM and updated the result file.

@rschu1ze rschu1ze merged commit be3b58a into ClickHouse:main Feb 26, 2025
@rschu1ze rschu1ze self-assigned this Mar 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Postgres-Tuned should tune alignment padding

2 participants