Skip to content

[enhancement](jdbc catalog) support postgresql partition table#23744

Merged
dataroaring merged 1 commit intoapache:masterfrom
zy-kkk:pg_partition_table
Sep 3, 2023
Merged

[enhancement](jdbc catalog) support postgresql partition table#23744
dataroaring merged 1 commit intoapache:masterfrom
zy-kkk:pg_partition_table

Conversation

@zy-kkk
Copy link
Copy Markdown
Member

@zy-kkk zy-kkk commented Sep 1, 2023

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@zy-kkk zy-kkk changed the title [enhancement](jdbc catalog ) support postgresql partition table [enhancement](jdbc catalog) support postgresql partition table Sep 1, 2023
@zy-kkk
Copy link
Copy Markdown
Member Author

zy-kkk commented Sep 1, 2023

run buildall

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 1, 2023

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.36 seconds
stream load tsv: 554 seconds loaded 74807831229 Bytes, about 128 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17162184365 Bytes

@zy-kkk
Copy link
Copy Markdown
Member Author

zy-kkk commented Sep 1, 2023

run p0

@zy-kkk zy-kkk force-pushed the pg_partition_table branch from 4840f9b to 9b5b58f Compare September 1, 2023 11:20
@zy-kkk
Copy link
Copy Markdown
Member Author

zy-kkk commented Sep 1, 2023

run buildall

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 1, 2023

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.5 seconds
stream load tsv: 535 seconds loaded 74807831229 Bytes, about 133 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17162353585 Bytes

dataroaring
dataroaring approved these changes Sep 2, 2023
View reviewed changes
Copy link
Copy Markdown
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Sep 2, 2023

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Sep 2, 2023
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Sep 2, 2023

PR approved by anyone and no changes requested.

yujun777
yujun777 approved these changes Sep 3, 2023
View reviewed changes
Copy link
Copy Markdown
Contributor

@yujun777 yujun777 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

wm1581066
wm1581066 approved these changes Sep 3, 2023
View reviewed changes
Copy link
Copy Markdown

@wm1581066 wm1581066 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

morningman
morningman approved these changes Sep 3, 2023
View reviewed changes
Copy link
Copy Markdown
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@dataroaring dataroaring merged commit a664bc5 into apache:master Sep 3, 2023
xiaokang pushed a commit that referenced this pull request Sep 5, 2023
@zy-kkk @xiaokang
[enhancement](jdbc catalog ) support postgresql partition table (#23744)
458b48e
@zy-kkk zy-kkk deleted the pg_partition_table branch October 11, 2023 07:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morningman morningman morningman approved these changes

@dataroaring dataroaring dataroaring approved these changes

+2 more reviewers

@yujun777 yujun777 yujun777 approved these changes

@wm1581066 wm1581066 wm1581066 approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.2-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@zy-kkk @hello-stephen @morningman @yujun777 @wm1581066 @dataroaring @xiaokang