Skip to content

[Bug](parquet) fix parquet write setting property is not effective#12912

Merged
morningman merged 1 commit intoapache:masterfrom
zhangstar333:fix_parquet_file
Oct 4, 2022
Merged

[Bug](parquet) fix parquet write setting property is not effective#12912
morningman merged 1 commit intoapache:masterfrom
zhangstar333:fix_parquet_file

Conversation

@zhangstar333
Copy link
Copy Markdown
Contributor

Proposed changes

outfile export as parquet format, and have set "max_file_size"="128MB"
But finally write all data into one file not as CSV split file

Snipaste_2022-09-23_16-33-59

## Problem summary

Describe your changes.

Checklist(Required)

  1. Does it affect the original behavior:
    • Yes
    • No
    • I don't know
  2. Has unit tests been added:
    • Yes
    • No
    • No Need
  3. Has document been added or modified:
    • Yes
    • No
    • No Need
  4. Does it need to update dependencies:
    • Yes
    • No
  5. Are there any changes that cannot be rolled back:
    • Yes (If Yes, please explain WHY)
    • No

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner area/vectorization labels Sep 23, 2022
@zhangstar333 zhangstar333 force-pushed the fix_parquet_file branch 4 times, most recently from 31224f6 to 6a69758 Compare September 29, 2022 03:15
Copy link
Copy Markdown
Contributor

@BiteTheDDDDt BiteTheDDDDt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Sep 30, 2022
@github-actions
Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@morningman morningman merged commit 3f47f67 into apache:master Oct 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. area/planner Issues or PRs related to the query planner area/vectorization dev/merged-1.1.4 reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants