Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix dateFormat partitioning in output path #236

Closed
istreeter opened this issue Nov 18, 2021 · 0 comments
Closed

Fix dateFormat partitioning in output path #236

istreeter opened this issue Nov 18, 2021 · 0 comments
Labels
bug

Comments

@istreeter
Copy link
Contributor

istreeter commented Nov 18, 2021 •
edited

The S3 loader has a configuration option to allow paritioning by date. It doesn't work in 2.0.0 and, looking at the code, I'm not convinced it worked in the 1.0.0 series either. E.g. output file gets called:

s3://mybucket/partitioned/%Y-%M-%d/com.acme_myschema/jsonschema-2-2021-11-18-1-2.gz
@istreeter istreeter added the bug label Nov 18, 2021
@istreeter istreeter changed the title Regression: fix dateFormat partitioning in 2.0.0 Fix dateFormat partitioning in 2.0.0 Nov 18, 2021
@istreeter istreeter changed the title Fix dateFormat partitioning in 2.0.0 Fix dateFormat partitioning in output path Nov 18, 2021
istreeter added a commit that referenced this issue Nov 18, 2021
@istreeter
Fix dateFormat partitioning in output path (close #236)
a346dc7
istreeter added a commit that referenced this issue Nov 18, 2021
@istreeter
Fix dateFormat partitioning in output path (close #236)
144fc88
istreeter added a commit that referenced this issue Nov 21, 2021
@istreeter
Fix dateFormat partitioning in output path (close #236)
3d7418a
istreeter added a commit that referenced this issue Nov 23, 2021
@istreeter
Fix dateFormat partitioning in output path (close #236)
6b3f780
istreeter added a commit that referenced this issue Nov 26, 2021
@istreeter
Fix dateFormat partitioning in output path (close #236)
6a1abd8
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@istreeter