Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EmrEtlRunner: retrieve correct latest run id when using s3a #3871

Closed
BenFradet opened this issue Aug 17, 2018 · 0 comments
Closed

EmrEtlRunner: retrieve correct latest run id when using s3a #3871

BenFradet opened this issue Aug 17, 2018 · 0 comments
Assignees

Comments

@BenFradet
Copy link
Contributor

Prior to using s3a, the enriched good and shredded good buckets were containing only one real folder (plus empty files) so the logic was to retrieve the only folder.

Using s3a, there are no empty files but there can be empty folders so the previous logic is broken.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant