Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

EmrEtlRunner: do not pass --skip shred to RDB Loader when skipping RDB Shredder #3403

Closed
chuwy opened this issue Aug 21, 2017 · 1 comment
Closed

EmrEtlRunner: do not pass --skip shred to RDB Loader when skipping RDB Shredder #3403

chuwy opened this issue Aug 21, 2017 · 1 comment
Assignees
@BenFradet
Milestone
R92 [BAT] Maiden ...

Comments

@chuwy
Copy link
Contributor

chuwy commented Aug 21, 2017

Otherwise recovery job will skip all shredded data.
@chuwy chuwy added this to the R92 [BAT] Maiden Castle milestone Aug 21, 2017
@alexanderdean alexanderdean changed the title EmrEtlRunner: do not pass --skip shred to RDB Loader EmrEtlRunner: do not pass --skip shred to RDB Loader when skipping Spark Shred Aug 21, 2017
BenFradet added a commit that referenced this issue Aug 21, 2017
@BenFradet
EmrEtlRunner: do not pass --skip shred to RDB Loader when skipping Sp…
34e4ef9 
…ark Shred (closes #3403)
@BenFradet BenFradet changed the title EmrEtlRunner: do not pass --skip shred to RDB Loader when skipping Spark Shred EmrEtlRunner: do not pass --skip shred to RDB Loader when skipping RDB Shredder Aug 21, 2017
BenFradet added a commit that referenced this issue Aug 21, 2017
@BenFradet
EmrEtlRunner: do not pass --skip shred to RDB Loader when skipping RD…
0a11a21 
…B Shredder (closes #3403)
@alexanderdean
Copy link
Member

If you think this has affected you, please read:

https://discourse.snowplowanalytics.com/t/important-alert-r90-r91-bug-may-result-in-shredded-types-not-loading-into-redshift-after-recovery/1422

peel pushed a commit to snowplow/emr-etl-runner that referenced this issue May 26, 2020
@BenFradet
Do not pass --skip shred to RDB Loader when skipping RDB Shredder (cl…
73a7839 
…oses snowplow/snowplow#3403)
peel pushed a commit to snowplow/emr-etl-runner that referenced this issue May 28, 2020
@BenFradet
Do not pass --skip shred to RDB Loader when skipping RDB Shredder (cl…
a6a3cb7 
…oses snowplow/snowplow#3403)
peel pushed a commit to snowplow/emr-etl-runner that referenced this issue May 28, 2020
@BenFradet
Do not pass --skip shred to RDB Loader when skipping RDB Shredder (cl…
c30fdb7 
…oses snowplow/snowplow#3403)
peel pushed a commit to snowplow/emr-etl-runner that referenced this issue May 28, 2020
@BenFradet
Do not pass --skip shred to RDB Loader when skipping RDB Shredder (close
55d34f3 
 snowplow/snowplow#3403)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@BenFradet BenFradet

Labels
None yet
Projects
None yet
Milestone
R92 [BAT] Maiden Castle
Development

No branches or pull requests
3 participants
@alexanderdean @chuwy @BenFradet