Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Common: add NAT Gateway fix script #85

Closed
chuwy opened this issue Jan 29, 2018 · 3 comments
Closed

Common: add NAT Gateway fix script #85

chuwy opened this issue Jan 29, 2018 · 3 comments
Assignees

Comments

@chuwy
Copy link
Contributor

chuwy commented Jan 29, 2018

A long-standing issue when RDB Loader behind NAT Gateway failed each time after 2 hours with Connection reset by peer message was fixed by following script:

#!/bin/sh

sudo /sbin/sysctl -w net.ipv4.tcp_keepalive_time=200 net.ipv4.tcp_keepalive_intvl=200 net.ipv4.tcp_keepalive_probes=5

This should live probably in this repository as issue appeared only for RDB Loader. Or snowplow/snowplow along with snowplow-ami4-bootstrap-0.2.0.sh, @alexanderdean?

@chuwy chuwy self-assigned this Jan 29, 2018
@alexanderdean
Copy link
Member

Let's go for the second option - in snowplow/snowplow, as this is only a problem when running RDB Loader from EMR.

I don't know if this should go alongside snowplow-ami4-bootstrap-0.2.0.sh, or if we should create a snowplow-ami5-bootstrap-0.3.0.sh and include this in it...

@chuwy
Copy link
Contributor Author

chuwy commented Jan 30, 2018

in snowplow/snowplow, as this is only a problem when running RDB Loader from EMR

Not sure what connection between snowplow/snowplow and EMR was assumed, but moving this ticket there snowplow/snowplow#3601

@chuwy chuwy closed this as completed Jan 30, 2018
@alexanderdean
Copy link
Member

Not sure what connection between snowplow/snowplow and EMR was assumed

The code that hosts the operation of Snowplow apps on EMR is all in EmrEtlRunner, in snowplow/snowplow...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants