Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NodeJS process crash in MAA #37

Closed
ignoramous opened this issue Dec 24, 2021 · 5 comments
Closed

NodeJS process crash in MAA #37

ignoramous opened this issue Dec 24, 2021 · 5 comments
Labels
invalid This doesn't seem right

Comments

@ignoramous
Copy link
Contributor

2021-12-24T05:22:18.469 app[a6e3f003] maa [info] Main child exited with signal (with signal 'SIGINT', core dumped? false)
2021-12-24T05:22:18.470 app[a6e3f003] maa [info] Starting clean up.
2021-12-24T05:22:18.482 proxy[a6e3f003] maa [error] error.code=2000 error.message="problem connecting to app instance" 
2021-12-24T05:22:19.311 proxy[a6e3f003] maa [error] error.code=2 error.message="Internal problem" 
2021-12-24T05:22:20.222 proxy[a6e3f003] maa [error] error.code=2 error.message="Internal problem" 
2021-12-24T05:22:20.247 proxy[a6e3f003] maa [error] error.code=2 error.message="Internal problem"

Nothing more.

@amithm7
Copy link
Contributor

amithm7 commented Dec 24, 2021

This is not a crash, this is old instance shutting down. Happened during today's deployment 8 hours ago.

@amithm7 amithm7 added the invalid This doesn't seem right label Dec 24, 2021
@amithm7
Copy link
Contributor

amithm7 commented Dec 24, 2021

Maybe strategy bluegreen or rolling should be used during deployment ?

I have found strategy bluegreen to be most stable during testing, but that also doubles instance count during deployment.

@ignoramous
Copy link
Contributor Author

Yeah: Either a bluegreen or a canary deploy strat sounds okay to me. It looks like there may not be enough resources on shared-cpu instances to support bluegreen though.

@amithm7
Copy link
Contributor

amithm7 commented Dec 24, 2021

It looks like there may not be enough resources on shared-cpu instances to support bluegreen though.

It is a completely new instance (possibly at a new region). So, with bluegreen instances double temporarily and old ones shutdown together.

Currently, with default, only one instance is brought up and stabilized. All others are shutdown together. In observation, I couldn't connect to the app for about 30 - 60 seconds.

@ignoramous
Copy link
Contributor Author

Okay, let's switch to bluegreen, even if it is more ambitious than a canary. Hopefully our testing in dev environment eliminates cause of such ambitious deployment strat.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
invalid This doesn't seem right
Projects
None yet
Development

No branches or pull requests

2 participants