ELB & updating Metabase => deadlock #6264
Labels
Operation/Elastic Beanstalk
.Performance
Priority:P1
Security holes w/o exploit, crashing, setup/upgrade, login, broken common features, correctness
Type:Bug
Product defects
Hey all,
I'll start right away with the details to contextualize:
Your browser and the version:
Chromium Version 61.0.3158.0 (Developer Build) (64-bit)
(but also happens with other browsers)Your operating system:
MacOS X 10.12.6
Your databases:
mongoDB
hosted on Mongo AtlasMetabase version:
0.25.2
Metabase hosting environment: EC2 Server on AWS (via ELB) (machine: t2.small) (os:
64bit Amazon Linux 2017.03 v2.6.0 running Docker 1.12.6
)Metabase internal database:
postgres
Basically, with the configuration above, we were mostly "fine", from time to time Metabase would slow down but overall it was working. We decided to try upgrading both Metabase and the os, from:
Metabase
0.25.2
->0.26.2
os:
64bit Amazon Linux 2017.03 v2.6.0 running Docker 1.12.6
->64bit Amazon Linux 2017.03 v2.7.4 running Docker 17.03.2-ce
But once those two were done, our instance basically deadlocked in less than an hour. Only way to put if back up online was to restart the instance; since it kept happening we had to rollback.
We first rolled back the os version to
64bit Amazon Linux 2017.03 v2.6.0 running Docker 1.12.6
, which "slowed down" the degradation of performances (= no deadlocks in 1h) but the ELB instance keeps going to health state "warning".It looks like it's performance degradation is a recurring issue ( #6209 #6071 #5607 #5106), but none of these other issues have any hints on how to fix aside from rolling back - I've opened this new issue to give more details about my specific situation & because it's kinda hard for me to tell if the causes are the same (and hopefully @attekei @camsaul @salsakran can help me out to pinpoint the issue/ suggest a fix).
The text was updated successfully, but these errors were encountered: