David Too Popular (or DDoS) ?

[nelsonic]

Morning @alanshaw hope you are feeling great today!

Really ❤️ David!
The site/service is great and we recommend it to everyone,
but get super sad when the badge goes blank on a repo if its down... 😢

Is David behind CloudFlare? Or can we help with anything...? http://www.isup.me/david-dm.org

Would love to help if there are any tasks you can offload.

[alanshaw]

There's an issue that occurs when the site runs out of memory. It causes 100% CPU to be used and causes all traffic to be dropped.

The downtime you noticed was because this happened on the AWS vm. The vm became completely unresponsive (even after power cycles) and I eventually decided to move to a less flakey host. We then had to wait for the TTL on the DNS to expire.

If you can help with the memory issue that would be amazing. David stores all data in memory and should probably be using a DB or something.

[kingcody]

@alanshaw something like mongodb?

[nelsonic]

@kingcody mongodb is one option.
I would recommend using a mini Node+Redis cluster on DigitalOcean fronted by nginx & CloudFlare.

@alanshaw where did you move the site to from AWS?

[silverwind]

Is the site having issues currently? curl -v https://david-dm.org gives me

< HTTP/1.1 504 Gateway Time-out
< Server: nginx/1.4.6 (Ubuntu)
< Date: Tue, 08 Sep 2015 14:21:15 GMT
< Content-Type: text/html
< Content-Length: 191
< Connection: keep-alive

[alanshaw]

I have no idea what the problem is here, but yes something is up.

[alanshaw]

Upgrade to iojs 3.3 and a reboot seems to have fixed it. Apologies to all inconvenienced.

[silverwind]

Ah, you probably ran into the memory leak that was there in io.js 3.0 til 3.2 :)