php apps deploy hangs on remote: text and crashes dashboard

[devekko]

depploying a php app crashes tsuru it seems

niccolox@trusty:~/Projects/tsuru-apps/wordpress|master
⇒ git push git@tsuru1.dev.io:blog.git master
Counting objects: 1412, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (1388/1388), done.
Writing objects: 100% (1412/1412), 6.90 MiB | 3.19 MiB/s, done.
Total 1412 (delta 114), reused 0 (delta 0)
remote: text

hangs and the dashboard dies and I cant connect

devekko@tsuru1:~$ sudo service mongodb status
mongodb stop/waiting

devekko@tsuru1:~$ sudo service mongodb start
mongodb start/running, process 29393

tsuru app-info --app blog
Error: Failed to connect to tsuru server (http://156.4.198.19:8080), it's probably down.

[andrewsmedina]

Can you look at the tsurud upstart log and paste de error here? the log should be in /var/log/upstart/tsuru-server-api.log

[devekko]

mongo was working after install, dashboard loaded, could create app, its just on git push it crashed

tried a few times, rebuilt, etc... wordpress and drupal...

am wondering if its mongodb locale issues
http://stackoverflow.com/questions/19668570/mongodb-localefacet-s-create-c-locale-name-not-valid
devekko@tsuru1:~$ locale -a
C
C.UTF-8
POSIX
en_US.utf8

/var/log/upstart/tsuru-server-api.log
could not create queue instance, please check queue:mongo-url and queue:mongo-database config entries. error: no reachable servers
Opening config file: /etc/tsuru/tsuru.conf
Done reading config file: /etc/tsuru/tsuru.conf
WARNING: Setting "docker:segregate" is not necessary anymore, this is the default behavior from now on.
WARNING: Using "redis-queue:" is deprecated. Please change your tsuru.conf to use "pubsub:" options. See http://docs.tsuru.io/en/latest/reference/config.html#pubsub for more details.
Using mongodb database "tsurudb" from the server "127.0.0.1:27017".

[andrewsmedina]

Looks like that something is restarting the process. A possible reason can be that your machine is out of memory. Can you try again and see the syslog (/var/log/syslog) to check if is this problem?

[devekko]

logs are big

-rw-r----- 1 root root 2.6G Dec 10 18:31 tsuru-server-api.log
-rw-r----- 1 root root 1.5G Dec 10 10:13 tsuru-server-api.log.save

devekko@tsuru1:/var/log/upstart$ sudo grep -r 'memory'
docker.log:WARN[0002] Your kernel does not support swap memory limit.
docker.log:WARN[0000] Your kernel does not support swap memory limit.
docker.log:WARN[0006] Your kernel does not support swap memory limit.
docker.log:WARN[0003] Your kernel does not support swap memory limit.
docker.log:WARN[0001] Your kernel does not support swap memory limit.
docker.log:WARN[0003] Your kernel does not support swap memory limit.
docker.log:WARN[0001] Your kernel does not support swap memory limit.
docker.log:WARN[0008] Your kernel does not support swap memory limit.

[devekko]

trying this

https://gist.github.com/steakknife/9094991
moby/moby#4250

devekko@tsuru1:/var/log/upstart$ # enable swap resource limiting
devekko@tsuru1:/var/log/upstart$ sudo sed -i 's/(GRUB_CMDLINE_LINUX_DEFAULT=")"/\1cgroup_enable=memory swapaccount=1"/' /etc/default/grub
devekko@tsuru1:/var/log/upstart$ sudo update-grub
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-3.19.0-39-generic
Found initrd image: /boot/initrd.img-3.19.0-39-generic
Found linux image: /boot/vmlinuz-3.19.0-25-generic
Found initrd image: /boot/initrd.img-3.19.0-25-generic
Found memtest86+ image: /memtest86+.elf
Found memtest86+ image: /memtest86+.bin
done
devekko@tsuru1:/var/log/upstart$ sudo reboot

changed swappiness to 10

no joy

going to rebuild and make sure I didnt mess up the client - server config somehow

[devekko]

is it this?
moby/moby#847

the VM is 8gb ram

[devekko]

closing, not sure how I got the error

I did create the VM by cloning one with 512mb of RAM and maybe somehow it hadn't reset available RAM in Proxmox? not sure

but closed.. thanks