Reboot inception VM; /var/vcap/store/systems/production/manifest.yml disappears

[lvnilesh]

vcap@ip-10-245-24-211:~$ sudo reboot

Broadcast message from vcap@ip-10-245-24-211
    (/dev/pts/0) at 20:23 ...

The system is going down for reboot NOW!
vcap@ip-10-245-24-211:~$ Connection to ec2-50-112-212-230.us-west-2.compute.amazonaws.com closed by remote host.
Connection to ec2-50-112-212-230.us-west-2.compute.amazonaws.com closed.
➜   bosh-bootstrap ssh
Linux ip-10-245-24-211 2.6.32-344-ec2 #46-Ubuntu SMP Wed Mar 7 13:47:05 UTC 2012 x86_64 GNU/Linux
Ubuntu 10.04.4 LTS

Welcome to Ubuntu!
 * Documentation:  https://help.ubuntu.com/

  System information as of Sun Apr  7 20:48:51 UTC 2013

  System load:  0.0               Processes:           61
  Usage of /:   12.8% of 7.87GB   Users logged in:     0
  Memory usage: 1%                IP address for eth0: 10.245.24.211
  Swap usage:   0%

  Graph this data and manage this system at https://landscape.canonical.com/
---------------------------------------------------------------------
At the moment, only the core of the system is installed. To tune the
system to your needs, you can choose to install one or more
predefined collections of software by running the following
command:

   sudo tasksel --section server
---------------------------------------------------------------------

New release 'precise' available.
Run 'do-release-upgrade' to upgrade to it.

A newer build of the Ubuntu lucid server image is available.
It is named 'release' and has build serial '20130124'.
Get cloud support with Ubuntu Advantage Cloud Guest
  http://www.ubuntu.com/business/services/cloud
Last login: Sun Apr  7 19:52:53 2013 from c-71-231-122-3.hsd1.wa.comcast.net
vcap@ip-10-245-24-211:~$ bosh cf deploy
/usr/local/lib/ruby/1.9.1/fileutils.rb:247:in `mkdir': File exists - /home/vcap/.bosh_cache (Errno::EEXIST)
    from /usr/local/lib/ruby/1.9.1/fileutils.rb:247:in `fu_mkdir'
    from /usr/local/lib/ruby/1.9.1/fileutils.rb:221:in `block (2 levels) in mkdir_p'
    from /usr/local/lib/ruby/1.9.1/fileutils.rb:219:in `reverse_each'
    from /usr/local/lib/ruby/1.9.1/fileutils.rb:219:in `block in mkdir_p'
    from /usr/local/lib/ruby/1.9.1/fileutils.rb:205:in `each'
    from /usr/local/lib/ruby/1.9.1/fileutils.rb:205:in `mkdir_p'
    from /usr/local/lib/ruby/gems/1.9.1/gems/bosh_cli-1.0.3/lib/cli/cache.rb:17:in `initialize'
    from /usr/local/lib/ruby/gems/1.9.1/gems/bosh_cli-1.0.3/lib/cli/runner.rb:39:in `new'
    from /usr/local/lib/ruby/gems/1.9.1/gems/bosh_cli-1.0.3/lib/cli/runner.rb:39:in `run'
    from /usr/local/lib/ruby/gems/1.9.1/gems/bosh_cli-1.0.3/lib/cli/runner.rb:18:in `run'
    from /usr/local/lib/ruby/gems/1.9.1/gems/bosh_cli-1.0.3/bin/bosh:16:in `<top (required)>'
    from /usr/local/bin/bosh:23:in `load'
    from /usr/local/bin/bosh:23:in `<main>'
vcap@ip-10-245-24-211:~$ ls -la
total 52
drwxr-xr-x 4 vcap vcap 4096 2013-04-07 19:52 .
drwxr-xr-x 4 root root 4096 2013-04-07 17:31 ..
-rw------- 1 vcap vcap  571 2013-04-07 20:23 .bash_history
-rw-r--r-- 1 vcap vcap  220 2010-04-19 02:15 .bash_logout
-rw-r--r-- 1 vcap vcap 3155 2013-04-07 17:31 .bashrc
lrwxrwxrwx 1 vcap vcap   26 2013-04-07 17:31 .bosh_cache -> /var/vcap/store/bosh_cache
-rw------- 1 vcap vcap  231 2013-04-07 19:53 .bosh_common_config
-rw------- 1 vcap vcap  455 2013-04-07 19:53 .bosh_config
-rw------- 1 vcap vcap  345 2013-04-07 18:08 .bosh_deployer_config
drwx------ 2 vcap vcap 4096 2013-04-07 17:31 .cache
-rw-r--r-- 1 vcap vcap   68 2013-04-07 17:32 .gitconfig
-rw-r--r-- 1 vcap vcap  675 2010-04-19 02:15 .profile
drwx------ 2 vcap vcap 4096 2013-04-07 17:41 .ssh
-rw------- 1 vcap vcap 1465 2013-04-07 19:42 .viminfo
vcap@ip-10-245-24-211:~$ cd /var/vcap/store/
vcap@ip-10-245-24-211:/var/vcap/store$ ls -la
total 8
drwxr-xr-x 2 root root 4096 2013-04-07 17:31 .
drwxr-xr-x 3 root root 4096 2013-04-07 17:31 ..

cap@ip-10-245-24-211:~$ rm .bosh_cache
vcap@ip-10-245-24-211:~$ bosh cf deploy
Current CloudFoundry system is '/var/vcap/store/systems/production'
Cannot read config file: No such file or directory - /var/vcap/store/systems/production/manifest.yml
vcap@ip-10-245-24-211:~$ cd /var/vcap/store/
vcap@ip-10-245-24-211:/var/vcap/store$ ls -la
total 8
drwxr-xr-x 2 root root 4096 2013-04-07 17:31 .
drwxr-xr-x 3 root root 4096 2013-04-07 17:31 ..
vcap@ip-10-245-24-211:/var/vcap/store$

[drnic]

Yeah, not sure yet how to deal with reboots. Thoughts?

[tpradeep]

Check df -hl

When you reboot your inception VM its volume gets detached. You have to remount the volume. Check the bosh-boostrap code where it mounts volume if you need steps.

[lvnilesh]

I haven't played with /etc/fstab in a while but that is the place I guess where ubuntu needs to remount that.

[tpradeep]

Yes exactly..even I haven't been quite successfull but a solution is
required ASAP

On Friday, April 12, 2013, Nilesh wrote:

I haven't played with /etc/fstab in a while but that is the place I guess
where ubuntu needs to remount that.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/155#issuecomment-16307272
.

[drnic]

inception-server rewrite included nice volume remounting