Message: cannot copy directory

[kojiwell]

I get this error message, which is probably because my local user and local home are different from the instance's.

Message: cannot copy directory /path/to/home/myuser/Documents/workspace/chef/cookbooks/myproject/default-ubuntu-1204-sandbox-20140322-26415-XXXXXX to itself /path/to/home/myuser/Documents/workspace/chef/cookbooks/myproject/default-ubuntu-1204-sandbox-20140322-26415-XXXXXX/cookbooks/myproject/default-ubuntu-1204-sandbox-20140322-26415-XXXXXX

My guess is, if I set the right driver option for the destination directory, this should be resolved, but I don't find it yet...

Any help would be great!

.kitchen.yml:

driver:
  name: openstack
  openstack_username: <%= ENV['OS_USERNAME'] %>
  openstack_api_key: <%= ENV['OS_PASSWORD'] %>
  openstack_auth_url: <%= "#{ENV['OS_AUTH_URL']}/tokens" %>
  require_chef_omnibus: latest
  image_ref: <%= ENV['OS_IMAGE_ID'] %>
  flavor_ref: <%= ENV['OS_FLAVOR_ID'] %>
  key_name: <%= ENV['OS_KEY_NAME'] %>
  tenant_name: <%= ENV['OS_TENANT_NAME'] %>
  username: ubuntu

provisioner:
  name: chef_solo

platforms:
  - name: ubuntu-12.04

suites:
  - name: myproject
    run_list:
      - recipe[myproject]
    attributes:

Version:

$ gem list | grep kitchen
kitchen-openstack (1.3.0)
test-kitchen (1.2.1)

[TerryHowe]

I don't think that message was created by kitchen-openstack, but I could be wrong. Whatever is going on, you cannot copy one directory to the same directory.

[kojiwell]

Thanks @TerryHowe . My recipe works fine with kitchen-vagrant, and the copy is what Kitchen is trying to do for me somehow. The follows are the detailed logs, but well, I'm a newbie and I think I'm doing something wrong... I will look into .kitchen/logs/kitchen.log and kitchen diagnose --all more carefully.

I, [2014-03-24T14:32:27.727390 #325]  INFO -- Kitchen: -----> Starting Kitchen (v1.2.1)
I, [2014-03-24T14:32:28.237941 #325]  INFO -- Kitchen: -----> Converging <default-ubuntu-1204>...
E, [2014-03-24T14:32:28.291006 #325] ERROR -- Kitchen: ------Exception-------
E, [2014-03-24T14:32:28.291063 #325] ERROR -- Kitchen: Class: Kitchen::ActionFailed
E, [2014-03-24T14:32:28.291104 #325] ERROR -- Kitchen: Message: Failed to complete #converge action: [cannot copy directory /path/to/home/myuser/Documents/workspace/chef/cookbooks/myproject/default-ubuntu-1204-sandbox-20140322-26415-XXXXXX to itself /path/to/home/myuser/Documents/workspace/chef/cookbooks/myproject/default-ubuntu-1204-sandbox-20140322-26415-XXXXXX/cookbooks/myproject/default-ubuntu-1204-sandbox-20140322-26415-XXXXXX]
E, [2014-03-24T14:32:28.291143 #325] ERROR -- Kitchen: ---Nested Exception---
E, [2014-03-24T14:32:28.291181 #325] ERROR -- Kitchen: Class: ArgumentError
E, [2014-03-24T14:32:28.291219 #325] ERROR -- Kitchen: Message: cannot copy directory /path/to/home/myuser/Documents/workspace/chef/cookbooks/myproject/default-ubuntu-1204-sandbox-20140322-26415-XXXXXX to itself /path/to/home/myuser/Documents/workspace/chef/cookbooks/myproject/default-ubuntu-1204-sandbox-20140322-26415-XXXXXX/cookbooks/myproject/default-ubuntu-1204-sandbox-20140322-26415-XXXXXX

Any comment is welcome.

Thanks again.

[hartmantis]

@kjtanaka It looks like something's going weird when Kitchen's setting up its sandbox directory of everything to copy to the test platform, like it thinks the cookbook dir and the sandbox dir are the same. But neither kitchen-openstack nor kitchen-vagrant alter the default behavior; they shouldn't behave differently.

Could you post the output of a fresh Kitchen run with debug-level logging (kitchen [test|converge] -l debug)? That might provide some clues.

[fnichol]

@kjtanaka You could also try to run kitchen diagnose --all and we can inspect the result--just be sure to scrub the output for any secrets/credentials before posting

[kojiwell]

Thanks both, @RoboticCheese and @fnichol . The follows are my kitchen converge -l debug and kitchen diagnose --all.

kitchen converge -l debug:

-----> Starting Kitchen (v1.2.1)
-----> Creating <myproject-ubuntu-1204>...
D      Selected image: a6fc6103-5052-44b9-b007-b779784ec6d8 ktanaka/ubuntu-1204-
2014-03-25
D      Selected flavor: 2 m1.small
       OpenStack instance <3225a027-0333-4841-b3f5-e5cc319a6ba1> created.
..................................
(server ready)
       Waiting for 192.168.11.23:22...
        :
        :
       Waiting for 192.168.11.23:22...
       (ssh ready)
       Using OpenStack keypair <***************>
       Using public SSH key </N/u/ktanaka/.ssh/id_rsa.pub>
       Using private SSH key </N/u/ktanaka/.ssh/id_rsa>
       Finished creating <myproject-ubuntu-1204> (1m45.16s).
-----> Converging <myproject-ubuntu-1204>...
       Preparing files for transfer
D      Creating local sandbox in /N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w
       Preparing current project directory as a cookbook
D      Using metadata.rb from /N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/metadata.rb
D      Cleaning up local sandbox in /N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w
>>>>>> ------Exception-------
>>>>>> Class: Kitchen::ActionFailed
>>>>>> Message: Failed to complete #converge action: [cannot copy directory /N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w to itself /N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w]
>>>>>> ----------------------
>>>>>> Please see .kitchen/logs/kitchen.log for more details
>>>>>> Also try running `kitchen diagnose --all` for configuration

D      ------Exception-------
D      Class: Kitchen::ActionFailed
D      Message: Failed to complete #converge action: [cannot copy directory /N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w to itself /N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w]
D      ---Nested Exception---
D      Class: ArgumentError
D      Message: cannot copy directory /N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w to itself /N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w/cookbooks/myproject/myproject-ubuntu-1204-sandbox-20140325-10184-e4149w
D      ------Backtrace-------
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:1366:in `copy'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:469:in `block in copy_entry'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:1500:in `call'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:1500:in `wrap_traverse'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:466:in `copy_entry'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:441:in `block in cp_r'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:1573:in `block in fu_each_src_dest'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:1582:in `block in fu_each_src_dest0'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:1580:in `each'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:1580:in `fu_each_src_dest0'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:1571:in `fu_each_src_dest'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/fileutils.rb:440:in `cp_r'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/provisioner/chef_base.rb:378:in `cp_this_cookbook'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/provisioner/chef_base.rb:265:in `prepare_cookbooks'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/provisioner/chef_base.rb:120:in `create_sandbox'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/provisioner/chef_solo.rb:33:in `create_sandbox'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/driver/ssh_base.rb:40:in `converge'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:273:in `public_send'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:273:in `block in perform_action'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:308:in `call'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:308:in `synchronize_or_call'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:283:in `block in action'
D      /N/u/ktanaka/.rvm/rubies/ruby-2.1.1/lib/ruby/2.1.0/benchmark.rb:279:in `measure'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:282:in `action'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:273:in `perform_action'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:256:in `converge_action'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:246:in `block in transition_to'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:245:in `each'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:245:in `transition_to'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/instance.rb:119:in `converge'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/command.rb:109:in `public_send'
D      /N/u/ktanaka/.rvm/gems/ruby-2.1.1/gems/test-kitchen-1.2.1/lib/kitchen/command.rb:109:in `block (2 levels) in run_action'
D      ----------------------

kitchen diagnose --all:

---
timestamp: 2014-03-25 15:40:12.041557000 Z
kitchen_version: 1.2.1
loader:
  process_erb: true
  process_local: true
  process_global: true
  global_config:
  project_config:
    filename: "/N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/.kitchen.yml"
    raw_data:
      driver_plugin: openstack
      provisioner:
        name: chef_solo
      platforms:
      - name: ubuntu-12.04
      driver_config:
        openstack_username: ktanaka
        openstack_api_key: **********************
        openstack_auth_url: https://**************************:5000/v2.0/tokens
        image_ref: ************************************
        flavor_ref: 2
        key_name: ***************
        tenant_name: **************
        disable_ssl_validation: true
        username: ubuntu
      suites:
      - name: myproject
        run_list:
        - recipe[myproject]
  local_config:
  combined_config:
    filename:
    raw_data:
      driver_plugin: openstack
      provisioner:
        name: chef_solo
      platforms:
      - name: ubuntu-12.04
      driver_config:
        openstack_username: ktanaka
        openstack_api_key: **********************
        openstack_auth_url: https://**************************:5000/v2.0/tokens
        image_ref: ************************************
        flavor_ref: 2
        key_name: **************
        tenant_name: *********
        disable_ssl_validation: true
        username: ubuntu
      suites:
      - name: myproject
        run_list:
        - recipe[myproject]
instances:
  myproject-ubuntu-1204:
    state_file:
      hostname: ****************
      last_action: create
      server_id: ************************************
      ssh_key: "/N/u/ktanaka/.ssh/id_rsa"
    driver:
      disable_ssl_validation: true
      flavor_ref: 2
      floating_ip:
      floating_ip_pool:
      image_ref: ************************************
      key_name: ***************
      kitchen_root: "/N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject"
      log_level: :info
      name: openstack
      network_ref:
      openstack_api_key: ****************
      openstack_auth_url: https://**************************:5000/v2.0/tokens
      openstack_network_name:
      openstack_region:
      openstack_service_name:
      openstack_tenant:
      openstack_username: ktanaka
      port: '22'
      private_key_path: "/N/u/ktanaka/.ssh/id_rsa"
      public_key_path: "/N/u/ktanaka/.ssh/id_rsa.pub"
      security_groups:
      server_name:
      sudo: true
      tenant_name: ***********
      test_base_path: "/N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/test/integration"
      use_ipv6: false
      username: ubuntu
    provisioner:
      attributes: {}
      chef_omnibus_url: https://www.getchef.com/chef/install.sh
      clients_path:
      cookbook_files_glob: README.*,metadata.{json,rb},attributes/**/*,definitions/**/*,files/**/*,libraries/**/*,providers/**/*,recipes/**/*,resources/**/*,templates/**/*
      data_bags_path:
      data_path:
      encrypted_data_bag_secret_key_path:
      environments_path:
      kitchen_root: "/N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject"
      log_level: :info
      name: chef_solo
      nodes_path:
      require_chef_omnibus: true
      roles_path:
      root_path: "/tmp/kitchen"
      run_list:
      - recipe[myproject]
      solo_rb: {}
      sudo: true
      test_base_path: "/N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/test/integration"
    busser:
      busser_bin: "/tmp/busser/bin/busser"
      kitchen_root: "/N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject"
      root_path: "/tmp/busser"
      ruby_bindir: "/opt/chef/embedded/bin"
      sudo: true
      suite_name: myproject
      test_base_path: "/N/u/ktanaka/Documents/workspace/test-chef/cookbooks/myproject/test/integration"
      version: busser

Since I can login to the instance with kitchen login myproject-ubuntu-1204, the instance seems ok.

Thanks a lot for your help!

[kojiwell]

I found out a kind of workaround. If I explicitly define /tmp in create_sandbox like below, the issue won't happen.

test-kitchen/lib/kitchen/provisioner/base.rb:

@@ -75,7 +75,7 @@ def prepare_command ; end
       def run_command ; end

       def create_sandbox
-        @sandbox_path = Dir.mktmpdir("#{instance.name}-sandbox-")
+        @sandbox_path = Dir.mktmpdir("#{instance.name}-sandbox-", "/tmp")
         File.chmod(0755, sandbox_path)
         info("Preparing files for transfer")
         debug("Creating local sandbox in #{sandbox_path}")

When I use kitchen-vagrant, the machine is my macbook, but when I use kitchen-openstack, I have to login to a shared machine(redhat5). So I guess the cause is something local on the redhat5 machine.

Thanks!