Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding better retry logic to creation, fixes #179 (hopefully) #184

Merged
merged 1 commit into from
Aug 3, 2015

Conversation

tyler-ball
Copy link
Contributor

The AWS Waiters still appear to be not correctly waiting for existence (see aws/aws-sdk-ruby#859). So adding better retry logic and outputting.

\cc @jaym @fnichol

Fixes #179
Rolls back #171 because that waited too long to provide output

@tyler-ball tyler-ball self-assigned this Jul 28, 2015
@tyler-ball tyler-ball added this to the 1.0.0 milestone Jul 28, 2015
server.create_tags(:tags => tags)
# Unfortunately the AWS SDK doesn't actually wait correctly for instance existence, so we
# need to retry if they throw a `server with id doesn't exist` error
Retryable.retryable(:tries => 10, :sleep => lambda { |n| [2**n, 10].min }) do |retries, _|
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe bump this to 30 seconds max

@jaym
Copy link
Contributor

jaym commented Jul 28, 2015

also, 💯

@jaym
Copy link
Contributor

jaym commented Jul 29, 2015

Here's the promised stacktrace

I, [2015-07-28T15:20:13.088488 #8869]  INFO -- lwrps-ubuntu-1204-ubuntu-1204: -----> Cleaning up any prior instances of <lwrps-ubuntu-1204-ubuntu-1204>
I, [2015-07-28T15:20:13.088589 #8869]  INFO -- lwrps-ubuntu-1204-ubuntu-1204: -----> Destroying <lwrps-ubuntu-1204-ubuntu-1204>...
I, [2015-07-28T15:20:13.089179 #8869]  INFO -- lwrps-ubuntu-1204-ubuntu-1204: Finished destroying <lwrps-ubuntu-1204-ubuntu-1204> (0m0.00s).
I, [2015-07-28T15:20:13.089995 #8869]  INFO -- lwrps-ubuntu-1204-ubuntu-1204: -----> Testing <lwrps-ubuntu-1204-ubuntu-1204>
I, [2015-07-28T15:20:13.090092 #8869]  INFO -- lwrps-ubuntu-1204-ubuntu-1204: -----> Creating <lwrps-ubuntu-1204-ubuntu-1204>...
I, [2015-07-28T15:20:13.090227 #8869]  INFO -- lwrps-ubuntu-1204-ubuntu-1204: If you are not using an account that qualifies under the AWS
free-tier, you may be charged to run these suites. The charge
should be minimal, but neither Test Kitchen nor its maintainers
are responsible for your incurred costs.

I, [2015-07-28T15:20:14.231407 #8869]  INFO -- lwrps-ubuntu-1204-ubuntu-1204: Instance <i-314ab4c7> requested.
E, [2015-07-28T15:20:14.390192 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: Create failed on instance <lwrps-ubuntu-1204-ubuntu-1204>.
E, [2015-07-28T15:20:14.390416 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: ------Exception-------
E, [2015-07-28T15:20:14.390446 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: Class: Aws::Waiters::Errors::UnexpectedError
E, [2015-07-28T15:20:14.390467 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: Message: stopped waiting due to an unexpected error: The instance ID 'i-314ab4c7' does not exist
E, [2015-07-28T15:20:14.390487 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: ------Backtrace-------
E, [2015-07-28T15:20:14.390504 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.7/lib/aws-sdk-core/waiters/waiter.rb:111:in `block in poll'
E, [2015-07-28T15:20:14.390523 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.7/lib/aws-sdk-core/waiters/waiter.rb:101:in `loop'
E, [2015-07-28T15:20:14.390539 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.7/lib/aws-sdk-core/waiters/waiter.rb:101:in `poll'
E, [2015-07-28T15:20:14.390556 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.7/lib/aws-sdk-core/waiters/waiter.rb:91:in `block (2 levels) in wait'
E, [2015-07-28T15:20:14.390574 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.7/lib/aws-sdk-core/waiters/waiter.rb:90:in `catch'
E, [2015-07-28T15:20:14.390591 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.7/lib/aws-sdk-core/waiters/waiter.rb:90:in `block in wait'
E, [2015-07-28T15:20:14.390609 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.7/lib/aws-sdk-core/waiters/waiter.rb:89:in `catch'
E, [2015-07-28T15:20:14.390626 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.7/lib/aws-sdk-core/waiters/waiter.rb:89:in `wait'
E, [2015-07-28T15:20:14.390644 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.7/lib/aws-sdk-core/client_waiters.rb:110:in `wait_until'
E, [2015-07-28T15:20:14.390662 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/kitchen-ec2-c2ea11a2447c/lib/kitchen/driver/ec2.rb:196:in `create'
E, [2015-07-28T15:20:14.390680 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:424:in `public_send'
E, [2015-07-28T15:20:14.390720 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:424:in `block in perform_action'
E, [2015-07-28T15:20:14.390740 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:488:in `call'
E, [2015-07-28T15:20:14.390759 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:488:in `synchronize_or_call'
E, [2015-07-28T15:20:14.390777 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:453:in `block in action'
E, [2015-07-28T15:20:14.390795 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/2.1.0/benchmark.rb:279:in `measure'
E, [2015-07-28T15:20:14.390813 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:452:in `action'
E, [2015-07-28T15:20:14.390831 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:424:in `perform_action'
E, [2015-07-28T15:20:14.390849 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:352:in `create_action'
E, [2015-07-28T15:20:14.390873 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:341:in `block in transition_to'
E, [2015-07-28T15:20:14.390892 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:340:in `each'
E, [2015-07-28T15:20:14.390909 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:340:in `transition_to'
E, [2015-07-28T15:20:14.390927 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:160:in `verify'
E, [2015-07-28T15:20:14.390944 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:189:in `block in test'
E, [2015-07-28T15:20:14.390962 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/2.1.0/benchmark.rb:279:in `measure'
E, [2015-07-28T15:20:14.390993 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:185:in `test'
E, [2015-07-28T15:20:14.391014 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/command.rb:176:in `public_send'
E, [2015-07-28T15:20:14.391070 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/command.rb:176:in `block (2 levels) in run_action'
E, [2015-07-28T15:20:14.391087 #8869] ERROR -- lwrps-ubuntu-1204-ubuntu-1204: ----------------------
I, [2015-07-28T15:20:15.667244 #8873]  INFO -- lwrps-ubuntu-1204-ubuntu-1204: -----> Destroying <lwrps-ubuntu-1204-ubuntu-1204>...
I, [2015-07-28T15:20:15.667935 #8873]  INFO -- lwrps-ubuntu-1204-ubuntu-1204: Finished destroying <lwrps-ubuntu-1204-ubuntu-1204> (0m0.00s).

@jaym
Copy link
Contributor

jaym commented Jul 29, 2015

This is the call to wait_until failing, not the tagging part

@tyler-ball
Copy link
Contributor Author

I don't even

@jaym
Copy link
Contributor

jaym commented Jul 30, 2015

you should throw tag server in there as well.

@tyler-ball
Copy link
Contributor Author

I hate throwing tag_server in there because it should work if the instance exists, but you're probably right

@jaym
Copy link
Contributor

jaym commented Jul 31, 2015

didn't work :(

 -----> Cleaning up any prior instances of <default-ubuntu-1404-ubuntu-1404>
 -----> Destroying <default-ubuntu-1404-ubuntu-1404>...
 Finished destroying <default-ubuntu-1404-ubuntu-1404> (0m0.00s).
 -----> Testing <default-ubuntu-1404-ubuntu-1404>
 -----> Creating <default-ubuntu-1404-ubuntu-1404>...
 If you are not using an account that qualifies under the AWS




 Instance <i-c23dfb34> requested.
 Polling AWS for existence, 0 attempt...
 EC2 instance <i-c23dfb34> created.
 Waited 0/300s for instance <i-c23dfb34> to become ready.
 Create failed on instance <default-ubuntu-1404-ubuntu-1404>.
 ------Exception-------
 Class: Aws::EC2::Errors::InvalidInstanceIDNotFound
 Message: The instance ID 'i-c23dfb34' does not exist
 ------Backtrace-------
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/seahorse/client/plugins/raise_response_errors.rb:15:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/plugins/param_converter.rb:21:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/plugins/response_paging.rb:26:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/seahorse/client/plugins/response_target.rb:21:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/seahorse/client/request.rb:70:in `send_request'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/seahorse/client/base.rb:207:in `block (2 levels) in define_operation_methods'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-resources-2.1.11/lib/aws-sdk-resources/request.rb:24:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-resources-2.1.11/lib/aws-sdk-resources/operations.rb:41:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-resources-2.1.11/lib/aws-sdk-resources/operations.rb:61:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-resources-2.1.11/lib/aws-sdk-resources/resource.rb:147:in `load'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-resources-2.1.11/lib/aws-sdk-resources/resource.rb:111:in `block in wait_until'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/waiters/waiter.rb:104:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/waiters/waiter.rb:104:in `block in poll'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/waiters/waiter.rb:101:in `loop'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/waiters/waiter.rb:101:in `poll'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/waiters/waiter.rb:91:in `block (2 levels) in wait'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/waiters/waiter.rb:90:in `catch'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/waiters/waiter.rb:90:in `block in wait'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/waiters/waiter.rb:89:in `catch'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/waiters/waiter.rb:89:in `wait'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-resources-2.1.11/lib/aws-sdk-resources/resource.rb:115:in `wait_until'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/kitchen-ec2-ab5a8f2ad8f8/lib/kitchen/driver/ec2.rb:395:in `wait_with_destroy'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/kitchen-ec2-ab5a8f2ad8f8/lib/kitchen/driver/ec2.rb:352:in `wait_until_ready'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/kitchen-ec2-ab5a8f2ad8f8/lib/kitchen/driver/ec2.rb:211:in `create'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:424:in `public_send'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:424:in `block in perform_action'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:488:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:488:in `synchronize_or_call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:453:in `block in action'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/2.1.0/benchmark.rb:279:in `measure'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:452:in `action'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:424:in `perform_action'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:352:in `create_action'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:341:in `block in transition_to'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:340:in `each'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:340:in `transition_to'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:160:in `verify'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:189:in `block in test'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/2.1.0/benchmark.rb:279:in `measure'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:185:in `test'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/command.rb:176:in `public_send'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/command.rb:176:in `block (2 levels) in run_action'
 ----------------------
 -----> Destroying <default-ubuntu-1404-ubuntu-1404>...
 Destroy failed on instance <default-ubuntu-1404-ubuntu-1404>.
 ------Exception-------
 Class: Aws::EC2::Errors::InvalidInstanceIDNotFound
 Message: The instance ID 'i-c23dfb34' does not exist
 ------Backtrace-------
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/seahorse/client/plugins/raise_response_errors.rb:15:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/aws-sdk-core/plugins/param_converter.rb:21:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/seahorse/client/plugins/response_target.rb:21:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/seahorse/client/request.rb:70:in `send_request'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-core-2.1.11/lib/seahorse/client/base.rb:207:in `block (2 levels) in define_operation_methods'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-resources-2.1.11/lib/aws-sdk-resources/request.rb:24:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-resources-2.1.11/lib/aws-sdk-resources/operations.rb:41:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/gems/aws-sdk-resources-2.1.11/lib/aws-sdk-resources/operation_methods.rb:19:in `block in add_operation'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/kitchen-ec2-ab5a8f2ad8f8/lib/kitchen/driver/ec2.rb:233:in `destroy'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:424:in `public_send'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:424:in `block in perform_action'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:488:in `call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:488:in `synchronize_or_call'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:453:in `block in action'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/2.1.0/benchmark.rb:279:in `measure'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:452:in `action'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:424:in `perform_action'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:411:in `destroy_action'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:341:in `block in transition_to'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:340:in `each'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:340:in `transition_to'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/instance.rb:171:in `destroy'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/command.rb:176:in `public_send'
 /Users/jmundrawala/.rbenv/versions/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/test-kitchen-8186160aeed8/lib/kitchen/command.rb:176:in `block (2 levels) in run_action'
 ----------------------

@tyler-ball
Copy link
Contributor Author

tyler-ball added a commit that referenced this pull request Aug 3, 2015
Adding better retry logic to creation, fixes #179 (hopefully)
@tyler-ball tyler-ball merged commit b27f058 into master Aug 3, 2015
@tyler-ball tyler-ball deleted the tball/retry_correctly branch August 3, 2015 21:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants