(10.5.0) INFRASYS-6354 pull loadbalancer instances by specific instance-ids and runs healtcheck in a recursive fashion. Improves error handling load balancer instances healthcheck and performs rollback when necessary

[sbraverman]

No description provided.

[adamjkeller]

+1 looks good to me!

[sbraverman]

-bash-4.1$ python rolling_deploy.py -e prd -p dnbi-cirrus -b 8 -P dnbi-deploy -a ami-d0c284ba
2015-12-02 14:53:18,379: INFO: Begin Logging...
2015-12-02 14:53:20,040: INFO: AMI ami-d0c284ba is ready
2015-12-02 14:53:20,040: INFO: Build #: 8 ::: Autoscale Group: dnbi-backend-prd-dnbicirrusASGprd-1RLOAGTISKVOP
2015-12-02 14:53:20,181: INFO: Current desired count was changed from 2 to 4
2015-12-02 14:53:20,181: INFO: Set autoscale capacity for dnbi-backend-prd-dnbicirrusASGprd-1RLOAGTISKVOP to 4
2015-12-02 14:53:20,299: INFO: Sleeping for 240 seconds to allow for instances to spin up
2015-12-02 14:57:21,306: INFO: List of all Instance ID's and IP addresses in dnbi-backend-prd-dnbicirrusASGprd-1RLOAGTISKVOP: {u'i-ee7fa958': u'10.34.10.42', u'i-7576a0c3': u'10.34.10.126', u'i-7676a0c0': u'10.34.10.127', u'i-ef7fa959': u'10.34.10.43'}
2015-12-02 14:57:21,792: INFO: New Instance List with IP Addresses: {u'i-ee7fa958': u'10.34.10.42', u'i-7576a0c3': u'10.34.10.126', u'i-7676a0c0': u'10.34.10.127', u'i-ef7fa959': u'10.34.10.43'}
2015-12-02 14:57:22,005: INFO: i-7576a0c3 is in a healthy state. Moving on...
2015-12-02 14:57:22,207: INFO: i-7676a0c0 is in a healthy state. Moving on...
2015-12-02 14:57:22,420: WARNING: i-ef7fa959 is not in a fully working state yet
2015-12-02 14:57:52,685: WARNING: i-ef7fa959 is not in a fully working state yet
2015-12-02 14:58:23,024: INFO: i-ef7fa959 is in a healthy state. Moving on...
2015-12-02 14:58:23,240: INFO: i-ee7fa958 is in a healthy state. Moving on...
dnbicirrusELBprd
2015-12-02 14:58:23,663: INFO: Must check load balancer again. Following instance(s) are not "InService": [InstanceState:(i-ef7fa959,OutOfService), InstanceState:(i-ee7fa958,OutOfService)]
dnbicirrusELBprd
2015-12-02 14:58:53,974: INFO: Must check load balancer again. Following instance(s) are not "InService": [InstanceState:(i-ef7fa959,OutOfService), InstanceState:(i-ee7fa958,OutOfService)]
dnbicirrusELBprd
2015-12-02 14:59:24,187: INFO: Must check load balancer again. Following instance(s) are not "InService": [InstanceState:(i-ef7fa959,OutOfService)]
dnbicirrusELBprd
2015-12-02 14:59:54,384: INFO: ELB healthcheck OK
2015-12-02 14:59:54,762: INFO: Current desired count was changed from 4 to 2
2015-12-02 14:59:54,762: INFO: Set autoscale capacity for dnbi-backend-prd-dnbicirrusASGprd-1RLOAGTISKVOP to 2
2015-12-02 15:00:56,133: INFO: Deployed instances [InstanceState:(i-ee7fa958,InService), InstanceState:(i-ef7fa959,InService)] to ELB: dnbicirrusELBprd
2015-12-02 15:00:56,358: INFO: DEPLOY tags currently exist: stg, new tag is stg, prd
2015-12-02 15:00:56,674: INFO: Deployment Complete!

[kantselovich]

+1