GCP: Failover is broken when dst is 'ANY' in a VS

[abhishek-batapati]

We have multiple VS in our configuration with few VS having destination as 'ANY'(0.0.0.0/0).
VS with dst 'ANY' is used for source NAT.

When we trigger a failover, it is failing because of VS with dst as 'ANY'. We would have expect it to skip this VS for failover.

Error log:
Mon, 06 Apr 2020 04:17:41 GMT - info: [f5-cloud-failover] Performing failover - execute
Mon, 06 Apr 2020 04:17:41 GMT - info: [f5-cloud-failover] Performing Failover - discovery
Mon, 06 Apr 2020 04:17:42 GMT - severe: [f5-cloud-failover] failover.execute() error: ipaddr: the address has neither IPv6 nor IPv4 format Error: ipaddr: the address has neither IPv6 nor IPv4 format
at Object.ipaddr.parse (/var/config/rest/iapps/f5-cloud-failover/node_modules/ipaddr.js/lib/ipaddr.js:632:13)
at ipsFilter.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:516:51)
at Array.forEach ()
at ips.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:512:23)
at Array.forEach ()
at Cloud._matchIps (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:505:13)
at vm.networkInterfaces.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:640:51)
at Array.forEach ()
at theirVms.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:636:34)
at Array.forEach ()
at Cloud._discoverNicOperations (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:634:18)
at Cloud._discoverAddressOperations (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:590:18)
at _getVmsByTags.then (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:173:33)
at tryCatcher (/usr/share/rest/node/node_modules/bluebird/js/release/util.js:16:23)
at Promise._settlePromiseFromHandler (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:512:31)
at Promise._settlePromise (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:569:18)
at Promise._settlePromise0 (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:614:10)
at Promise._settlePromises (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:693:18)
at Promise._fulfill (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:638:18)
at Promise._settlePromise (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:582:21)
at Promise._settlePromise0 (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:614:10)
at Promise._settlePromises (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:693:18)

[shyawnkarim]

Can you change the logging level to silly via the instructions on this page and then post your output again?

[abhishek-batapati]

Please find the output below after changing log level to silly.

Tue, 07 Apr 2020 17:54:48 GMT - fine: [f5-cloud-failover] HTTP Request - POST /trigger
Tue, 07 Apr 2020 17:54:48 GMT - fine: [f5-cloud-failover] Initializing failover class
Tue, 07 Apr 2020 17:54:48 GMT - fine: [f5-cloud-failover] config: {"class":"Cloud_Failover","environment":"gcp","externalStorage":{"scopingTags":{"goog-dm":"dev1-sjc1-ng"}},"failoverAddresses":{"scopingTags":{"goog-dm":"dev1-sjc1-ng"}},"failoverRoutes":{"scopingTags":{"goog-dm":"dev1-sjc1-ng"},"scopingAddressRanges":[{"range":"0.0.0.0/0"}],"defaultNextHopAddresses":{"discoveryType":"static","items":["192.168.0.130","192.168.0.131"]}},"controls":{"class":"Controls","logLevel":"silly"},"schemaVersion":"1.1.0"}
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: artifacts.saasdev-sed-wss-hp.appspot.com bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: bkt-cs1-cas-postconfig bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: bkt-dev-cas-db bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: bkt-dev-cas-postconfig bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: bkt-dev-pod-tp bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: bkt-dev1-cas-postconfig bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: bkt-mv1-cas-postconfig bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: dev-cas-images bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-cs1-cs1dc bucket labels: [{"f5_cloud_failover_label":"cs1-cs1dc","goog-dm":"cs1-cs1dc"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev-acdc bucket labels: [{"f5_cloud_failover_label":"dev-acdc","goog-dm":"dev-acdc"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev1-devdc1 bucket labels: [{"f5_cloud_failover_label":"dev1-devdc1","goog-dm":"dev1-devdc1"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev1-devdc1-ng bucket labels: [{"f5_cloud_failover_label":"dev1-devdc1-ng","goog-dm":"dev1-devdc1-ng"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev1-mv1 bucket labels: [{"goog-dm":"dev1-mv1","f5_cloud_failover_label":"dev1-mv1"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev1-mv1-ng bucket labels: [{"goog-dm":"dev1-mv1-ng","f5_cloud_failover_label":"dev1-mv1-ng"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev1-nyam-dc bucket labels: [{"goog-dm":"dev1-nyam-dc","f5_cloud_failover_label":"dev1-nyam-dc"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev1-qa1 bucket labels: [{"goog-dm":"dev1-qa1","f5_cloud_failover_label":"dev1-qa1"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev1-sjc1 bucket labels: [{"f5_cloud_failover_label":"dev1-sjc1","goog-dm":"dev1-sjc1"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev1-sjc1-ng bucket labels: [{"goog-dm":"dev1-sjc1-ng","f5_cloud_failover_label":"dev1-sjc1-ng"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev1-tp1 bucket labels: [{"f5_cloud_failover_label":"dev1-tp1","goog-dm":"dev1-tp1"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev7-devdc6 bucket labels: [{"goog-dm":"dev7-devdc6","f5_cloud_failover_label":"dev7-devdc6"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev7-devdc6-ng bucket labels: [{"f5_cloud_failover_label":"dev7-devdc6-ng","goog-dm":"dev7-devdc6-ng"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev7-devdc7 bucket labels: [{"f5_cloud_failover_label":"dev7-devdc7","goog-dm":"dev7-devdc7"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev7-devdc7-ng bucket labels: [{"f5_cloud_failover_label":"dev7-devdc7-ng","goog-dm":"dev7-devdc7-ng"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev7-qa7 bucket labels: [{"goog-dm":"dev7-qa7","f5_cloud_failover_label":"dev7-qa7"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev7-qa7-ng bucket labels: [{"goog-dm":"dev7-qa7-ng","f5_cloud_failover_label":"dev7-qa7-ng"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-dev7-sacheen bucket labels: [{"f5_cloud_failover_label":"dev7-sacheen","goog-dm":"dev7-sacheen"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: f5-bigip-storage-tp1-dcw1-ng bucket labels: [{"goog-dm":"tp1-dcw1-ng","f5_cloud_failover_label":"tp1-dcw1-ng"}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: saasdev-sed-wss-hp.appspot.com bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: saasdev-sed-wss-hpcai bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: sed-gcp-iam-development bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: staging.saasdev-sed-wss-hp.appspot.com bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] bucket name: us.artifacts.saasdev-sed-wss-hp.appspot.com bucket labels: [{}]
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] deployment bucket name: f5-bigip-storage-dev1-sjc1-ng
Tue, 07 Apr 2020 17:54:48 GMT - finest: [f5-cloud-failover] Getting GCP resources
Tue, 07 Apr 2020 17:54:49 GMT - finest: [f5-cloud-failover] GCP resources have been collected; gcp provider initialization is completed.
Tue, 07 Apr 2020 17:54:50 GMT - finest: [f5-cloud-failover] Download stateFile: {"taskState":"FAILED","message":"Failover failed because of failover.execute() error: ipaddr: the address has neither IPv6 nor IPv4 format Error: ipaddr: the address has neither IPv6 nor IPv4 format\n at Object.ipaddr.parse (/var/config/rest/iapps/f5-cloud-failover/node_modules/ipaddr.js/lib/ipaddr.js:632:13)\n at ipsFilter.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:516:51)\n at Array.forEach ()\n at ips.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:512:23)\n at Array.forEach ()\n at Cloud._matchIps (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:505:13)\n at vm.networkInterfaces.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:640:51)\n at Array.forEach ()\n at theirVms.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:636:34)\n at Array.forEach ()\n at Cloud._discoverNicOperations (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:634:18)\n at Cloud._discoverAddressOperations (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:590:18)\n at _getVmsByTags.then (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:173:33)\n at tryCatcher (/usr/share/rest/node/node_modules/bluebird/js/release/util.js:16:23)\n at Promise._settlePromiseFromHandler (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:512:31)\n at Promise._settlePromise (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:569:18)\n at Promise._settlePromise0 (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:614:10)\n at Promise._settlePromises (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:693:18)\n at Promise._fulfill (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:638:18)\n at Promise._settlePromise (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:582:21)\n at Promise._settlePromise0 (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:614:10)\n at Promise._settlePromises (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:693:18)","timestamp":"2020-04-06T04:17:42.650Z","instance":"bigip2-dev1-sjc1-ng.c.saasdev-sed-wss-hp.internal","failoverOperations":{"addresses":null,"routes":null}}
Tue, 07 Apr 2020 17:54:50 GMT - finest: [f5-cloud-failover] taskState: {"taskState":"FAILED","message":"Failover failed because of failover.execute() error: ipaddr: the address has neither IPv6 nor IPv4 format Error: ipaddr: the address has neither IPv6 nor IPv4 format\n at Object.ipaddr.parse (/var/config/rest/iapps/f5-cloud-failover/node_modules/ipaddr.js/lib/ipaddr.js:632:13)\n at ipsFilter.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:516:51)\n at Array.forEach ()\n at ips.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:512:23)\n at Array.forEach ()\n at Cloud._matchIps (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:505:13)\n at vm.networkInterfaces.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:640:51)\n at Array.forEach ()\n at theirVms.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:636:34)\n at Array.forEach ()\n at Cloud._discoverNicOperations (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:634:18)\n at Cloud._discoverAddressOperations (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:590:18)\n at _getVmsByTags.then (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:173:33)\n at tryCatcher (/usr/share/rest/node/node_modules/bluebird/js/release/util.js:16:23)\n at Promise._settlePromiseFromHandler (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:512:31)\n at Promise._settlePromise (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:569:18)\n at Promise._settlePromise0 (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:614:10)\n at Promise._settlePromises (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:693:18)\n at Promise._fulfill (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:638:18)\n at Promise._settlePromise (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:582:21)\n at Promise._settlePromise0 (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:614:10)\n at Promise._settlePromises (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:693:18)","timestamp":"2020-04-06T04:17:42.650Z","instance":"bigip2-dev1-sjc1-ng.c.saasdev-sed-wss-hp.internal","failoverOperations":{"addresses":null,"routes":null}}
Tue, 07 Apr 2020 17:54:50 GMT - info: [f5-cloud-failover] Performing failover - execute
Tue, 07 Apr 2020 17:54:50 GMT - finest: [f5-cloud-failover] State file data: {"taskState":"FAILED","message":"Failover failed because of failover.execute() error: ipaddr: the address has neither IPv6 nor IPv4 format Error: ipaddr: the address has neither IPv6 nor IPv4 format\n at Object.ipaddr.parse (/var/config/rest/iapps/f5-cloud-failover/node_modules/ipaddr.js/lib/ipaddr.js:632:13)\n at ipsFilter.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:516:51)\n at Array.forEach ()\n at ips.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:512:23)\n at Array.forEach ()\n at Cloud._matchIps (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:505:13)\n at vm.networkInterfaces.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:640:51)\n at Array.forEach ()\n at theirVms.forEach (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:636:34)\n at Array.forEach ()\n at Cloud._discoverNicOperations (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:634:18)\n at Cloud._discoverAddressOperations (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:590:18)\n at _getVmsByTags.then (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:173:33)\n at tryCatcher (/usr/share/rest/node/node_modules/bluebird/js/release/util.js:16:23)\n at Promise._settlePromiseFromHandler (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:512:31)\n at Promise._settlePromise (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:569:18)\n at Promise._settlePromise0 (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:614:10)\n at Promise._settlePromises (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:693:18)\n at Promise._fulfill (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:638:18)\n at Promise._settlePromise (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:582:21)\n at Promise._settlePromise0 (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:614:10)\n at Promise._settlePromises (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:693:18)","timestamp":"2020-04-06T04:17:42.650Z","instance":"bigip2-dev1-sjc1-ng.c.saasdev-sed-wss-hp.internal","failoverOperations":{"addresses":null,"routes":null}}
Tue, 07 Apr 2020 17:54:50 GMT - info: [f5-cloud-failover] Performing Failover - recovery
Tue, 07 Apr 2020 17:54:50 GMT - finest: [f5-cloud-failover] Data will be uploaded to f5cloudfailoverstate.json: {"taskState":"RUNNING","message":"Failover running","timestamp":"2020-04-07T17:54:50.651Z","instance":"bigip1-dev1-sjc1-ng.c.saasdev-sed-wss-hp.internal","failoverOperations":{}}
Tue, 07 Apr 2020 17:54:50 GMT - warning: [f5-cloud-failover] Recovering previous task: {"addresses":null,"routes":null}
Tue, 07 Apr 2020 17:54:50 GMT - finest: [f5-cloud-failover] Data will be uploaded to f5cloudfailoverstate.json: {"taskState":"RUNNING","message":"Failover running","timestamp":"2020-04-07T17:54:50.982Z","instance":"bigip1-dev1-sjc1-ng.c.saasdev-sed-wss-hp.internal","failoverOperations":{"addresses":null,"routes":null}}
Tue, 07 Apr 2020 17:54:51 GMT - info: [f5-cloud-failover] Performing Failover - update
Tue, 07 Apr 2020 17:54:51 GMT - fine: [f5-cloud-failover] recoverPreviousTask: true
Tue, 07 Apr 2020 17:54:51 GMT - fine: [f5-cloud-failover] addressDiscovery: null
Tue, 07 Apr 2020 17:54:51 GMT - fine: [f5-cloud-failover] routeDiscovery: null
Tue, 07 Apr 2020 17:54:51 GMT - finest: [f5-cloud-failover] updateAddresses: {"updateOperations":null}
Tue, 07 Apr 2020 17:54:51 GMT - info: [f5-cloud-failover] No failoverAddresses to discover
Tue, 07 Apr 2020 17:54:51 GMT - fine: [f5-cloud-failover] updateAddresses disassociate operations: undefined
Tue, 07 Apr 2020 17:54:51 GMT - fine: [f5-cloud-failover] updateAddresses associate operations: undefined
Tue, 07 Apr 2020 17:54:51 GMT - info: [f5-cloud-failover] No associations to update.
Tue, 07 Apr 2020 17:54:51 GMT - severe: [f5-cloud-failover] failover.execute() error: Cannot read property 'forEach' of undefined TypeError: Cannot read property 'forEach' of undefined
at Cloud._updateFwdRules (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:854:20)
at Cloud._updateAddresses (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:802:18)
at _discoverAddressOperations.then.operations (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:181:46)
at tryCatcher (/usr/share/rest/node/node_modules/bluebird/js/release/util.js:16:23)
at Promise._settlePromiseFromHandler (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:512:31)
at Promise._settlePromise (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:569:18)
at Promise._settlePromiseCtx (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:606:10)
at Async._drainQueue (/usr/share/rest/node/node_modules/bluebird/js/release/async.js:138:12)
at Async._drainQueues (/usr/share/rest/node/node_modules/bluebird/js/release/async.js:143:10)
at Immediate.Async.drainQueues (/usr/share/rest/node/node_modules/bluebird/js/release/async.js:17:14)
at runCallback (timers.js:794:20)
at tryOnImmediate (timers.js:752:5)
at processImmediate [as _immediateCallback] (timers.js:729:5)
Tue, 07 Apr 2020 17:54:51 GMT - finest: [f5-cloud-failover] Data will be uploaded to f5cloudfailoverstate.json: {"taskState":"FAILED","message":"Failover failed because of failover.execute() error: Cannot read property 'forEach' of undefined TypeError: Cannot read property 'forEach' of undefined\n at Cloud._updateFwdRules (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:854:20)\n at Cloud._updateAddresses (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:802:18)\n at _discoverAddressOperations.then.operations (/var/config/rest/iapps/f5-cloud-failover/nodejs/providers/gcp/cloud.js:181:46)\n at tryCatcher (/usr/share/rest/node/node_modules/bluebird/js/release/util.js:16:23)\n at Promise._settlePromiseFromHandler (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:512:31)\n at Promise._settlePromise (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:569:18)\n at Promise._settlePromiseCtx (/usr/share/rest/node/node_modules/bluebird/js/release/promise.js:606:10)\n at Async._drainQueue (/usr/share/rest/node/node_modules/bluebird/js/release/async.js:138:12)\n at Async._drainQueues (/usr/share/rest/node/node_modules/bluebird/js/release/async.js:143:10)\n at Immediate.Async.drainQueues (/usr/share/rest/node/node_modules/bluebird/js/release/async.js:17:14)\n at runCallback (timers.js:794:20)\n at tryOnImmediate (timers.js:752:5)\n at processImmediate [as _immediateCallback] (timers.js:729:5)","timestamp":"2020-04-07T17:54:51.868Z","instance":"bigip1-dev1-sjc1-ng.c.saasdev-sed-wss-hp.internal","failoverOperations":{"addresses":null,"routes":null}}
Tue, 07 Apr 2020 17:54:51 GMT - finest: [f5-cloud-failover] Routes: {"0":{"id":"1210773612427470640","creationTimestamp":"2020-04-05T15:21:19.228-07:00","name":"route-dev1-useast1-sjc1-wanout-default","description":"f5_cloud_failover_labels={"goog-dm":"dev1-sjc1-ng"}","network":"https://www.googleapis.com/compute/v1/projects/saasdev-sed-wss-hp/global/networks/vpc-dev1-useast1-sjc1-wanout","destRange":"0.0.0.0/0","priority":900,"nextHopIp":"192.168.0.130","selfLink":"https://www.googleapis.com/compute/v1/projects/saasdev-sed-wss-hp/global/routes/route-dev1-useast1-sjc1-wanout-default","kind":"compute#route"}}
Tue, 07 Apr 2020 17:54:51 GMT - warning: [f5-cloud-failover] Next hop address to use is empty: 192.168.0.130,192.168.0.131
Tue, 07 Apr 2020 17:54:51 GMT - finest: [f5-cloud-failover] Next hop address: undefined
Tue, 07 Apr 2020 17:54:52 GMT - fine: [f5-cloud-failover] updateRoutes operations: {}
Tue, 07 Apr 2020 17:54:52 GMT - info: [f5-cloud-failover] No route operations to run
Tue, 07 Apr 2020 17:54:57 GMT - finest: socket 252 closed

[shyawnkarim]

Thanks for reaching out to us with with your issue. This is a bug and I've filed a bug ticket, internal ID AUTOSDK-275, to get this fixed.

[alaari-f5]

Closing this issue

As of release CFE 1.2 we moved this CFE repo under F5Networks. Your issue was recreated there. To follow-up on this issue visit:

F5Networks/f5-cloud-failover-extension#3