azure & gcp: do not stop when service not enable, 404 or not enough permission

[talset]

Abstract

With a valid credential, terracognita should import everything possible and not stop for

• a missing permission
• 404/403 error
• service not enabled

Errors should be displayed (at least in verbose)

For example with azure azurerm_storage_queue

could not import from Azure: error while reading from resource "azurerm_storage_queue": unable to list storage queues from reader: unable to list storage.ListQueue from Azure APIs: storage.QueueClient#List: Failure responding to request: StatusCode=404 -- Original Error: autorest/azure: Service returned an error. Status=404 Code="ParentResourceNotFound" Message="Can not perform requested operation on nested resource. Parent resource 'cycloidlabtfstate' not found."

Example with gcp google_compute_instance

 error while reading from resource "google_compute_instance": unable to list instances from reader: unable to get zones in region: unable to fetch information for region europe-west1: googleapi: Error 403: Compute Engine API has not been used in project XXXXXXXXXXX before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/compute.googleapis.com/overview?project=XXXXXXXXXXX then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured

Proposal

Implementation

Open issues (if applicable)

[xescugc]

We should add a logic similar to the aws one https://github.com/cycloidio/terracognita/blob/master/aws/provider.go#L92 for those providers.

[majorku5anagi]

@talset I'm running into same issue. Is there an alternative way in which I can somehow get around these issues? All required flags are correctly defined and it breaks with azurerm_storage_queue.

EDIT: I have managed to make a workaround by excluding all resources starting with azurerm_storage_*. Neverthless, the issue is there

[talset]

@talset I'm running into same issue. Is there an alternative way in which I can somehow get around these issues? All required flags are correctly defined and it breaks with azurerm_storage_queue.

EDIT: I have managed to make a workaround by excluding all resources starting with azurerm_storage_*. Neverthless, the issue is there

Sorry to be late, I planned to work on it this week ;)