Add retries to resources

[gabcoyne]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request.
• Please do not leave +1 or me too comments, they generate extra noise for issue followers and do not help prioritize the request.
• If you are interested in working on this issue or have submitted a pull request, please leave a comment.

Terraform Version

Terraform version – 1.7.5
Prefect provider version – 0.1.2

Affected Resource(s)

• prefect_*

Terraform Configuration Files

terraform {
  required_providers {
    prefect = {
      source = "prefecthq/prefect"
    }
  }
}
 
provider "prefect" {
  account_id = var.prefect_account_id
  api_key    = data.aws_secretsmanager_secret_version.api_token.secret_string
}

resource "prefect_workspace" "this" {
 name  = var.name
  handle = lower(var.name)
}

Expected Behavior

In the event of failure to create by 429 or 5XX errors, add retries to bring resiliency across the board.

Actual Behavior

In this example a 503 was returned when attempting to create multiple workspaces at once

Steps to Reproduce

1. terraform apply

Important Factoids

Discussed adding https://github.com/hashicorp/go-retryablehttp

[taylor-curran]

I have a plus one on this ticket from customer.

[mitchnielsen]

Received another report of this happening for prefect_variable resources.

[mitchnielsen]

We recently added retries for prefect_workspace resources in #242. We can look into doing this for variables as well.

[mitchnielsen]

Workspaces and variables seem to be the two resources where this popped up the most. For now, rather than adding retries to all resources, let's stick with what we've added so far. If anyone notices similar problems on other resources, please leave a comment here and we'll reopen to investigate.