Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extra connection attributes for DMS S3 Endpoints incomplete --> no error is shown #26296

Closed
Olgoetz opened this issue Sep 18, 2020 · 2 comments
Closed

Comments

@Olgoetz
Copy link

Olgoetz commented Sep 18, 2020

Terraform Version

Terraform v0.13.2

Terraform Configuration Files

resource "aws_dms_endpoint" "s3_endpoint" {

  count                       = length(var.zones)
  endpoint_id                 = "${var.s3_endpoint_id_prefix}-${var.environment}-${var.shortApp}-${var.zones[count.index]}"
  endpoint_type               = "target"
  engine_name                 = "s3"
  ssl_mode                    = "none"
  kms_key_arn = var.kms_key_arn
extra_connection_attributes = "ServiceAccessRoleArn=${var.service_access_role_arn};bucketFolder=${var.zones[count.index]}/dms-export/${var.shortApp};bucketName=${var.bucket_name};cannedAclForObjects=BUCKET_OWNER_FULL_CONTROL;cdcPath=undefined;compressionType=NONE;csvDelimiter=,;csvRowDelimiter=\n;dataFormat=csv;datePartitionEnabled=false;includeOpForFullLoad=true;timestampColumnName=CDCTIMESTAMP"
  
  
  s3_settings {
    bucket_folder           = "${var.zones[count.index]}/dms-export/${var.shortApp}"
    bucket_name             = var.bucket_name
    service_access_role_arn = var.service_access_role_arn

  }

  tags = merge(var.tags, { "global.project" = "${local.global_project_tag}" })

}
...

Debug Output

https://gist.github.com/Olgoetz/9e7aec3af0af47b347822f20d0ce6b47

Crash Output

Expected Behavior

The extra connection attributes should look like:

ServiceAccessRoleArn=arn:aws:iam::*******:role/SDP_DMS_MIGRATION_TO_S3_ROLE;bucketFolder=komo/dms-export/pc;bucketName=*****-nonprod-sdp-lz-stag-pnc;cannedAclForObjects=BUCKET_OWNER_FULL_CONTROL;cdcPath=undefined;compressionType=NONE;csvDelimiter=,;csvRowDelimiter=\n;dataFormat=csv;datePartitionEnabled=false;includeOpForFullLoad=true;timestampColumnName=CDCTIMESTAMP

Actual Behavior

When I go to the endpoint in the AWS management console, these are the settings in extra connection attributes:

bucketFolder=komo/dms-export/pc;bucketName=axade-nonprod-sdp-lz-stag-pnc;compressionType=NONE;csvDelimiter=,;csvRowDelimiter=\n;datePartitionEnabled=false;

Steps to Reproduce

  1. terraform init
  2. terraform apply

Additional Context

No.

References

@Olgoetz Olgoetz added bug new new issue not yet triaged labels Sep 18, 2020
@alisdair
Copy link
Member

Thanks for reporting this! I believe this is a bug in the AWS provider: hashicorp/terraform-provider-aws#8009. Closing this issue as it is not on Terraform core.

@alisdair alisdair added provider/aws and removed new new issue not yet triaged labels Sep 18, 2020
@ghost
Copy link

ghost commented Oct 19, 2020

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@ghost ghost locked as resolved and limited conversation to collaborators Oct 19, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants