Support cross account DynamoDB source tables

[graytaylor0]

Is your feature request related to a problem? Please describe.
With the addition of DynamoDB resource policies, data prepper can now assume a role in account A and access a table in account B. However, the Data Prepper DynamodB source only passes the table name to some requests, instead of the full table ARN (

data-prepper/data-prepper-plugins/dynamodb-source/src/main/java/org/opensearch/dataprepper/plugins/source/dynamodb/leader/LeaderScheduler.java

Line 240 in 11b18cd

.tableName(tableName)

). Changing this in all the calls that allow table arn will allow this support.

Describe alternatives you've considered (Optional)
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

[dlvenable]

As noted in the documentation, DynamoDB now supports passing the table ARN instead of the name to the TableName parameter.

https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_DescribeTable.html#API_DescribeTable_RequestSyntax

Thus, we mainly need to just provide the ARN rather than have to extract the table name.

We can change this line:

data-prepper/data-prepper-plugins/dynamodb-source/src/main/java/org/opensearch/dataprepper/plugins/source/dynamodb/leader/LeaderScheduler.java

Line 234 in 77d8812

String tableName = TableUtil.getTableNameFromArn(tableConfig.getTableArn());

to:

String tableName = tableConfig.getTableArn();

We may still want some logging to use the tableName only.

We will need to make this change for any other interaction with DynamoDB.

[dlvenable]

I've opened #4776 to support the table ARN. This works for streams. However, export gives the following error:

2024-07-30T23:40:30,615 [pool-11-thread-2] INFO  org.opensearch.dataprepper.plugins.source.dynamodb.export.ExportScheduler - Submitting a new export job for table arn:aws:dynamodb:us-west-2:123456789012:table/SampleCrossAccount with export time 2024-07-30T22:42:35.225Z
2024-07-30T23:40:31,196 [pool-11-thread-2] ERROR org.opensearch.dataprepper.plugins.source.dynamodb.export.ExportTaskManager - Failed to submit an export job with error This action is only supported by accounts that match the resource owner?s account. (Service: DynamoDb, Status Code: 400, Request ID: ZNLGONJUC8NHLHSG7P65O4SHA3VV4KQMSO5AEMVJF67Q9ASXBAJG)