Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kinesisfirehose: support Iceberg Destination #33666

Open
1 of 2 tasks
mazyu36 opened this issue Mar 1, 2025 · 2 comments
Open
1 of 2 tasks

kinesisfirehose: support Iceberg Destination #33666

mazyu36 opened this issue Mar 1, 2025 · 2 comments
Labels
@aws-cdk/aws-kinesisfirehose Related to Amazon Kinesis Data Firehose effort/medium Medium work item – several days of effort feature-request A feature should be added or improved. p2

Comments

@mazyu36
Copy link
Contributor

mazyu36 commented Mar 1, 2025

Describe the feature

Firehose supports the destination settings for Apache Iceberg Table.
https://docs.aws.amazon.com/firehose/latest/dev/apache-iceberg-destination.html

But at the present, L2 Construct does not support it.

Ref: https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-kinesisfirehose-deliverystream-icebergdestinationconfiguration.html

Use Case

To use Iceberg Destination feature.

Proposed Solution

Add a L2 Construct for Iceberg Destination.

Other Information

No response

Acknowledgements

  • I may be able to implement this feature request
  • This feature might incur a breaking change

CDK version used

2.180.0

Environment details (OS name and version, etc.)

all

@mazyu36 mazyu36 added feature-request A feature should be added or improved. needs-triage This issue or PR still needs to be triaged. labels Mar 1, 2025
@mazyu36 mazyu36 changed the title firehose: support IceBerg Destination kinesisfirehose: support IceBerg Destination Mar 1, 2025
@github-actions github-actions bot added the @aws-cdk/aws-kinesisfirehose Related to Amazon Kinesis Data Firehose label Mar 1, 2025
@mazyu36 mazyu36 changed the title kinesisfirehose: support IceBerg Destination kinesisfirehose: support Iceberg Destination Mar 1, 2025
@juliomaroto
Copy link

They seem to be available in the Cfn resource though.

https://docs.aws.amazon.com/cdk/api/v2/docs/aws-cdk-lib.aws_kinesisfirehose.CfnDeliveryStream.html

Main problem to me, that I'm observing, is that nor the Cfn resource include the automatic tables creation in Glue:

https://docs.aws.amazon.com/firehose/latest/APIReference/API_TableCreationConfiguration.html

Seems to be only supported through UI, API, SDK, but not in the CDK.

@pahud
Copy link
Contributor

pahud commented Mar 2, 2025

Thank you @mazyu36 ! We appreciate your PR as always! :-)

@pahud pahud added p2 effort/medium Medium work item – several days of effort and removed needs-triage This issue or PR still needs to be triaged. labels Mar 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
@aws-cdk/aws-kinesisfirehose Related to Amazon Kinesis Data Firehose effort/medium Medium work item – several days of effort feature-request A feature should be added or improved. p2
Projects
None yet
Development

No branches or pull requests

5 participants