AWS DDK 0.6.2

🚀 Enhancements / Bug Fixes

Core:

• Enhancing AthenaSQLStage to handle both static and dynamic SQL Queries by @anmolsgandhi in #204
• Enhancement: adding queue_props to SqsToLambda by @malachi-constant in #207
• Enhancement: adding rule_name parameter to DataPipeline.add_stage() by @malachi-constant in #209
• Enhancing GlueTransform Stage for Stepfunction Crawler Task Retry by @anmolsgandhi in #208
• Enhancment: Adding additonal sfn props support to StateMachineStage by @malachi-constant in #210
• Fix bug for context_layer undefined and changing region_name derived from boto3 session by @anmolsgandhi in #211
• Enhancement: Allowing alarms to be disabled in stages by @malachi-constant in #205

🙏 Thanks

We thank the following contributors/users for their work on this release:
@anmolsgandhi , @malachi-constant

Full Changelog: 0.6.1...0.6.2

AWS DDK 0.6.1

🚀 Enhancements / Dependency Upgrades

Core:

• Enhancement: Support additional pipeline attributes in CICDPipelineStack construct by @malachi-constant in #184
• Enhancement: SqsToLambdaStage Adding support for fifo event target by @malachi-constant in #185
• Enhancement: SDK for pandas layer lookup utility by @malachi-constant in #186
• Dependencies: CDK Library Upgrade -> 2.54 by @malachi-constant in #190

🙏 Thanks

We thank the following contributors/users for their work on this release:

@kukushking, @malachi-constant

Full Changelog: 0.6.0...0.6.1

AWS DDK 0.6.0

🚀 Features // 💎 Enhancements // 🪲 Bug fixes

CLI:

• add stacks argument for 'ddk deploy' by @malachi-constant in #129
• bug fix: windows ddk deploy Issue by @malachi-constant in #180

Core:

• support pipeline_name parameter in CICDPipeline Construct by @malachi-constant in #161
• bug fix: GlueTransformStage does not pass crawler name in to SFN by @malachi-constant in #167
• additional resource level args in stages SqsToLambdaStage & GlueTransformStage by @malachi-constant in #170
• support Multiple S3 Prefixes in S3 Event Stage by @malachi-constant in #171
• support Multiple Buckets by @malachi-constant in #173
• bug fix: set the required Glue crawler permissions in GlueTransformStage by @malachi-constant in #172
• add add_wave support to CICDPipelineStack construct by @malachi-constant in #176
• add max_batching_window to SqsToLambda Stage by @malachi-constant in #179

Full Changelog: 0.5.1...0.6.0

AWS DDK 0.5.1

🚀 Features / Bug fixes

CLI:

• add --all to ddk deploy by @jaidisido in #111

Core:

• Glue DataBrew Stage by @b-akhil in #123
• remove Glue log encryption by default from security config by @kukushking in #126

🙏 Thanks

We thank the following contributors/users for their work on this release:

@b-akhil, @jaidisido, @kukushking, @malachi-constant, @cnfait

Full Changelog: 0.4.0...0.5.1

AWS DDK 0.4.0

🚀 Features / Bug fixes

Core:

• Add stage rshift operator by @kukushking in #92
• Refactor Stage construct to include Event, StateMachine and DataStage by @jaidisido in #104
• Dms S3<->S3 ingestion stage by @malachi-constant in #105

CLI:

• Add alpha packages to cli requirements.txt template by @jaidisido in #107

Docs 📚

• How-to guide ddk configuration by @malachi-constant in #99
• Expose configuration attributes for classes in documentation by @malachi-constant in #91
• How-To Private Code Artifact and other enhancements by @jaidisido in #102

Full Changelog: 0.3.0...0.4.0

🙏 Thanks

We thank the following contributors/users for their work on this release:

@jaidisido, @kukushking, @malachi-constant, @cnfait

AWS DDK 0.3.0

⚠️ Breaking changes

• Update CDK to v2.20.0 and pin the version #83 #72
• Replace CloudTrail with S3 EventBridge notifications in S3EventStage #83

🚀 Features / Bug fixes

Core:

• Add additional_role_policy_statements to state machine stages #82
• Expose state machine objects in stages #81
• Add state machine alarms #76
• Allow multiple CloudWatch alarms per stage #78
• Add lambda layers to SQSToLambdaStage #79
• Add security config to Glue factory #75
• Add firehose delivery ingestion stage #71 🚀
• Add CodeArtifact publish action #74
• Add AppFlow stage #68 🚀
• Add AthenaSQL stage #66 🚀
• Add glue factory and create glue job and crawler in stage #63
• Add data pipeline & stage alerting #55

CLI:

• Remove default AWS profile #61

Docs 📚

• Multi-account how-to #64

🙏 Thanks

We thank the following contributors/users for their work on this release:

@jaidisido, @kukushking, @malachi-constant, @cnfait

AWS DDK 0.2.0

⚠️ Breaking changes

• Renamed aws_ddk_core.pipelines.Stage to aws_ddk_core.pipelines.DataStage and aws_ddk_core.pipelines.Pipeline to aws_ddk_core.pipelines.DataPipeline #33

🚀 Features / Bug fixes

• Enable event handling in SqsToLambdaStage #54
• Improve git commands in CLI create-repository #53
• Add StepFunctionFactory #48
• Use Step Functions service-sent events in GlueTransformStage #51
• Add escape hatches for SqsToLambdaStage #47
• Add security checks and test stages to CICD pipeline construct #28
• Add custom CodeBuild stage to CICD pipeline construct #37
• Add CICD pipeline notifications via SNS #43

Docs 📚

• Create your own DDK Data Stage How-to guide

🙏 Thanks

We thank the following contributors/users for their work on this release:

@jaidisido, @kukushking, @malachi-constant, @cnfait, @vemel, @NickCorbett

0.1.0

Initial release of core and cli packages. 🚀🚀🚀