feat: Adds glueJob and crawlerName to GlueTransform stage properties

[malachi-constant]

• Adds glueJob and crawlerName to GlueTransform stage properties

Relates

• Closes feat: syncing GlueTransformStage to main #265

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[anmolsgandhi]

We need the crawler object similarly to the glue job object and not the crawler name as return property. We can return the crawler instead of crawler.ref

[malachi-constant]

We need the crawler object similarly to the glue job object and not the crawler name as return property. We can return the crawler instead of crawler.ref

@anmolsgandhi In our current version self._crawler is set to None when crawler_name is specified. Do you think we should continue this behavior? Or find a way to import and return?

[anmolsgandhi]

We need the crawler object similarly to the glue job object and not the crawler name as return property. We can return the crawler instead of crawler.ref

@anmolsgandhi In our current version self._crawler is set to None when crawler_name is specified. Do you think we should continue this behavior? Or find a way to import and return?

Unlike other cdk constructs, Crawler doesn't have an interface that can import crawler through crawler_name or arn. I think when we create the crawler as part of the stage, it will not possible for the devs to it as that object is not exposed. If the user is passing a crawler name, i am not sure if they will be interesting in either the crawler object or the name as they already would have both the information which is not true when we create the crawler in the stage.

[malachi-constant]

AWS CodeBuild CI Report

• CodeBuild project: DDKIntegrationTestsD8472609-5SCHWjldmWcf
• Commit ID: e959c77
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository