Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(glue): Add G.4X and G.8X worker types for AWS Glue #25637

Merged
merged 20 commits into from
May 24, 2023
Merged

Conversation

racc
Copy link
Contributor

@racc racc commented May 18, 2023

Adds new worker types for Glue announced in: https://aws.amazon.com/about-aws/whats-new/2023/05/aws-glue-large-instance-types-generally-available/


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license

@gitpod-io
Copy link

gitpod-io bot commented May 18, 2023

@github-actions github-actions bot added the beginning-contributor [Pilot] contributed between 0-2 PRs to the CDK label May 18, 2023
@aws-cdk-automation aws-cdk-automation requested a review from a team May 18, 2023 05:20
@github-actions github-actions bot added the p2 label May 18, 2023
@racc racc changed the title Add G.4X and G.8X worker types for AWS Glue feat(aws-glue-alpha): Add G.4X and G.8X worker types for AWS Glue May 18, 2023
Copy link
Collaborator

@aws-cdk-automation aws-cdk-automation left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The pull request linter has failed. See the aws-cdk-automation comment below for failure reasons. If you believe this pull request should receive an exemption, please comment and provide a justification.

A comment requesting an exemption should contain the text Exemption Request. Additionally, if clarification is needed add Clarification Request to a comment.

@racc racc changed the title feat(aws-glue-alpha): Add G.4X and G.8X worker types for AWS Glue feat(glue-alpha): Add G.4X and G.8X worker types for AWS Glue May 18, 2023
@aws-cdk-automation aws-cdk-automation added pr-linter/exemption-requested The contributor has requested an exemption to the PR Linter feedback. pr/needs-community-review This PR needs a review from a Trusted Community Member or Core Team Member. labels May 18, 2023
@aws-cdk-automation aws-cdk-automation dismissed their stale review May 21, 2023 23:14

✅ Updated pull request passes all PRLinter validations. Dismissing previous PRLinter review.

@racc racc changed the title feat(glue-alpha): Add G.4X and G.8X worker types for AWS Glue feat(glue): Add G.4X and G.8X worker types for AWS Glue May 22, 2023
@aws-cdk-automation aws-cdk-automation removed the pr-linter/exemption-requested The contributor has requested an exemption to the PR Linter feedback. label May 22, 2023
@@ -42,8 +42,9 @@ new glue.Job(this, 'ScalaSparkEtlJob', {
glueVersion: glue.GlueVersion.V4_0,
script: glue.Code.fromBucket(bucket, 'src/com/example/HelloWorld.scala'),
className: 'com.example.HelloWorld',
extraJars: [glue.Code.fromBucket(bucket, 'jars/HelloWorld.jar')],
extraJars: [glue.Code.fromBucket(bucket, 'jars/HelloWorld.jar')]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These kinds of commas are not typos, it makes it easier to extend without having to worry if it's the last line or higher up.

@@ -31,7 +31,7 @@ const script = glue.Code.fromAsset(path.join(__dirname, 'job-script/hello_world.
glueVersion,
script,
}),
workerType: glue.WorkerType.G_2X,
workerType: glue.WorkerType.G_8X,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why make the tests 4x as expensive?

racc added 2 commits May 23, 2023 08:06
Add comma back to README.md
Make worker type G.1X to save $
@racc
Copy link
Contributor Author

racc commented May 24, 2023

@Naumel what say ye?

@Naumel
Copy link
Contributor

Naumel commented May 24, 2023

@Naumel what say ye?

😆 I see what you did there; nice by-pass of checks. In this case, with the nature of the change, I like it!

Copy link
Contributor

@Naumel Naumel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for taking the time to make these changes!

@mergify
Copy link
Contributor

mergify bot commented May 24, 2023

Thank you for contributing! Your pull request will be updated from main and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

@aws-cdk-automation aws-cdk-automation removed the pr/needs-community-review This PR needs a review from a Trusted Community Member or Core Team Member. label May 24, 2023
@aws-cdk-automation
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: AutoBuildv2Project1C6BFA3F-wQm2hXv2jqQv
  • Commit ID: 3ef5ed3
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@mergify mergify bot merged commit 1e4ffcd into aws:main May 24, 2023
7 checks passed
@mergify
Copy link
Contributor

mergify bot commented May 24, 2023

Thank you for contributing! Your pull request will be updated from main and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
beginning-contributor [Pilot] contributed between 0-2 PRs to the CDK p2
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants