Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Updates to the Ray blueprint #111

Merged
merged 27 commits into from
Mar 21, 2023
Merged

feat: Updates to the Ray blueprint #111

merged 27 commits into from
Mar 21, 2023

Conversation

askulkarni2
Copy link
Collaborator

What does this PR do?

🛑 Please open an issue first to discuss any significant work and flesh out details/direction - we would hate for your time to be wasted.
Consult the CONTRIBUTING guide for submitting pull-requests.

Motivation

The current example for Ray under AI/ML is outdated and uses some of the legacy code. This PR updates the example to incorporate the new helm charts for kuberay-operator. The example also takes into account the upcoming changes in the v5 of EKS Blueprints and hence uses upstream EKS module for cluster and node group creation.

More

  • Yes, I have tested the PR using my local account setup (Provide any test evidence report under Additional Notes)
  • Yes, I have added a new example under examples to support my PR
  • Yes, I have created another PR to add a new Add-on for Terraform EKS Blueprints repo (if applicable)
  • Yes, I have updated the website/docs or website/blog section for this feature
  • Yes, I ran pre-commit run -a with this PR. Link for installing pre-commit locally

For Moderators

  • E2E Test successfully complete before merge?

Additional Notes

@askulkarni2 askulkarni2 requested a review from a team as a code owner February 15, 2023 11:01
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test February 15, 2023 11:01 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test February 15, 2023 19:20 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test February 15, 2023 19:22 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test February 15, 2023 19:27 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test February 15, 2023 22:25 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test February 15, 2023 23:08 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test February 16, 2023 04:00 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test February 16, 2023 04:08 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test February 16, 2023 04:17 — with GitHub Actions Inactive
Copy link
Contributor

@vara-bonthu vara-bonthu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for Updated Ray Blueprint 👍🏼 It looks great.
I left few monitor comments. I didn't get a chance to deploy this blueprint but I will do as soon as i get some free time.

ai-ml/ray/terraform/main.tf Outdated Show resolved Hide resolved
ai-ml/ray/terraform/main.tf Outdated Show resolved Hide resolved
ai-ml/ray/terraform/main.tf Show resolved Hide resolved
ai-ml/ray/terraform/variables.tf Outdated Show resolved Hide resolved
ai-ml/ray/terraform/examples/pytorch/main.tf Show resolved Hide resolved
ai-ml/ray/terraform/examples/pytorch/main.tf Show resolved Hide resolved
ai-ml/ray/terraform/examples/xgboost/main.tf Show resolved Hide resolved
ai-ml/ray/terraform/main.tf Outdated Show resolved Hide resolved
website/docs/ai-ml/ray.md Outdated Show resolved Hide resolved
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test March 21, 2023 03:15 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test March 21, 2023 03:18 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test March 21, 2023 03:23 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test March 21, 2023 03:54 — with GitHub Actions Inactive
@askulkarni2 askulkarni2 temporarily deployed to DoEKS Test March 21, 2023 04:42 — with GitHub Actions Inactive
Comment on lines +119 to +145
cluster_addons = {
coredns = {
most_recent = true
}
kube-proxy = {
most_recent = true
}
vpc-cni = {
# The VPC CNI addon should be deployed before compute to ensure
# the addon is configured before data plane compute resources are created
# See README for further details
before_compute = true
most_recent = true # To ensure access to the latest settings provided
preserve = true
configuration_values = jsonencode({
env = {
# Reference https://aws.github.io/aws-eks-best-practices/reliability/docs/networkmanagement/#cni-custom-networking
AWS_VPC_K8S_CNI_CUSTOM_NETWORK_CFG = "true"
ENI_CONFIG_LABEL_DEF = "topology.kubernetes.io/zone"

# Reference docs https://docs.aws.amazon.com/eks/latest/userguide/cni-increase-ip-addresses.html
ENABLE_PREFIX_DELEGATION = "true"
WARM_PREFIX_TARGET = "1"
}
})
}
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@askulkarni2 Let's move this to Kubernetes add-ons module in the next revision.

Copy link
Contributor

@vara-bonthu vara-bonthu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍🏼

@vara-bonthu vara-bonthu merged commit 84d14e8 into main Mar 21, 2023
@vara-bonthu vara-bonthu deleted the ray-updates branch March 21, 2023 08:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants