Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(blueprint): Ray Blueprint #871

Merged
merged 27 commits into from
Aug 22, 2022
Merged

feat(blueprint): Ray Blueprint #871

merged 27 commits into from
Aug 22, 2022

Conversation

askulkarni2
Copy link
Contributor

@askulkarni2 askulkarni2 commented Aug 19, 2022

What does this PR do?

This PR adds an experimental blueprint for running Ray Clusters using the KubeRay operator which is provided as a new add-on.

Fixes #491

Motivation

Ray is a popular AI/ML framework for running distributed ML training and inference. Customers who wish to deploy Ray Clusters on EKS can use this example as a reference implementation. The example shows how Ray Clusters can be deployed along with Ingress for model serving as well as a sample monitoring stack using kube-prometheus-stack. Over time we will work towards adding more robustness to the Ray cluster configuration and features such as autoscaling, multi-tenancy, etc.

More

  • Yes, I have tested the PR using my local account setup (Provide any test evidence report under Additional Notes)
  • Yes, I have added a new example under examples to support my PR
  • [N/A] Yes, I have created another PR for add-ons under add-ons repo (if applicable)
  • Yes, I have updated the docs for this feature
  • Yes, I ran pre-commit run -a with this PR

Note: Not all the PRs required examples and docs except a new pattern or add-on added.

For Moderators

  • E2E Test successfully complete before merge?

Additional Notes

The repo local helm chart for kuberay-operator is temporary as the upstream project is still working on having the helm chart published. See ray-project/kuberay#475

@askulkarni2 askulkarni2 temporarily deployed to EKS Blueprints Test August 19, 2022 17:06 Inactive
@askulkarni2 askulkarni2 temporarily deployed to EKS Blueprints Test August 20, 2022 22:47 Inactive
@askulkarni2 askulkarni2 temporarily deployed to EKS Blueprints Test August 22, 2022 07:30 Inactive
@askulkarni2 askulkarni2 temporarily deployed to EKS Blueprints Test August 22, 2022 07:53 Inactive
@askulkarni2 askulkarni2 temporarily deployed to EKS Blueprints Test August 22, 2022 08:04 Inactive
@normalfaults
Copy link
Contributor

Are there any operational, observability, and security considerations to add to the README ?

@askulkarni2
Copy link
Contributor Author

Are there any operational, observability, and security considerations to add to the README ?

Yep, please see https://github.com/aws-ia/terraform-aws-eks-blueprints/tree/feature-ray-addon/examples/ai-ml/ray#monitoring

@askulkarni2 askulkarni2 merged commit e6e8c7a into main Aug 22, 2022
@askulkarni2 askulkarni2 deleted the feature-ray-addon branch August 22, 2022 20:43
allamand pushed a commit to allamand/terraform-aws-eks-blueprints that referenced this pull request Dec 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BLUEPRINT+ADDON] - Ray
3 participants