-
Notifications
You must be signed in to change notification settings - Fork 172
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.
Already on GitHub? Sign in to your account
Kafka on EKS - EKS Bluprints V5 Mitigation #169
Conversation
resource "aws_eks_addon" "vpc_cni" { | ||
cluster_name = module.eks.cluster_name | ||
addon_name = "vpc-cni" | ||
service_account_role_arn = module.vpc_cni_irsa.iam_role_arn |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
add preserve=true
to ensure VPC CNI is not fully deleted before the EKS Cluster. VPC CNI sometimes required to cleanup the existing add-ons
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @AlyIbrahim ! PR Looks good. few minor comment.
In addition.
1/ Please add install and cleanup scripts like other blueprints
2/ Raise an issue to create a Architecture diagram for this pattern
Thanks 馃憤馃徏
|
||
resource "aws_eks_addon" "coredns" { | ||
cluster_name = module.eks.cluster_name | ||
addon_name = "coredns" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
add preserve=true
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
|
||
resource "aws_eks_addon" "kube_proxy" { | ||
cluster_name = module.eks.cluster_name | ||
addon_name = "kube-proxy" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
add preserve=true
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
streaming/kafka/addons.tf
Outdated
|
||
#--------------------------------------------------------------- | ||
# Cluster Autoscaler | ||
#--------------------------------------------------------------- | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit:remove extra line
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
@@ -169,85 +114,115 @@ provisioner: ebs.csi.aws.com | |||
reclaimPolicy: Delete | |||
volumeBindingMode: WaitForFirstConsumer | |||
YAML | |||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Add a dependency to on EKS module for this storage class resource
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
streaming/kafka/addons.tf
Outdated
yaml_body = file("./monitoring-manifests/podmonitor-cluster-operator-metrics.yml") | ||
depends_on = [kubectl_manifest.kafka_namespace] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: formatting. add two spaces. Pre-commit didn't pickup thisone?
same for all the resources below
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
streaming/kafka/main.tf
Outdated
# ingress_fsx1 = { | ||
# description = "Allows Lustre traffic between Lustre clients" | ||
# cidr_blocks = module.vpc.private_subnets_cidr_blocks | ||
# from_port = 1021 | ||
# to_port = 1023 | ||
# protocol = "tcp" | ||
# type = "ingress" | ||
# } | ||
|
||
# ingress_fsx2 = { | ||
# description = "Allows Lustre traffic between Lustre clients" | ||
# cidr_blocks = module.vpc.private_subnets_cidr_blocks | ||
# from_port = 988 | ||
# to_port = 988 | ||
# protocol = "tcp" | ||
# type = "ingress" | ||
# } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
remove the commented lines
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the PR @AlyIbrahim ! LGTM 馃憤馃徏
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM 馃憤馃徏 Thanks for the PR 馃殌
What does this PR do?
馃洃 Please open an issue first to discuss any significant work and flesh out details/direction - we would hate for your time to be wasted.
Consult the CONTRIBUTING guide for submitting pull-requests.
Updating Kafka-on-EKS patterns by:
Motivation
EKS Blueprints v5 upgrade
More
website/docs
orwebsite/blog
section for this featurepre-commit run -a
with this PR. Link for installing pre-commit locallyFor Moderators
Additional Notes