v1.0.2

What's Changed

• remove deprecated format and increaes volume timeout to 60 seconds by @nabuskey in #119
• EMR on EKS with Karpenter example with V5 EKS Blueprints by @vara-bonthu in #121
• feat: EMR on EKS Fargate pattern with new approach by @vara-bonthu in #102
• Update Adopters and Add policy of SSM to karpenter role by @srikaanthpenugonda in #123
• Readme update by @vara-bonthu in #124
• Data on EKS workshop module by @vara-bonthu in #125
• Apache NiFi on EKS by @codesometech in #99
• Cleanup scripts added by @vara-bonthu in #126
• add workshop util by @lmouhib in #129
• modifying job submission by changing to input variables rather than hardcoding by @dalbhanj in #130
• Workshop content update by @vara-bonthu in #133
• fix for karpenter provisioner by @vara-bonthu in #134
• Bump webpack from 5.74.0 to 5.76.1 in /website by @dependabot in #135
• adding ebs volume example by @dalbhanj in #132
• Updated all the addons to use v4.25.0 by @vara-bonthu in #136
• minor bug in compute provisioner script by @dalbhanj in #137
• Correct URL in README.md by @mfjackson in #141
• Fsx for lustre added as module to Karpenter example by @vara-bonthu in #139
• Removing link from Adopters page by @dalbhanj in #142
• added preserve field to true to avoid destroy issues by @vara-bonthu in #144
• simplifying deployment experience by @dalbhanj in #143
• chore: Remove accidental commits by @askulkarni2 in #145
• feat: Updates to the Ray blueprint by @askulkarni2 in #111
• doc: Add Kubeflow on AWS page by @askulkarni2 in #147
• Improve guide by @dalbhanj in #148
• EMR EKS Workshop module updates by @vara-bonthu in #146
• RAID-0 config for NVMe based SSD EC2 instances with Karpenter Provisioners by @vara-bonthu in #156
• Add CloudNativePG operator. by @jihed in #127
• CloudNativePG by @jihed in #159
• initialize terraform in install scripts by @nabuskey in #161
• update secrets name by @jihed in #160
• Fix documentation error in ray pytorch example by @elyall in #165
• Spark operator refactor by @vara-bonthu in #170
• fix pre-commit run by @jihed in #173
• EMR EKS Blueprints leveraging the sub terraform modules by @vara-bonthu in #174
• Updated broken links on Readme by @vara-bonthu in #177
• Removed the cluster name variable by @vara-bonthu in #178
• Bump node-fetch and docusaurus in /website by @dependabot in #168
• Flink Operator on EKS by @vara-bonthu in #180
• Security critical fixes for docusaurus by @vara-bonthu in #181
• Bump xml2js and @aws-quickstart/eks-blueprints in /analytics/cdk/emr-eks by @dependabot in #183
• add output for amp by @lmouhib in #184
• delta lake example by @rajarshighosal in #182
• updated website doc for delta lake example by @rajarshighosal in #188
• Bump yaml from 2.1.3 to 2.2.2 in /analytics/cdk/emr-eks by @dependabot in #195
• Dependabot security fix for GOT and TRIM packages by @vara-bonthu in #196
• Monitoring ML Workflows using Kubeflow on Amazon EKS by @elamaran11 in #202
• Fix region mismatch in XGBoost example by @raykrueger in #204
• Spark Operator blueprint upgrade to EKS 1.26 by @vara-bonthu in #205
• Fix region mismatch in pytorch example by @raykrueger in #207
• Fix ray example docs by @raykrueger in #208
• EMR on EKS with Karpenter updated to Kubernetes 1.26 by @mihneaspirescu in #210
• Fixed intallation scripts and removed default region from variables.tf by @lusoal in #211
• fixed broken link in spark observability module by @lusoal in #214
• remove acl using bucket policy by @hitsub2 in #218
• Website restructure and Dynamic EBS volumes for karpenter userdata by @vara-bonthu in #221
• Fixed links for EMR EKS Inro page by @vara-bonthu in #222
• EMR NVIDIA Spark Rapids Blueprint added by @vara-bonthu in #224
• Modify Python script and execution shell script to customize Docker i… by @tanmatth in #225
• Feat/emr eks spark operator by @lmouhib in #220
• DataHub on EKS by @bbgu1 in #213
• Kafka on EKS - EKS Bluprints V5 Mitigation by @AlyIbrahim in #169
• pre-commit updates and vpc module version uplifted by @vara-bonthu in #227
• EMR spark rapids website and XGBoost example update by @vara-bonthu in #229
• Bump aws-cdk-lib from 2.51.1 to 2.80.0 in /analytics/cdk/emr-eks by @dependabot in #226
• Reduce the number of times we run apply by @raykrueger in #233
• Upgrade Airflow to 2.5.3 and EKS to 1.26 by @jagpk in #230
• Jupyterhub on EKS by @rajarshighosal in #228
• Updated readme with correct links by @vara-bonthu in #234
• feat: Refactor/update kafka v5 by @ovaleanu in #231
• feat: Docs update for Jupyterhub and Spark rapids by @vara-bonthu in #236
• fix: Bump cdk and remove package-lock.json by @lmouhib in #238
• Bump stylelint from 14.16.1 to 15.10.1 in /website by @dependabot in #239
• chore: Fix linting errors to pass CI checks by @bryantbiggs in #242
• chore: Change Prometheus with for kube-prometheus-stack by @ovaleanu in #241
• chore: Update module versions to standardize and remove deprecation errors/warnings by @bryantbiggs in #243
• Bump semver from 5.7.1 to 5.7.2 in /website by @dependabot in #245
• chore: Remove VPC CNI IRSA role; utilize permissions provided on EC2 node IAM role by @bryantbiggs in #244
• chore: Change Prometheus to kube-prometheus-stack by @ovaleanu in #246
• chore: Update Spark operator example to use new bootstrap flag for instance store volume RAID0 configuration by @bryantbiggs in #237
• chore: Update Karpenter provisioner codeblock for self-managed Airflow by @bryantbiggs in #247
• fix: Update Spark install script to remove target apply on addons modules by @bryantbiggs in #250
• chore: Replace local EMR on EKS module with virtual cluster sub-module from terraform-aws-emr by @bryantbiggs in #249
• chore: Emr-eks-karpenter blueprint updates by @vara-bonthu in #252
• feat: Trainium blueprint Part1 by @vara-bonthu in #251
• fix: Added a fix for Grafana to use sigv4 authentication by @vara-bonthu in #253
• chore: README Update with logo by @vara-bonthu in #254
• chore: Add remote AMP for Grafana by @ovaleanu in #256
• Bump word-wrap from 1.2.3 to 1.2.4 in /website by @dependabot in #258
• chore: EMR ...

v1.0.1 Final release for Version1

NOTE: This is the final release for Data on EKS Version1 blueprints(Final Tag v1.0.1). We will be updating the DoEKS blueprints with major changes and it will be published under Version2 onwards

What's Changed

• Bump loader-utils from 2.0.3 to 2.0.4 in /website by @dependabot in #62
• fix broken link after folder structure change by @season1946 in #63
• Feat: Apache Kafka using Strimzi on EKS by @AlyIbrahim in #47
• Fix link to Kafka docs. by @brianhammons in #64
• Better positioning EMR on EKS by @dalbhanj in #72
• add cdk blueprint for emr-eks by @lmouhib in #45
• Architecture diagram for home page by @vara-bonthu in #73
• Update import for emr on eks blueprint by @lmouhib in #74
• Add analytics reference architecture blog by @lmouhib in #75
• Fix the aws cli command by @lmouhib in #78
• VPC endpoints added;s3 state for e2e tests by @vara-bonthu in #77
• Add storage considerations and managed alternatives sections to Kafka… by @brianhammons in #79
• [feat] ACK EMR on EKS Controller pattern and example by @season1946 in #81
• [enhancement] Change argo workflow example to create spark app in a new ns by @season1946 in #84
• Feat: Observability on Spark on EKS by @season1946 in #85
• EMR on EKS Doc improvement by @dalbhanj in #83
• EMR on EKS Karpenter with YuniKorn updates by @vara-bonthu in #87
• fixing bug in CloudWatch Logs autocreate in helm bcoz terraform alrea… by @dalbhanj in #88
• Add Troubleshooting page by @dalbhanj in #90
• [enhancement] update argo workflows based on blog comments by @season1946 in #89
• Bump json5 from 2.2.1 to 2.2.3 in /website by @dependabot in #91
• Bump json5 from 2.2.1 to 2.2.3 in /analytics/cdk/emr-eks by @dependabot in #92
• Bump ua-parser-js from 0.7.31 to 0.7.33 in /website by @dependabot in #96
• Bump http-cache-semantics from 4.1.0 to 4.1.1 in /website by @dependabot in #100
• Bump @sideway/formula from 3.0.0 to 3.0.1 in /website by @dependabot in #103
• Website update to Docu@2.3.1 by @vara-bonthu in #106
• Bump node-fetch and docusaurus in /website by @dependabot in #108
• Data on EKS Logo added with footer icons by @vara-bonthu in #109
• Removing the Robot font by @vara-bonthu in #110
• Added EMR cluster Name to output.tf so instructions work by @rbarcia in #113
• Spark Live UI added by @vara-bonthu in #114

New Contributors

• @AlyIbrahim made their first contribution in #47
• @brianhammons made their first contribution in #64
• @dalbhanj made their first contribution in #72
• @lmouhib made their first contribution in #45
• @rbarcia made their first contribution in #113

Full Changelog: v1.0.0...v1.0.1

v0.1 DoEKS initial release

What's Changed

• 🚀 Initial commit for DoEKS by @vara-bonthu in #1
• removed package-lock.json file by @vara-bonthu in #2
• Adding package-lock.json file by @vara-bonthu in #3
• Fixing the git node package dependa alert by @vara-bonthu in #4
• Fix to github pages deployment by @vara-bonthu in #5
• Updated Test environment by @vara-bonthu in #6
• removed deployment branch as main for website by @vara-bonthu in #7
• changed publish dire to ./website by @vara-bonthu in #8
• baseurl for the site changed by @vara-bonthu in #9
• Searchbar added to website by @vara-bonthu in #32
• Karpenter Graviton Provisioner support for EMR on EKS by @vara-bonthu in #37
• Doc updates for Airflow and fixes to spark operator by @vara-bonthu in #38
• Trigger EMR on EKS jobs with Apache Airflow by @season1946 in #39
• Website updates by @vara-bonthu in #40
• 🦄 Apache YuniKorn batch scheduler with EMR on EKS by @vara-bonthu in #42
• Updates to github workflows by @vara-bonthu in #44
• EMR on EKS Gang scheduling example by @vara-bonthu in #49
• Added FluentBit config to write logs to S3 by @vara-bonthu in #50
• MWAA doc fix by @season1946 in #48
• Argo workflows on EKS example and doc by @season1946 in #43
• KubeCost addon for EMR on EKS Karpenter by @vara-bonthu in #52
• argo workflow enhancement by @season1946 in #53
• fix: Fixed the karpenter example hard-coded the provisioner region by @hustshawn in #55
• Bump loader-utils from 2.0.2 to 2.0.3 in /website by @dependabot in #57
• Bump minimatch, recursive-readdir and serve-handler in /website by @dependabot in #58
• Folder structure and major updates to docs by @vara-bonthu in #59
• Github workflow security updates by @vara-bonthu in #60
• daily tag gh flow added by @vara-bonthu in #61

New Contributors

• @vara-bonthu made their first contribution in #1
• @season1946 made their first contribution in #39
• @hustshawn made their first contribution in #55
• @dependabot made their first contribution in #57

Full Changelog: https://github.com/awslabs/data-on-eks/commits/v0.1