Skip to content

v1.2.1

Latest

Choose a tag to compare

@vara-bonthu vara-bonthu released this 05 May 18:18
· 58 commits to main since this release
a796297

What's Changed

  • docs: How to retrieve Argo Workflow WebUI url by @berry2012 in #873
  • docs: Adding Spark Best Practices with new guidelines by @arunnalpet in #856
  • feat: Datahub upgrade and security patch by @bbgu1 in #871
  • feat: Add Ray Data Spark logs processing example with Apache Iceberg by @ratnopam in #877
  • docs: Update website doc to link to the blueprint by @ratnopam in #878
  • feat: Spark on EKS Blueprint Update by @vara-bonthu in #880
  • fix: Add shs helm provisioning timeout by @ratnopam in #881
  • feat: Deploying gp3 storage class before the addons to avoud race condition by @vara-bonthu in #883
  • feat: Added bedrock IAM policy to JupyterHub Notebooks by @vara-bonthu in #884
  • fix: Add sonnet perms by @nabuskey in #886
  • fix: Fix tf lint by @nabuskey in #887
  • feat: VPC Module update to create subnets dynamically for AZ = 2 to 4 by @vara-bonthu in #889
  • fix: Add spark history server enable variable by @ratnopam in #882
  • chore: Pin IRSA module version by @alanty in #893
  • docs: Added Spark workshop links to Website homepage by @vara-bonthu in #896
  • feat: Add Example for Apache Beam on Spark on EKS by @bbgu1 in #852
  • fix: Airflow SSH Key Fixes by @jagpk in #898
  • feat: Kafka cluster validation script by @saiteja313 in #850
  • chore(deps): bump tar-fs from 3.0.9 to 3.1.1 in /website by @dependabot[bot] in #902
  • feat: Version upgrade for EMR / Flink and adding autoscaler example by @bbgu1 in #897
  • docs: Update EMR on EKS with Flink Streaming documentation by @Eriall1 in #900
  • refactor: CNPG on EKS bug fixes, documentation updates by @reverse in #899
  • feat: TPCDS Benchmarks for "Spark + Gluten +Velox" Vs Native Spark by @vara-bonthu in #903
  • feat: Security fix and pre-commit fixes by @vara-bonthu in #906
  • fix: Improve install/cleanup dependencies. by @alanty in #901
  • fix: Upstream CSI Driver issues by @meetreks in #910
  • feat: Add celeborn benchmark by @nabuskey in #918
  • chore(deps-dev): bump js-yaml from 4.1.0 to 4.1.1 in /website by @dependabot[bot] in #914
  • chore(deps): bump node-forge from 1.3.1 to 1.3.2 in /website by @dependabot[bot] in #919
  • chore(deps): bump brotli from 1.1.0 to 1.2.0 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #916
  • fix: Update github actions to publish the website by @vara-bonthu in #920
  • fix: Spelling and grammar errors by @vara-bonthu in #921
  • chore(deps): bump werkzeug from 3.1.3 to 3.1.4 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #923
  • chore(deps): bump mdast-util-to-hast from 13.2.0 to 13.2.1 in /website by @dependabot[bot] in #922
  • fix: Update celeborn benchmark with more data by @nabuskey in #932
  • chore(deps): bump urllib3 from 2.5.0 to 2.6.3 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #930
  • chore(deps): bump werkzeug from 3.1.4 to 3.1.5 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #931
  • feat: Data on EKS v2 by @nabuskey in #935
  • fix: Update website release build directory by @nabuskey in #940
  • chore(deps): bump urllib3 from 2.5.0 to 2.6.3 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #939
  • chore(deps): bump pydantic from 2.0.3 to 2.4.0 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #938
  • chore(deps): bump pyasn1 from 0.6.1 to 0.6.2 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #937
  • chore(deps): bump werkzeug from 3.1.3 to 3.1.5 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #936
  • chore(deps): bump pyasn1 from 0.6.1 to 0.6.2 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #933
  • chore(deps): bump apache-airflow from 3.1.0 to 3.1.6 in /data-stacks/airflow-on-eks/examples/dag-bundles by @dependabot[bot] in #944
  • chore(deps): bump brotli from 1.1.0 to 1.2.0 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #942
  • chore(deps): bump urllib3 from 2.5.0 to 2.6.3 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #941
  • fix: Update python packages by @nabuskey in #948
  • chore(deps): bump urllib3 from 2.5.0 to 2.6.3 in /data-stacks/airflow-on-eks/examples/dag-bundles by @dependabot[bot] in #946
  • fix: Fix datahub link by @nabuskey in #951
  • chore(deps): bump requests from 2.32.3 to 2.32.4 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #943
  • chore(deps): bump aiohttp from 3.13.1 to 3.13.3 in /data-stacks/airflow-on-eks/examples/dag-bundles by @dependabot[bot] in #947
  • chore(deps): bump starlette from 0.48.0 to 0.49.1 in /data-stacks/airflow-on-eks/examples/dag-bundles by @dependabot[bot] in #949
  • chore(deps): bump requests from 2.32.3 to 2.32.4 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #950
  • chore(deps): bump lodash from 4.17.21 to 4.17.23 in /website by @dependabot[bot] in #952
  • chore(deps): bump apache-airflow from 3.1.0 to 3.1.6 in /data-stacks/airflow-on-eks/examples/dag-bundles by @dependabot[bot] in #955
  • feat: Add Pinot data stack by @nabuskey in #954
  • chore: Remove pinot blueprint by @nabuskey in #956
  • doc: Add documentation for NAU by @nabuskey in #958
  • fix: Fix trailing whitespace by @nabuskey in #967
  • fix: Fix home page links by @nabuskey in #962
  • fix: Fix box overflow by @nabuskey in #959
  • chore: Remove superset on eks blueprint by @nabuskey in #966
  • chore: Remove datahub on eks blueprint by @nabuskey in #965
  • chore: Remove spark ipv6 blueprint by @nabuskey in #964
  • fix: Update SHS memory allocation by @nabuskey in #976
  • fix: Add fernet key for airflow by @nabuskey in #977
  • chore: Upgrade karpenter by @nabuskey in #978
  • chore(deps): bump protobuf from 5.29.5 to 5.29.6 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #969
  • feat: Add celeborn best practices by @nabuskey in #980
  • feat: Add datafusion comet benchmark results by @nabuskey in #975
  • chore(deps): bump flask from 3.1.1 to 3.1.3 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #982
  • chore(deps): bump flask from 3.1.1 to 3.1.3 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #984
  • chore(deps): bump werkzeug from 3.1.5 to 3.1.6 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #983
  • chore(deps): bump werkzeug from 3.1.5 to 3.1.6 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #981
  • feat: Rapids TPCDS test updates with GPU Operator by @vara-bonthu in #988
  • fix: Remove trino blueprint by @nabuskey in #992
  • fix: Remove Flink blueprint by @nabuskey in #993
  • fix: Use irsa for celeborn by @nabuskey in #990
  • feat: EKS PCP tiers added, VPC modified to support 120k IPs per AZ by @vara-bonthu in #989
  • fix: lint EOL by @nabuskey in #999
  • fix: Shorten shs role name by @nabuskey in #1004
  • fix: Pin celeborn to version 6.2.0 by @nabuskey in #1003
  • fix: Remove cloud native postgresql by @nabuskey in #996
  • chore(deps): bump pyjwt from 2.10.1 to 2.12.0 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #991
  • chore(deps): bump orjson from 3.11.3 to 3.11.6 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #987
  • chore(deps): bump pyasn1 from 0.6.2 to 0.6.3 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #995
  • fix: Remove kafka blueprint by @nabuskey in #997
  • fix: Remove nifi blueprint by @nabuskey in #1000
  • chore(deps): bump pyasn1 from 0.6.2 to 0.6.3 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #994
  • chore(deps): bump minimatch, serve-handler and serve in /website by @dependabot[bot] in #1001
  • fea: Add initial clickhouse stack by @nabuskey in #1005
  • fix: Remove spark streaming blueprint by @nabuskey in #998
  • fix: Conditionally create irsa for celeborn by @nabuskey in #1006
  • Add s3 express vpc endpoint by @nabuskey in #1011
  • Update monitoring namespace and versions by @nabuskey in #1012
  • Remove argo workflows by @nabuskey in #1010
  • Update docs with monitoring namespace changes by @nabuskey in #1013
  • feat: Fixed all the security vulnerabilities by @vara-bonthu in #1014
  • pin all GH actions to commit hashes by @nabuskey in #1016
  • Add celeborn 10tb results by @nabuskey in #1009
  • feat: improve resource clean up by @shvbsle in #1023
  • chore(deps): bump requests from 2.32.4 to 2.33.0 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #1018
  • chore(deps): bump picomatch from 2.3.1 to 2.3.2 in /website by @dependabot[bot] in #1019
  • chore(deps): bump requests from 2.32.3 to 2.33.0 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #1020
  • chore(deps): bump requests from 2.32.5 to 2.33.0 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #1021
  • chore(deps): bump node-forge from 1.3.2 to 1.4.0 in /website by @dependabot[bot] in #1024
  • chore(deps): bump brace-expansion from 1.1.12 to 1.1.13 in /website by @dependabot[bot] in #1025
  • chore(deps): bump path-to-regexp from 0.1.12 to 0.1.13 in /website by @dependabot[bot] in #1028
  • do not run install scripts, set min release age to 10 days by @nabuskey in #1029
  • remove eks resources before vpc by @nabuskey in #1030
  • Add ClickHouse-based event store for K8s events and Spark application logs by @nabuskey in #1032
  • feat: Add Celeborn rolling restart validation and production best practices by @vara-bonthu in #1026
  • chore: Update paths-filter GitHub Action to 4.0.1 by @nabuskey in #1034
  • update spark applciations to use json logging by @nabuskey in #1033
  • chore: Udpate node to 24 by @nabuskey in #1035
  • fix: Update git repository refs by @nabuskey in #1036
  • fix: Increase memory for Spark History Server by @nabuskey in #1039
  • feat: Preventing Spark OOM kills best practices by @vara-bonthu in #1041
  • fix: Return ipv4 DNS records for ipv4 clusters by @nabuskey in #1045
  • feat: Adding Starrocks data stack by @hitsub2 in #1044
  • feat: Emr-Eks-Flink by @bbgu1 in #1047
  • chore(deps): bump python-dotenv from 1.0.1 to 1.2.2 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #1052
  • chore(deps): bump python-dotenv from 1.0.1 to 1.2.2 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #1051
  • Update logging infra and configurations for k8s events and spark by @nabuskey in #1053
  • Enable cgroupv2 by @nabuskey in #1054
  • feat(starrocks): add shared-data/shared-nothing dual architecture, KEDA scale-to-zero, and TPC-DS benchmark by @vara-bonthu in #1057
  • chore: Remove deprecated blueprints and fix broken docs links by @vara-bonthu in #1015
  • chore: remove deprecated emr-eks-flink blueprint by @vara-bonthu in #1058
  • fix dashboard links by @nabuskey in #1061
  • Update Datafusion Comet results by @nabuskey in #1062
  • fix: drain nodes before terraform destroy to prevent degraded nodes during teardown by @Ignoramuss in #1067
  • chore(deps): bump dompurify from 3.3.3 to 3.4.1 in /website by @dependabot[bot] in #1056
  • chore(deps): bump follow-redirects from 1.15.11 to 1.16.0 in /website by @dependabot[bot] in #1048
  • chore(deps): bump lodash-es and langium in /website by @dependabot[bot] in #1043
  • chore(deps): bump lodash from 4.17.23 to 4.18.1 in /website by @dependabot[bot] in #1042

New Contributors

Full Changelog: v1.2.0...v1.2.1