Repository navigation
What's Changed
- docs: How to retrieve Argo Workflow WebUI url by @berry2012 in #873
- docs: Adding Spark Best Practices with new guidelines by @arunnalpet in #856
- feat: Datahub upgrade and security patch by @bbgu1 in #871
- feat: Add Ray Data Spark logs processing example with Apache Iceberg by @ratnopam in #877
- docs: Update website doc to link to the blueprint by @ratnopam in #878
- feat: Spark on EKS Blueprint Update by @vara-bonthu in #880
- fix: Add shs helm provisioning timeout by @ratnopam in #881
- feat: Deploying gp3 storage class before the addons to avoud race condition by @vara-bonthu in #883
- feat: Added bedrock IAM policy to JupyterHub Notebooks by @vara-bonthu in #884
- fix: Add sonnet perms by @nabuskey in #886
- fix: Fix tf lint by @nabuskey in #887
- feat: VPC Module update to create subnets dynamically for AZ = 2 to 4 by @vara-bonthu in #889
- fix: Add spark history server enable variable by @ratnopam in #882
- chore: Pin IRSA module version by @alanty in #893
- docs: Added Spark workshop links to Website homepage by @vara-bonthu in #896
- feat: Add Example for Apache Beam on Spark on EKS by @bbgu1 in #852
- fix: Airflow SSH Key Fixes by @jagpk in #898
- feat: Kafka cluster validation script by @saiteja313 in #850
- chore(deps): bump tar-fs from 3.0.9 to 3.1.1 in /website by @dependabot[bot] in #902
- feat: Version upgrade for EMR / Flink and adding autoscaler example by @bbgu1 in #897
- docs: Update EMR on EKS with Flink Streaming documentation by @Eriall1 in #900
- refactor: CNPG on EKS bug fixes, documentation updates by @reverse in #899
- feat: TPCDS Benchmarks for "Spark + Gluten +Velox" Vs Native Spark by @vara-bonthu in #903
- feat: Security fix and pre-commit fixes by @vara-bonthu in #906
- fix: Improve install/cleanup dependencies. by @alanty in #901
- fix: Upstream CSI Driver issues by @meetreks in #910
- feat: Add celeborn benchmark by @nabuskey in #918
- chore(deps-dev): bump js-yaml from 4.1.0 to 4.1.1 in /website by @dependabot[bot] in #914
- chore(deps): bump node-forge from 1.3.1 to 1.3.2 in /website by @dependabot[bot] in #919
- chore(deps): bump brotli from 1.1.0 to 1.2.0 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #916
- fix: Update github actions to publish the website by @vara-bonthu in #920
- fix: Spelling and grammar errors by @vara-bonthu in #921
- chore(deps): bump werkzeug from 3.1.3 to 3.1.4 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #923
- chore(deps): bump mdast-util-to-hast from 13.2.0 to 13.2.1 in /website by @dependabot[bot] in #922
- fix: Update celeborn benchmark with more data by @nabuskey in #932
- chore(deps): bump urllib3 from 2.5.0 to 2.6.3 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #930
- chore(deps): bump werkzeug from 3.1.4 to 3.1.5 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #931
- feat: Data on EKS v2 by @nabuskey in #935
- fix: Update website release build directory by @nabuskey in #940
- chore(deps): bump urllib3 from 2.5.0 to 2.6.3 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #939
- chore(deps): bump pydantic from 2.0.3 to 2.4.0 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #938
- chore(deps): bump pyasn1 from 0.6.1 to 0.6.2 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #937
- chore(deps): bump werkzeug from 3.1.3 to 3.1.5 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #936
- chore(deps): bump pyasn1 from 0.6.1 to 0.6.2 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #933
- chore(deps): bump apache-airflow from 3.1.0 to 3.1.6 in /data-stacks/airflow-on-eks/examples/dag-bundles by @dependabot[bot] in #944
- chore(deps): bump brotli from 1.1.0 to 1.2.0 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #942
- chore(deps): bump urllib3 from 2.5.0 to 2.6.3 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #941
- fix: Update python packages by @nabuskey in #948
- chore(deps): bump urllib3 from 2.5.0 to 2.6.3 in /data-stacks/airflow-on-eks/examples/dag-bundles by @dependabot[bot] in #946
- fix: Fix datahub link by @nabuskey in #951
- chore(deps): bump requests from 2.32.3 to 2.32.4 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #943
- chore(deps): bump aiohttp from 3.13.1 to 3.13.3 in /data-stacks/airflow-on-eks/examples/dag-bundles by @dependabot[bot] in #947
- chore(deps): bump starlette from 0.48.0 to 0.49.1 in /data-stacks/airflow-on-eks/examples/dag-bundles by @dependabot[bot] in #949
- chore(deps): bump requests from 2.32.3 to 2.32.4 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #950
- chore(deps): bump lodash from 4.17.21 to 4.17.23 in /website by @dependabot[bot] in #952
- chore(deps): bump apache-airflow from 3.1.0 to 3.1.6 in /data-stacks/airflow-on-eks/examples/dag-bundles by @dependabot[bot] in #955
- feat: Add Pinot data stack by @nabuskey in #954
- chore: Remove pinot blueprint by @nabuskey in #956
- doc: Add documentation for NAU by @nabuskey in #958
- fix: Fix trailing whitespace by @nabuskey in #967
- fix: Fix home page links by @nabuskey in #962
- fix: Fix box overflow by @nabuskey in #959
- chore: Remove superset on eks blueprint by @nabuskey in #966
- chore: Remove datahub on eks blueprint by @nabuskey in #965
- chore: Remove spark ipv6 blueprint by @nabuskey in #964
- fix: Update SHS memory allocation by @nabuskey in #976
- fix: Add fernet key for airflow by @nabuskey in #977
- chore: Upgrade karpenter by @nabuskey in #978
- chore(deps): bump protobuf from 5.29.5 to 5.29.6 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #969
- feat: Add celeborn best practices by @nabuskey in #980
- feat: Add datafusion comet benchmark results by @nabuskey in #975
- chore(deps): bump flask from 3.1.1 to 3.1.3 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #982
- chore(deps): bump flask from 3.1.1 to 3.1.3 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #984
- chore(deps): bump werkzeug from 3.1.5 to 3.1.6 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #983
- chore(deps): bump werkzeug from 3.1.5 to 3.1.6 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #981
- feat: Rapids TPCDS test updates with GPU Operator by @vara-bonthu in #988
- fix: Remove trino blueprint by @nabuskey in #992
- fix: Remove Flink blueprint by @nabuskey in #993
- fix: Use irsa for celeborn by @nabuskey in #990
- feat: EKS PCP tiers added, VPC modified to support 120k IPs per AZ by @vara-bonthu in #989
- fix: lint EOL by @nabuskey in #999
- fix: Shorten shs role name by @nabuskey in #1004
- fix: Pin celeborn to version 6.2.0 by @nabuskey in #1003
- fix: Remove cloud native postgresql by @nabuskey in #996
- chore(deps): bump pyjwt from 2.10.1 to 2.12.0 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #991
- chore(deps): bump orjson from 3.11.3 to 3.11.6 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #987
- chore(deps): bump pyasn1 from 0.6.2 to 0.6.3 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #995
- fix: Remove kafka blueprint by @nabuskey in #997
- fix: Remove nifi blueprint by @nabuskey in #1000
- chore(deps): bump pyasn1 from 0.6.2 to 0.6.3 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #994
- chore(deps): bump minimatch, serve-handler and serve in /website by @dependabot[bot] in #1001
- fea: Add initial clickhouse stack by @nabuskey in #1005
- fix: Remove spark streaming blueprint by @nabuskey in #998
- fix: Conditionally create irsa for celeborn by @nabuskey in #1006
- Add s3 express vpc endpoint by @nabuskey in #1011
- Update monitoring namespace and versions by @nabuskey in #1012
- Remove argo workflows by @nabuskey in #1010
- Update docs with monitoring namespace changes by @nabuskey in #1013
- feat: Fixed all the security vulnerabilities by @vara-bonthu in #1014
- pin all GH actions to commit hashes by @nabuskey in #1016
- Add celeborn 10tb results by @nabuskey in #1009
- feat: improve resource clean up by @shvbsle in #1023
- chore(deps): bump requests from 2.32.4 to 2.33.0 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #1018
- chore(deps): bump picomatch from 2.3.1 to 2.3.2 in /website by @dependabot[bot] in #1019
- chore(deps): bump requests from 2.32.3 to 2.33.0 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #1020
- chore(deps): bump requests from 2.32.5 to 2.33.0 in /data-stacks/workshop/src/data-flow by @dependabot[bot] in #1021
- chore(deps): bump node-forge from 1.3.2 to 1.4.0 in /website by @dependabot[bot] in #1024
- chore(deps): bump brace-expansion from 1.1.12 to 1.1.13 in /website by @dependabot[bot] in #1025
- chore(deps): bump path-to-regexp from 0.1.12 to 0.1.13 in /website by @dependabot[bot] in #1028
- do not run install scripts, set min release age to 10 days by @nabuskey in #1029
- remove eks resources before vpc by @nabuskey in #1030
- Add ClickHouse-based event store for K8s events and Spark application logs by @nabuskey in #1032
- feat: Add Celeborn rolling restart validation and production best practices by @vara-bonthu in #1026
- chore: Update paths-filter GitHub Action to 4.0.1 by @nabuskey in #1034
- update spark applciations to use json logging by @nabuskey in #1033
- chore: Udpate node to 24 by @nabuskey in #1035
- fix: Update git repository refs by @nabuskey in #1036
- fix: Increase memory for Spark History Server by @nabuskey in #1039
- feat: Preventing Spark OOM kills best practices by @vara-bonthu in #1041
- fix: Return ipv4 DNS records for ipv4 clusters by @nabuskey in #1045
- feat: Adding Starrocks data stack by @hitsub2 in #1044
- feat: Emr-Eks-Flink by @bbgu1 in #1047
- chore(deps): bump python-dotenv from 1.0.1 to 1.2.2 in /data-stacks/spark-on-eks/benchmarks/spark-operator-benchmarks by @dependabot[bot] in #1052
- chore(deps): bump python-dotenv from 1.0.1 to 1.2.2 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in #1051
- Update logging infra and configurations for k8s events and spark by @nabuskey in #1053
- Enable cgroupv2 by @nabuskey in #1054
- feat(starrocks): add shared-data/shared-nothing dual architecture, KEDA scale-to-zero, and TPC-DS benchmark by @vara-bonthu in #1057
- chore: Remove deprecated blueprints and fix broken docs links by @vara-bonthu in #1015
- chore: remove deprecated emr-eks-flink blueprint by @vara-bonthu in #1058
- fix dashboard links by @nabuskey in #1061
- Update Datafusion Comet results by @nabuskey in #1062
- fix: drain nodes before terraform destroy to prevent degraded nodes during teardown by @Ignoramuss in #1067
- chore(deps): bump dompurify from 3.3.3 to 3.4.1 in /website by @dependabot[bot] in #1056
- chore(deps): bump follow-redirects from 1.15.11 to 1.16.0 in /website by @dependabot[bot] in #1048
- chore(deps): bump lodash-es and langium in /website by @dependabot[bot] in #1043
- chore(deps): bump lodash from 4.17.23 to 4.18.1 in /website by @dependabot[bot] in #1042
New Contributors
- @arunnalpet made their first contribution in #856
- @saiteja313 made their first contribution in #850
- @Eriall1 made their first contribution in #900
- @reverse made their first contribution in #899
- @shvbsle made their first contribution in #1023
- @Ignoramuss made their first contribution in #1067
Full Changelog: v1.2.0...v1.2.1