Repository navigation
v1.0.0
·
4 commits
to refs/heads/main
since this release
1.0.0 (2025-01-07)
⚠ BREAKING CHANGES
-
cookbook and customization page improved (awslabs#244)
-
generate documentation with compiled examples (awslabs#235)
-
generate documentation with compiled examples (#235) (e33fcd6)
Features
- add Athena Workgroup construct (#405) (a65a0b7)
- add emr on eks managed endpoint support (#357) (9edd7cf)
- Add EMR Serverless runtimeConf and recent EMR release versions (#313) (84c6f54)
- add example (3aa220f)
- add global removal to DataLakeStorage and make it availble cros… (#104) (a57eee3)
- add vpc creation for EmrSparkServerless runtime (#127) (386b426)
- Added DataLakeCatalog construct (#115) (fdf0bbf)
- Allow configuration of number of NAT in DataVpc (#525) (f93ef8a)
- cdk bump 2.165.0 (#782) (856091a)
- cdk: bump cdk (#639) (6a90a78)
- Configure advanced controls for Redshift Serverless Workgroup (#715) (c125c1c)
- Configure Redshift Serverless to create a final snapshot when stack is deleted (899503f)
- consumption-opensearch: opensearch api as separate construct (#694) (2fe228f)
- Create Service Linked Role utility for services used in DSF (#409) (deccb6a)
- data copy (#292) (638fcc6)
- DataVpc construct (#283) (dce1deb)
- deploy client vpn in DataVPC (#416) (b676da1)
- dsf cr provider (#306) (bfa15c0)
- expose all resources in constructs and add doc for customization (#240) (4cc0884)
- governance: add MSK DataZone governance (#738) (8ca011c)
- governance: msk brokers (#784) (b4705bd)
- kafka api construct (#540) (4df81b7)
- kafka-api: Add IAM as Authentication method when creating ACL with kafka api (#655) (9735429)
- kafka-api: Add support for configEntries (#636) (c34d313)
- msk 3.7.X support (#667) (8ce1295)
- msk: Add support for managing cluster policy through the constuct (#696) (9c5d48e)
- msk: MSK serverless and provisioned construct (#571) (9ef8480)
- Opensearch construct (#374) (756a69e)
- processing: bump to karpenter v1 in SparkEmrContainersRuntime (#744) (1bb7372)
- pyspark app package (#133) (bd283a0)
- Redshift Data Sharing (#476) (f9c028a)
- redshift example (#661) (2ac4dc7)
- redshift-workgroup: Streamlined Redshift Data API. Users can now run custom SQL directly from Workgroup (#579) (1d16f3b)
- Role as optional props (#262) (5b88058)
- spark ci cd pipeline (#63) (69ff182)
- SparkEmrContainers runtime (#191) (b3d82e2)
- sparkjob construct - clean branch (#132) (272dbcb)
- streaming-kafka-api: Reuse existing service token on MSK Kafka API (#731) (b842fdc)
- streaming: Add encryption key to lambda environment for MSK constructs (#756) (fd23ec5)
- Support for Redshift Serverless, Data API access, and JDBC based Data Catalog (#323) (b4e202a)
- track version of the construct (#77) (1c44d5a)
- tracked construct with tags support (#38) (25c8521)
Bug Fixes
- project rename (#253) (28a96c5)
crawlerTableLevelDepthProperty in Catalog (#198) (1243173)- add dependency on ALB controller for interactive endpoint (#558) (951e7bb)
- add link to OpenSearch cluster generated doc (#448) (dec15a4)
- add loggroup name (#255) (d82c691)
- add optional deps in pyspark packaging (#140) (0f7bcb4)
- add rm file .jsii.tabl.json for doc generation (#268) (fad3bc5)
- add security group creation (#380) (179e1d6)
- adding account and region in default bucket names to avoid name clashes (#144) (b7c7aa9)
- Allow no policy for SparkEmrServerlessRuntime.createExecRole() (#181) (9da5fdb)
- aws custom resource sdk bug (#574) (9ea0ad8)
- change permissions for Glue crawler in DataCatalogDatabase (#423) (9233c39)
- code examples and enforce validation at build (#199) (a4f8443)
- Crawler Permissions and Behavior (#163) (ce4e30d)
- data-catalog-permissions-crawler (#86) (f1136e2)
- data-lake-example: spark data lake readme (#654) (0d33987)
- dsfprovider scope (#478) (21465c2)
- emr-containers: fix iam policy (#727) (3880167)
- fix SparkCICDPipeline issues (#196) (0bfe2aa)
- global data removal policy (67c6b61)
- global data removal policy (#79) (8eba0af)
- governance-catalog: Default location prefix would use bucket name (#519) (e689c0e)
- governance: msk data source lambda (#776) (989cd72)
- improvements in Redshift Data API construct (0788197)
- kafka-api: Correction e2e (#570) (967f088)
- kafka-api: modify the fail on checking vpc attribute (#565) (a4db119)
- non-unique bucket names (#154) (60d6d67)
- Only create the KMS key when creating the VPC. (#229) (7b3b21c)
- opensearch api (#500) (b4378c4)
- os example (#516) (9daa4a9)
- processing: EMR EKS limitrange and default configs (#794) (9dbee29)
- processing: fix iam policy for karpenter (6c53ff2)
- proper project name in code and doc (#257) (362f931)
- PySparkPackage construct (#533) (0bfea4f)
- redshift: add Redshift SLR creation (#725) (29c85e0)
- remove debug loging in opensearch(#477) (72f2ad6)
- remove previous versions of uniqueHash (#293) (05f8bb7)
- resolve resource quota issue in spark-containers (#512) (e7099af)
- restrict invocation permissions on DsfProvider lambdas (#430) (7c90b46)
- spark data lake example (#175) (ca489c0)
- spark-cicd: change the git provider in cicd construct (#697) (3356818)
- SparkEmrContainersRuntime: bump to eks 1.30, karpenter 0.37 and fix critical provisioner configuration (#705) (e29cc45)
- sparkSparkEmrServerlessJob doesn’t provide the removal_policy parameter (#182) (17c53a4)
- streaming: add bootstrap server attribute for MskServerless (028c2e8)
- test stack for SparkCICDPipeline e2e tests (#101) (b8cc2ce)
- update IAM policy for karpenter (#308) (ee444b8)
- update Spark Jobs constructs simplified props to strong types (#404) (ddcc669)
- update spark-cicd api (#159) (1b6539a)
- vpc logical id naming (#152) (680cbc7)