Skip to content

v1.0.0

Choose a tag to compare

@github-actions github-actions released this 07 Jan 15:23
· 4 commits to refs/heads/main since this release
0f91681

1.0.0 (2025-01-07)

⚠ BREAKING CHANGES

  • cookbook and customization page improved (awslabs#244)

  • generate documentation with compiled examples (awslabs#235)

  • cookbook and customization page improved (#244) (e54c05d)

  • generate documentation with compiled examples (#235) (e33fcd6)

Features

  • add Athena Workgroup construct (#405) (a65a0b7)
  • add emr on eks managed endpoint support (#357) (9edd7cf)
  • Add EMR Serverless runtimeConf and recent EMR release versions (#313) (84c6f54)
  • add example (3aa220f)
  • add global removal to DataLakeStorage and make it availble cros… (#104) (a57eee3)
  • add vpc creation for EmrSparkServerless runtime (#127) (386b426)
  • Added DataLakeCatalog construct (#115) (fdf0bbf)
  • Allow configuration of number of NAT in DataVpc (#525) (f93ef8a)
  • cdk bump 2.165.0 (#782) (856091a)
  • cdk: bump cdk (#639) (6a90a78)
  • Configure advanced controls for Redshift Serverless Workgroup (#715) (c125c1c)
  • Configure Redshift Serverless to create a final snapshot when stack is deleted (899503f)
  • consumption-opensearch: opensearch api as separate construct (#694) (2fe228f)
  • Create Service Linked Role utility for services used in DSF (#409) (deccb6a)
  • data copy (#292) (638fcc6)
  • DataVpc construct (#283) (dce1deb)
  • deploy client vpn in DataVPC (#416) (b676da1)
  • dsf cr provider (#306) (bfa15c0)
  • expose all resources in constructs and add doc for customization (#240) (4cc0884)
  • governance: add MSK DataZone governance (#738) (8ca011c)
  • governance: msk brokers (#784) (b4705bd)
  • kafka api construct (#540) (4df81b7)
  • kafka-api: Add IAM as Authentication method when creating ACL with kafka api (#655) (9735429)
  • kafka-api: Add support for configEntries (#636) (c34d313)
  • msk 3.7.X support (#667) (8ce1295)
  • msk: Add support for managing cluster policy through the constuct (#696) (9c5d48e)
  • msk: MSK serverless and provisioned construct (#571) (9ef8480)
  • Opensearch construct (#374) (756a69e)
  • processing: bump to karpenter v1 in SparkEmrContainersRuntime (#744) (1bb7372)
  • pyspark app package (#133) (bd283a0)
  • Redshift Data Sharing (#476) (f9c028a)
  • redshift example (#661) (2ac4dc7)
  • redshift-workgroup: Streamlined Redshift Data API. Users can now run custom SQL directly from Workgroup (#579) (1d16f3b)
  • Role as optional props (#262) (5b88058)
  • spark ci cd pipeline (#63) (69ff182)
  • SparkEmrContainers runtime (#191) (b3d82e2)
  • sparkjob construct - clean branch (#132) (272dbcb)
  • streaming-kafka-api: Reuse existing service token on MSK Kafka API (#731) (b842fdc)
  • streaming: Add encryption key to lambda environment for MSK constructs (#756) (fd23ec5)
  • Support for Redshift Serverless, Data API access, and JDBC based Data Catalog (#323) (b4e202a)
  • track version of the construct (#77) (1c44d5a)
  • tracked construct with tags support (#38) (25c8521)

Bug Fixes

  • project rename (#253) (28a96c5)
  • crawlerTableLevelDepth Property in Catalog (#198) (1243173)
  • add dependency on ALB controller for interactive endpoint (#558) (951e7bb)
  • add link to OpenSearch cluster generated doc (#448) (dec15a4)
  • add loggroup name (#255) (d82c691)
  • add optional deps in pyspark packaging (#140) (0f7bcb4)
  • add rm file .jsii.tabl.json for doc generation (#268) (fad3bc5)
  • add security group creation (#380) (179e1d6)
  • adding account and region in default bucket names to avoid name clashes (#144) (b7c7aa9)
  • Allow no policy for SparkEmrServerlessRuntime.createExecRole() (#181) (9da5fdb)
  • aws custom resource sdk bug (#574) (9ea0ad8)
  • change permissions for Glue crawler in DataCatalogDatabase (#423) (9233c39)
  • code examples and enforce validation at build (#199) (a4f8443)
  • Crawler Permissions and Behavior (#163) (ce4e30d)
  • data-catalog-permissions-crawler (#86) (f1136e2)
  • data-lake-example: spark data lake readme (#654) (0d33987)
  • dsfprovider scope (#478) (21465c2)
  • emr-containers: fix iam policy (#727) (3880167)
  • fix SparkCICDPipeline issues (#196) (0bfe2aa)
  • global data removal policy (67c6b61)
  • global data removal policy (#79) (8eba0af)
  • governance-catalog: Default location prefix would use bucket name (#519) (e689c0e)
  • governance: msk data source lambda (#776) (989cd72)
  • improvements in Redshift Data API construct (0788197)
  • kafka-api: Correction e2e (#570) (967f088)
  • kafka-api: modify the fail on checking vpc attribute (#565) (a4db119)
  • non-unique bucket names (#154) (60d6d67)
  • Only create the KMS key when creating the VPC. (#229) (7b3b21c)
  • opensearch api (#500) (b4378c4)
  • os example (#516) (9daa4a9)
  • processing: EMR EKS limitrange and default configs (#794) (9dbee29)
  • processing: fix iam policy for karpenter (6c53ff2)
  • proper project name in code and doc (#257) (362f931)
  • PySparkPackage construct (#533) (0bfea4f)
  • redshift: add Redshift SLR creation (#725) (29c85e0)
  • remove debug loging in opensearch(#477) (72f2ad6)
  • remove previous versions of uniqueHash (#293) (05f8bb7)
  • resolve resource quota issue in spark-containers (#512) (e7099af)
  • restrict invocation permissions on DsfProvider lambdas (#430) (7c90b46)
  • spark data lake example (#175) (ca489c0)
  • spark-cicd: change the git provider in cicd construct (#697) (3356818)
  • SparkEmrContainersRuntime: bump to eks 1.30, karpenter 0.37 and fix critical provisioner configuration (#705) (e29cc45)
  • sparkSparkEmrServerlessJob doesn’t provide the removal_policy parameter (#182) (17c53a4)
  • streaming: add bootstrap server attribute for MskServerless (028c2e8)
  • test stack for SparkCICDPipeline e2e tests (#101) (b8cc2ce)
  • update IAM policy for karpenter (#308) (ee444b8)
  • update Spark Jobs constructs simplified props to strong types (#404) (ddcc669)
  • update spark-cicd api (#159) (1b6539a)
  • vpc logical id naming (#152) (680cbc7)