v2.0.0-beta1

Beta pre-release of version 2.0.0, focused on the refactor to modularize data.all. This version includes a modularized backend but not yet a modularized front-end, which will be published with the final release.

⚠️ We recommend installing this release from scratch instead of upgrading an existing system, since this is a pre-production release.

⚠️ WARNING If upgrading, do so from version 1.6.2.

Known issues affecting deployment

In the deployment guide, run step 8 before step 5, then continue from step 5. This is needed because data.all uses the cdk look up roles in CDK synth, which requires bootstrapping the accounts before running cdk synth locally. Documentation will be updated for the final release.

Known issues

• #556 Request for share is being sent for invalid environment (CREATE_FAILED)
• #540 OpenSearch stack failed during backend deploy due to length of policy name
• #534 Catalog Search along with filters
• #533 Profille Job run fails
• #428 Prefix crawling is crawling complete bucket instead of specific folder
• #374 Error in Monitoring tab in Admin Settings
• #338 Import of Dashboard / Dataset - Environment selection drop-down list is limited to 5 environments
• #288 Can't Paginate to view all Folders
• #625 CDK execution role (custom template) throws S3 access denied error for pivotRole auto-created nested stack
• Denied share requests show the wrong message to the asking user: approved instead of denied (no effect on actual sharing)
• Logging of approvals for sharing shows AWSResourceNotFound for some approvals
• There is an issue when user creates a dataset he/she can’t upload the data using UPLOAD button. We are facing CORS error which disappears after some time
• After creating a dataset, a user may temporarily be unable to upload data using the UPLOAD button

What's Changed

• sync modularization main (frontend) with main by @AmrSaber in #395
• modularization: backend Pluginarchitecture by @nikpodsh in #359
• frontend: simplify dev dockerfile by @AmrSaber in #396
• frontend: make styling consistent and remove dead code by @AmrSaber in #394
• ignore styling commits in git blame by @AmrSaber in #405
• modularization: Dataset Modularization pt.1 by @nikpodsh in #413
• modularization: Datasets modularization pt.2 by @nikpodsh in #432
• modularization: Datasets modularization pt.3 by @nikpodsh in #440
• modularization: Datasets modularization pt.4 by @nikpodsh in #441
• modularization: Datasets modularization pt.5 by @nikpodsh in #442
• modularization: Module dependencies by @nikpodsh in #447
• modularization: Worksheets modularization by @dbalintx in #449
• modularization: Merge from main V1.5.2 to the modularization branch by @nikpodsh in #463
• modularization: MLstudio modularization by @dlpzx in #486
• modularization: testing extensions by @dlpzx in #518
• modularization: Disable and skip module test directories for modules that are inactive by @nikpodsh in #522
• modularization: Dataset Sharing modularization by @nikpodsh in #488
• modularization: Datapipelines modularization by @dbalintx in #457
• Dashboard modularization by @nikpodsh in #537
• feat: Redshift removal by @dbalintx in #551
• Fix methods without permissions by @nikpodsh in #547
• feat:increase memory limit for local frontend container by @dbalintx in #568
• Change the pipeline for the modularization by @nikpodsh in #545
• Add generic way to toggle data.all features by @blitzmohit in #538
• Refactoring of aws calls by @nikpodsh in #550
• Migrate to a new permission checker by @nikpodsh in #569
• Core modularization by @nikpodsh in #592
• Merge main into modularization-main branch by @nikpodsh in #595
• Resolve modularization inconsistencies by @dbalintx in #605
• Modularization-main bugfixes by @dbalintx in #604
• Frontend - Module Enablement by @itsmo-amzn in #602
• Fixing of linting error by @nikpodsh in #627
• Fix assume role for the fresh account by @nikpodsh in #628

New Contributors

• @blitzmohit made their first contribution in #538

Full Changelog: v1.6.1...v2.0.0-beta1