The objective of this lab is to provide participants solid understanding and experience of developing applications using Azure Synapse. The intended audience for the lab is architects and developers who design, build, and troubleshoot Azure Synapse solutions that meet business and technical requirements. The following are the main topics covered in the lab.
- Data Ingestion and transformation using Synapse Spark
This is a deployment accelerator based on the reference architecture described in the Azure Architecture Center article Analytics end-to-end with Azure Synapse. This deployment accelerator aims to automate not only the deployment of the services covered by the reference architecture, but also to fully automate the configuration and permissions required for the services to work together. The deployed architecture enables the end-to-end analytics platform capable of handling the most common uses cases for most organizations.
The scope of this deployment accelerator is illustrated in the diagram below.
| Name | Type | Default Pricing Tier | Conditional | Notes |
|---|---|---|---|---|
| azsynapsewkssuffix | Synapse workspace | N/A | No | Default workspace deployment doesn't incur costs. |
| SparkCluster | Apache Spark pool | Small (3 nodes) | Yes | |
| EnterpriseDW | Synapse SQL pool | DW100 | Yes | |
| azwksdatalakesuffix | Storage account | Standard LRS | No | |
| azrawdatalakesuffix | Storage account | Standard GRS | No | |
| azcurateddatalakesuffix | Storage account | Standard GRS | No | |
| SynapsePostDeploymentScript | Deployment Script | N/A | No |