Intel® Cloud Optimization Modules for Terraform

© Copyright 2022, Intel Corporation

Azure Databricks

The module can deploy an Intel Optimized Azure Databricks Workspace.

Learn more about optimizations :

Performance Data

Reduce Time to Decision With the Databricks Lakehouse Platform and Latest Intel 3rd Gen Xeon Scalable Processors

Up to 3.0x price/performance benefits and 6.7x the speed up on Azure Edsv5

Accelerating Azure Databricks Runtime for Machine Learning

Usage

See examples folder for code ./examples/terraform-intel-azure-databricks/main.tf

Example of main.tf

# Provision Intel Cloud Optimization Module

module "module-example" {
  source                  = "intel/azure-databricks-workspace/intel"
  resource_group_name     = <"ENTER_YOUR_RESOURCE_GROUP_NAME">                #Required. Enter an pre-existing resource group you want Azure Databricks Workspace to deploy in
  dbx_workspace_name      = <"NAME_YOUR_DATABRICKS_WORKSPACE">                #Required. Enter a name for your Azure Databricks Workspace

}

Run Terraform

terraform init  
terraform plan
terraform apply

Note that this example may create resources. Run terraform destroy when you don't need these resources anymore.

Considerations

More Information regarding deploying Azure Databricks Workspace

More Information regarding deploying and Managing Databricks

Requirements

Name	Version
azurerm	~> 3.48
databricks	~> 1.14.2
random	~> 3.4.3

Providers

Name	Version
azurerm	~> 3.48
databricks	~> 1.14.2
random	~> 3.4.3

Modules

No modules.

Resources

Name	Type
azurerm_databricks_workspace.az-databricks	resource
databricks_global_init_script.intel_optimized_script	resource
random_string.naming	resource
azurerm_resource_group.databricks	data source
azurerm_subnet.dbx-private	data source
azurerm_subnet.dbx-public	data source
azurerm_virtual_network.dbx-vnet	data source

Inputs

Name	Description	Type	Default	Required
dbx_network_security_group_rules_required	Does the data plane (clusters) to control plane communication happen over private link endpoint only or publicly? Possible values AllRules, NoAzureDatabricksRules or NoAzureServiceRules. Required when public_network_access_enabled is set to false.	string	"AllRules"	no
dbx_no_public_ip	Are public IP Addresses not allowed? Possible values are true or false. Defaults to false.	bool	false	no
dbx_private_subnet	Name of the private subnet in your virtual network for your Databricks worskpace. Required only if you like to use your own virtual network else it will be on a databricks network	string	""	no
dbx_public_network_access_enabled	Allow public access for accessing workspace. Set value to false to access workspace only via private link endpoint. Possible values include true or false. Defaults to true.	bool	true	no
dbx_public_subnet	Name of the public subnet in your virtual network for your Databricks worskpace. Required only if you like to use your own virtual network else it will be on a databricks network	string	""	no
dbx_sku	The sku to use for the Databricks Workspace. Possible values are standard, premium, or trial.	string	"premium"	no
dbx_vnet	Name of the virtual network for your Databricks worskpace. Required only if you like to use your own virtual network else it will be on a databricks network	string	""	no
dbx_workspace_name	Name of the databricks workspace that will be created.	string	n/a	yes
enable_intel_tags	If true adds additional Intel tags to resources	bool	true	no
intel_tags	Intel Tags	map(string)	{ "intel-module": "terraform-intel-azure-databricks-workspace", "intel-registry": "https://registry.terraform.io/namespaces/intel" }	no
resource_group_name	Existing Resource Group where databricks reosurce will be created.	string	n/a	yes
tags	Tags to apply to the Databricks Workspace	map(string)	{}	no

Outputs

Name	Description
dbx_custom_parameters	Custom parameter block of the databricks workspace
dbx_location	Location of the databricks workspace
dbx_network_security_group_rules_required	NSG outbound rules of the databricks workspace
dbx_public_network_access_enabled	Public Network access enabled of the databricks workspace
dbx_resource_group_name	Name of the Resource group of databricks workspace
dbx_sku	Sku tier of the databricks workspace
dbx_workspace_name	Name of the databricks workspace
dbx_workspace_url	URL of the databricks workspace