Skip to content

Latest commit

 

History

History
67 lines (51 loc) · 2.63 KB

metastore.md

File metadata and controls

67 lines (51 loc) · 2.63 KB
Raw
subcategory
Unity Catalog

databricks_metastore Resource

-> Notes Unity Catalog APIs are accessible via workspace-level APIs. This design may change in the future.

A metastore is the top-level container of objects in Unity Catalog. It stores data assets (tables and views) and the permissions that govern access to them. Databricks account admins can create metastores and assign them to Databricks workspaces in order to control which workloads use each metastore.

Unity Catalog offers a new metastore with built in security and auditing. This is distinct to the metastore used in previous versions of Databricks (based on the Hive Metastore).

Example Usage

For AWS

resource "databricks_metastore" "this" {
  name          = "primary"
  storage_root  = "s3://${aws_s3_bucket.metastore.id}/metastore"
  owner         = "uc admins"
  force_destroy = true
}

resource "databricks_metastore_assignment" "this" {
  metastore_id = databricks_metastore.this.id
  workspace_id = local.workspace_id
}

For Azure

resource "databricks_metastore" "this" {
  name = "primary"
  storage_root = format("abfss://%s@%s.dfs.core.windows.net/",
    azurerm_storage_container.unity_catalog.name,
  azurerm_storage_account.unity_catalog.name)
  owner         = "uc admins"
  force_destroy = true
}

resource "databricks_metastore_assignment" "this" {
  metastore_id = databricks_metastore.this.id
  workspace_id = local.workspace_id
}

Argument Reference

The following arguments are required:

  • name - Name of metastore.
  • storage_root - Path on cloud storage account, where managed databricks_table are stored. Change forces creation of a new resource.
  • owner - (Optional) Username/groupname/sp application_id of the metastore owner.
  • delta_sharing_scope - (Optional) Required along with delta_sharing_recipient_token_lifetime_in_seconds. Used to enable delta sharing on the metastore. Valid values: INTERNAL, INTERNAL_AND_EXTERNAL.
  • delta_sharing_recipient_token_lifetime_in_seconds - (Optional) Required along with delta_sharing_scope. Used to set expiration duration in seconds on recipient data access tokens. Set to 0 for unlimited duration.
  • delta_sharing_organization_name - (Optional) The organization name of a Delta Sharing entity. This field is used for Databricks to Databricks sharing. Once this is set it cannot be removed and can only be modified to another valid value. To delete this value please taint and recreate the resource.
  • force_destroy - (Optional) Destroy metastore regardless of its contents.

Import

This resource can be imported by ID:

terraform import databricks_metastore.this <id>