Support for Accelerated Writes with HDInsight HBase Clusters

[bfg111]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Description

The hdinsight_hbase_cluster resource does not support enabling accelerated writes with HBase

New or Affected Resource(s)

azurerm_hdinsight_hbase_cluster

Potential Terraform Configuration

resource "azurerm_resource_group" "example" {
  name     = "example-resources"
  location = "West Europe"
}

resource "azurerm_storage_account" "example" {
  name                     = "hdinsightstor"
  resource_group_name      = azurerm_resource_group.example.name
  location                 = azurerm_resource_group.example.location
  account_tier             = "Standard"
  account_replication_type = "LRS"
}

resource "azurerm_storage_container" "example" {
  name                  = "hdinsight"
  storage_account_name  = azurerm_storage_account.example.name
  container_access_type = "private"
}

resource "azurerm_hdinsight_hbase_cluster" "example" {
  name                = "example-hdicluster"
  resource_group_name = azurerm_resource_group.example.name
  location            = azurerm_resource_group.example.location
  cluster_version     = "3.6"
  tier                = "Standard"
  accelerated_writes  = "true"

  component_version {
    hbase = "1.1"
  }

  gateway {
    enabled  = true
    username = "acctestusrgw"
    password = "TerrAform123!"
  }

  storage_account {
    storage_container_id = azurerm_storage_container.example.id
    storage_account_key  = azurerm_storage_account.example.primary_access_key
    is_default           = true
  }

  roles {
    head_node {
      vm_size  = "Standard_D3_V2"
      username = "acctestusrvm"
      password = "AccTestvdSC4daf986!"
    }

    worker_node {
      vm_size               = "Standard_D12S_V2"
      username              = "acctestusrvm"
      password              = "AccTestvdSC4daf986!"
      target_instance_count = 3
    }

    zookeeper_node {
      vm_size  = "Standard_D3_V2"
      username = "acctestusrvm"
      password = "AccTestvdSC4daf986!"
    }
  }
}

References

https://docs.microsoft.com/en-us/azure/hdinsight/hbase/apache-hbase-accelerated-writes

[tfproviders]

I have given it a spin and was able to implement the same. Here are the details:

• Terraform Provider - tfproviders/terraform-provider-azurerm
• GitHub Repo - tfproviders/terraform-provider-azurerm

resource "azurerm_hdinsight_hbase_cluster" "example" {
  name                      = "example-hdicluster"
  resource_group_name       = azurerm_resource_group.example.name
  location                  = azurerm_resource_group.example.location
  cluster_version           = "3.6"
  enable_accelerated_writes = true                      # Added in this Fork
  tier                      = "Standard"

  component_version {}
  gateway {}
  storage_account {}
  roles {
    head_node {}
    worker_node {}
    zookeeper_node {}
  }
  enable_disk_encryption {                               # Added in this fork
    using_pmk    = false
    using_cmk_key_url = "https://example.vault.azure.net/keys/xxxxx/xxxxxx"
    msi_resource_id   = "/subscriptions/xxxxxx-xxxxxxx-xxxx-xxxxxxx-xxxxxx/resourcegroups/example/providers/microsoft.managedidentity/userassignedidentities/example-assigned-managed-identity"
  }
}

• enable_accelerated_writes added to enable accelerated writes for HBase clusters, documented here
• enable_disk_encryption {} added to enable encryption at rest for HBase clusters. documented here