Terraform AZURE DATA FACTORY

Terraform module to create data factory resource on AZURE.

---

We eat, drink, sleep and most importantly love DevOps. We are working towards strategies for standardizing architecture while ensuring security for the infrastructure. We are strong believer of the philosophy Bigger problems are always solved by breaking them into smaller manageable problems. Resonating with microservices architecture, it is considered best-practice to run database, cluster, storage in smaller connected yet manageable pieces within the infrastructure.

This module is basically combination of Terraform open source and includes automatation tests and examples. It also helps to create and improve your infrastructure with minimalistic code instead of maintaining the whole infrastructure code yourself.

We have fifty plus terraform modules. A few of them are comepleted and are available for open source usage while a few others are in progress.

Prerequisites

This module has a few dependencies:

Examples

IMPORTANT: Since the master branch used in source varies based on new modifications, we suggest that you use the release versions here.

Simple Example

Here is an example of how you can use this module in your inventory structure:

default data factory

  module "data_factory" {
    depends_on                = [module.resource_group]
    source                    = "clouddrove/data-factory/azure"
    name                      = "app"
    environment               = "test"
    resource_group_name       = module.resource_group.resource_group_name
    location                  = module.resource_group.resource_group_location

Inputs

Name	Description	Type	Default	Required
application	Application (e.g. cd or clouddrove).	string	""	no
cmk_encryption_enabled	n/a	bool	false	no
create	Used when creating the Resource Group.	string	"60m"	no
delete	Used when deleting the Resource Group.	string	"60m"	no
enable_private_endpoint	enable or disable private endpoint to storage account	bool	false	no
enabled	Flag to control the module creation.	bool	true	no
environment	Environment (e.g. prod, dev, staging).	string	""	no
existing_private_dns_zone	Name of the existing private DNS zone	string	null	no
existing_private_dns_zone_resource_group_name	The name of the existing resource group	string	""	no
identity_ids	Specifies a list of User Assigned Managed Identity IDs to be assigned to this Storage Account.	list(string)	null	no
identity_type	Specifies the type of Managed Service Identity that should be configured on this Storage Account. Possible values are SystemAssigned, UserAssigned, SystemAssigned, UserAssigned (to enable both).	string	"SystemAssigned"	no
key_vault_id	n/a	string	null	no
label_order	Label order, e.g. name,application.	list(any)	[ "name", "environment" ]	no
location	Location where resource should be created.	string	""	no
machine_count	Number of Virtual Machines to create.	number	0	no
managed_virtual_network_enabled	Is default virtual machine enabled for data factory or not.	bool	null	no
managedby	ManagedBy, eg 'CloudDrove' or 'AnmolNagpal'.	string	"anmol@clouddrove.com"	no
name	Name (e.g. app or cluster).	string	""	no
principal_id	The ID of the Principal (User, Group or Service Principal) to assign the Role Definition to. Changing this forces a new resource to be created.	list(string)	[]	no
private_dns_zone_name	The name of the private dns zone name which will used to create private endpoint link.	string	"privatelink.blob.core.windows.net"	no
public_network_enabled	Is the Data Factory visible to the public network? Defaults to true.	bool	false	no
read	Used when retrieving the Resource Group.	string	"5m"	no
repository	Terraform current module repo	string	""	no
resource_group_name	The name of the resource group in which to create the virtual network.	string	""	no
shared_access_key_enabled	Indicates whether the storage account permits requests to be authorized with the account access key via Shared Key. If false, then all requests, including shared access signatures, must be authorized with Azure Active Directory (Azure AD). The default value is true.	bool	true	no
subnet_id	The resource ID of the subnet	string	""	no
tags	Additional tags (e.g. map(BusinessUnit,XYZ).	map(any)	{}	no
update	Used when updating the Resource Group.	string	"60m"	no
virtual_network_id	The name of the virtual network	string	""	no

Outputs

Name	Description
id	n/a
identity	n/a

Testing

In this module testing is performed with terratest and it creates a small piece of infrastructure, matches the output like ARN, ID and Tags name etc and destroy infrastructure in your AWS account. This testing is written in GO, so you need a GO environment in your system.

You need to run the following command in the testing folder:

  go test -run Test

Feedback

If you come accross a bug or have any feedback, please log it in our issue tracker, or feel free to drop us an email at hello@clouddrove.com.

If you have found it worth your time, go ahead and give us a ★ on our GitHub!

About us

At CloudDrove, we offer expert guidance, implementation support and services to help organisations accelerate their journey to the cloud. Our services include docker and container orchestration, cloud migration and adoption, infrastructure automation, application modernisation and remediation, and performance engineering.

We are The Cloud Experts!

---

We ❤️ Open Source and you can check out our other modules to get help with your new Cloud ideas.