| title | titleSuffix | description | ms.service | ms.topic | author | ms.author | ms.date |
|---|---|---|---|---|---|---|---|
Add a Kubernetes secret to pull an image from a private container registry |
Azure Data Factory |
This article explains how to add a Kubernetes secret to pull a custom image from a private container registry with Workflow Orchestration Manager in Data Factory for Microsoft Fabric. |
data-factory |
how-to |
nabhishek |
abnarain |
08/30/2023 |
[!INCLUDEappliesto-adf-xxx-md]
This article explains how to add a Kubernetes secret to pull a custom image from a private Azure Container Registry within the Azure Data Factory Workflow Orchestration Manager environment.
Note
Workflow Orchestration Manager for Azure Data Factory relies on the open-source Apache Airflow application. You can find documentation and more tutorials for Airflow on the Apache Airflow Documentation or Community webpages.
- Azure subscription: If you don't have an Azure subscription, create a free Azure account before you begin.
- Azure Storage account: If you don't have a storage account, see Create an Azure Storage account for steps to create one. Ensure the storage account allows access only from selected networks.
- Azure Container Registry: Configure an Azure Container Registry with the custom Docker image you want to use in the directed acyclic graph (DAG). For more information on push and pull container images, see Push and pull container image - Azure Container Registry.
Open Azure Data Factory Studio and on the toolbar on the left, select the Manage tab. Then under Workflow orchestration manager, select Apache Airflow. Finally, select + New to create a new Workflow Orchestration Manager environment.
:::image type="content" source="media/kubernetes-secret-pull-image-from-private-container-registry/create-new-airflow-environment.png" alt-text="Screenshot that shows the steps to create a new Workflow Orchestration Manager environment in Azure Data Factory Studio." lightbox="media/kubernetes-secret-pull-image-from-private-container-registry/create-new-airflow-environment.png":::
On the Airflow environment setup window, scroll to the bottom and expand the Advanced section. Then under Kubernetes secrets, select + New.
:::image type="content" source="media/kubernetes-secret-pull-image-from-private-container-registry/add-kubernetes-secret.png" alt-text="Screenshot that shows the Airflow environment setup window with the Advanced section expanded to show the Kubernetes secrets section." lightbox="media/kubernetes-secret-pull-image-from-private-container-registry/add-kubernetes-secret.png":::
Provide the required field Secret name. For Secret type, select Private registry auth. Then enter information in the other required fields. The Registry server URL should be the URL of your private container registry, for example, \registry_name\>.azurecr.io.
:::image type="content" source="media/kubernetes-secret-pull-image-from-private-container-registry/create-airflow-secret.png" alt-text="Screenshot that shows the Create airflow secret window and its fields." lightbox="media/kubernetes-secret-pull-image-from-private-container-registry/create-airflow-secret.png" :::
After you enter information in the required fields, select Apply to add the secret.