copy-azure-blob-powershell.md

title	description	ms.author	author	ms.service	ms.subservice	ms.topic	ms.custom	ms.date
Copy data in the cloud using PowerShell	This PowerShell script copies data from one location in an Azure Blob Storage to another location in the same Blob Storage.	jianleishen	jianleishen	data-factory	data-movement	article	devx-track-azurepowershell	01/05/2024

Use PowerShell to create a data factory pipeline to copy data in the cloud

This sample PowerShell script creates a pipeline in Azure Data Factory that copies data from one location to another location in an Azure Blob Storage.

[!INCLUDE updated-for-az]

[!INCLUDE sample-powershell-install]

Prerequisites

• Azure Storage account. You use the blob storage as both the source and sink data stores. If you don't have an Azure storage account, see the Create a storage account on creating one.
• Create a blob container in Blob Storage, create an input folder in the container, and upload some files to the folder. You can use tools such as Azure Storage Explorer to connect to Azure Blob storage, create a blob container, upload input file, and verify the output file.

Sample script

Important

This script creates JSON files that define Data Factory entities (linked service, dataset, and pipeline) on your hard drive in the c:\ folder.

[!code-powershellmain]

Clean up deployment

After you run the sample script, you can use the following command to remove the resource group and all resources associated with it:

Remove-AzResourceGroup -ResourceGroupName $resourceGroupName

To remove the data factory from the resource group, run the following command:

Remove-AzDataFactoryV2 -Name $dataFactoryName -ResourceGroupName $resourceGroupName

Script explanation

This script uses the following commands:

Command	Notes
New-AzResourceGroup	Creates a resource group in which all resources are stored.
Set-AzDataFactoryV2	Create a data factory.
Set-AzDataFactoryV2LinkedService	Creates a linked service in the data factory. A linked service links a data store or compute to a data factory.
Set-AzDataFactoryV2Dataset	Creates a dataset in the data factory. A dataset represents input/output for an activity in a pipeline.
Set-AzDataFactoryV2Pipeline	Creates a pipeline in the data factory. A pipeline contains one or more activities that perform a certain operation. In this pipeline, a copy activity copies data from one location to another location in an Azure Blob Storage.
Invoke-AzDataFactoryV2Pipeline	Creates a run for the pipeline. In other words, runs the pipeline.
Get-AzDataFactoryV2ActivityRun	Gets details about the run of the activity (activity run) in the pipeline.
Remove-AzResourceGroup	Deletes a resource group including all nested resources.

Related content

For more information on the Azure PowerShell, see Azure PowerShell documentation.

Additional Azure Data Factory PowerShell script samples can be found in the Azure Data Factory PowerShell samples.