Skip to content
The new Azure Storage data transfer utility - AzCopy v10
Go Python
Branch: master
Clone or download
zezha-msft Merge pull request #705 from lesterw1/patch-1
Add binary download location link to README.md
Latest commit 0eab945 Oct 21, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github Added issue template Sep 17, 2018
azbfs Move to single logging policy (#647) Oct 4, 2019
cmd Fix/extra warnings for parameter changes (#695) Oct 17, 2019
common Bumped version for 10.3.1 and added changelog entry Oct 17, 2019
ste Write x-ms-request-id into the abbreviated logging for successful ope… Oct 17, 2019
testSuite Minor fix to enable S3 smoke tests if S3_TESTS_OFF is present but empty Oct 17, 2019
.gitignore Fix/too many open files in download (#276) Mar 20, 2019
CODE_OF_CONDUCT.md Added Code of Conduct (#605) Sep 24, 2019
ChangeLog.md Bumped version for 10.3.1 and added changelog entry Oct 17, 2019
LICENSE Added skeleton frontend which can generate job parts in JSON format Dec 20, 2017
README.md Add binary download location link to README.md Oct 20, 2019
ThirdPartyNotice.txt Updated thirdpartynotice file (#613) Oct 10, 2019
azure-pipelines.yml Fix dependency for distributed mutex Oct 7, 2019
go.mod Added support for sync File -> File (#600) Sep 28, 2019
go.sum Final set of edits to in-app help strings (#643) Oct 10, 2019
main.go Make rand seeding clearer and predictable (#620) Sep 30, 2019
main_unix.go S2S refactor (S3, File, Blob -> Blob) (#565) Sep 17, 2019
main_windows.go Create a log file even when there's nothing to do (#566) Sep 17, 2019
readme-command-prompt.png Added SPN authentication & relevant in-depth documentation. (#383) Jun 28, 2019
tool_clean.sh 10.0.4 release (#111) Nov 3, 2018
tool_distributed_mutex.py Added distributed mutex to protect live CI tests from failing each ot… Aug 9, 2019
tool_generate_packages.py 10.0.4 release (#111) Nov 3, 2018

README.md

AzCopy v10

AzCopy v10 is a command-line utility that you can use to copy data to and from containers and file shares in Azure Storage accounts. AzCopy V10 presents easy-to-use commands that are optimized for performance.

Features and capabilities

Use with storage accounts that have a hierarchical namespace (Azure Data Lake Storage Gen2).

Create containers and file shares.

Upload files and directories.

Download files and directories.

Copy containers, directories and blobs between storage accounts (Blobs only).

Synchronize containers with local file systems and visa versa (Blobs only).

Copy objects, directories, and buckets from Amazon Web Services (AWS) (Blobs only).

List files in a container (Blobs only).

Remove files from a container (Blobs only).

Recover from failures by restarting previous jobs.

Find help

For complete guidance, visit any of these articles on the docs.microsoft.com website.

✳️ Get started with AzCopy (download links here)

✳️ Transfer data with AzCopy and blob storage

✳️ Transfer data with AzCopy and file storage

✳️ Transfer data with AzCopy and Amazon S3 buckets

✳️ Configure, optimize, and troubleshoot AzCopy

Find help from your command prompt

For convenience, consider adding the AzCopy directory location to your system path for ease of use. That way you can type azcopy from any directory on your system.

To see a list of commands, type azcopy -h and then press the ENTER key.

To learn about a specific command, just include the name of the command (For example: azcopy list -h).

AzCopy command help example

If you choose not to add AzCopy to your path, you'll have to change directories to the location of your AzCopy executable and type azcopy or .\azcopy in Windows PowerShell command prompts.

Frequently asked questions

What is the difference between sync and copy?

The copy command is a simple transferring operation, it scans the source and attempts to transfer every single file/blob. The supported source/destination pairs are listed in the help message of the tool. On the other hand, sync makes sure that whatever is present in the source will be replicated to the destination. If your goal is to simply move some files, then copy is definitely the right command, since it offers much better performance.

For sync, last modified times are used to determine whether to transfer the same file present at both the source and the destination. If the use case is to incrementally transfer data then sync is the better choice, since only the modified/missing files are transferred.

Will copy overwrite my files?

By default, AzCopy will overwrite the files at the destination if they already exist. To avoid this behavior, please use the flag --overwrite=false.

Will 'sync' delete files in the destination if they no longer exist in the source location?

By default, the 'sync' command doesn't delete files in the destination unless you use an optional flag with the command. To learn more, see Synchronize files.

Download AzCopy

The latest binary install for AzCopy along with installation instructions may be found here.

How to contribute to AzCopy v10

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.

When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

You can’t perform that action at this time.