Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azcopy add support to copy files to $web container #133

Closed
JohnReeson opened this issue Jun 29, 2018 · 21 comments
Closed

Azcopy add support to copy files to $web container #133

JohnReeson opened this issue Jun 29, 2018 · 21 comments
Assignees

Comments

@JohnReeson
Copy link

@JohnReeson JohnReeson commented Jun 29, 2018

In this new feature--Static website hosting for Azure Storage now in public preview. A container $web will be created for hosting static websites.

The problem is, Azcopy can't recognize this container, test in cmd

[ERROR] Error parsing destination location "https://{accountname}.blob.core.windows.net/$web": Invalid location 'https://{accountname}.blob.core.windows.net/$web', address could not be parsed.

Also test in powershell, no breaking, but files are just uploaded to $root despite the name after $.

For now seems that it can only resolve container $root with $ in name.

@onpaws
Copy link

@onpaws onpaws commented Jun 29, 2018

Yesterday I tried to use static website hosting by setting up a release task in VSTS.
VSTS uses an older version of AzCopy (apparently v2.0.1) and it doesn't support $web.
I manually tested on my local machine using a fresher version of AzCopy, but same behavior.

AzCopy v7.1.0, then I tried 8.0.0-netcorepreview - still broken.
Win10 Enterprise build 17704

@jiacfan
Copy link
Member

@jiacfan jiacfan commented Jul 2, 2018

Hi, @JohnReeson and @onpaws:

Sorry that AzCopy v7.1.0 doesn't support static website, and we'll release a new version AzCopy recently which involves static website support, it will be hopefully in this week.

Thanks,
Jiachen

@jiacfan jiacfan self-assigned this Jul 2, 2018
@rajatagrawal-dev
Copy link

@rajatagrawal-dev rajatagrawal-dev commented Jul 2, 2018

@onpaws Actually VSTS also uses AzCopy v7.1.0 (the Azure File Copy task version is 2.0.1). We (VSTS) will try to update the AzCopy version in our task as well once it is released.

@jiacfan Will there be any breaking changes when moving from AzCopy v7.1.0 to the next AzCopy version?

@jiacfan
Copy link
Member

@jiacfan jiacfan commented Jul 2, 2018

@rajatagrawal-dev

The next version would likely be a minor version(7.3.0), there should not be any breaking change. Will update this thread if there is any change.

Best Wishes,
Jiachen

@onpaws
Copy link

@onpaws onpaws commented Jul 2, 2018

Thanks for the update @jiacfan.
If there's a way I can help test I'd be happy to

@MrBRUE
Copy link

@MrBRUE MrBRUE commented Jul 6, 2018

@jiacfan - will that azcopy update be available on Azure Cloud Shell right away, too? (Will that version there be immediately upgraded?) --tested it on my beloved Cloud Shell and $web broke everything.

@hoetz
Copy link

@hoetz hoetz commented Jul 7, 2018

FYI until AzCopy supports it you can use the Azure CLI to copy files to the $web container. Worked for me:

az storage blob upload-batch --account-name myaccount -s . -d $web

@jiacfan
Copy link
Member

@jiacfan jiacfan commented Jul 9, 2018

Hi, @MrBRUE

Thanks for providing feedback, FYI, v7.3.0 has been released(Windows, based on .Net Framework), involved $web support. The Azure Cloud Shell support hasn't yet get ready, and I have established a tracking item to follow. Will share more details once get any update on the Cloud Shell support.

Thanks,
Jiachen

@tpetrina
Copy link

@tpetrina tpetrina commented Jul 14, 2018

@hoetz Where did you test that? On macOS it doesn't work. The error is:

az storage blob upload-batch: error: argument --destination/-d: expected one argument

@onpaws
Copy link

@onpaws onpaws commented Jul 15, 2018

@tpetrina try putting \ a backslash in front of $web so your shell (likely bash) doesn't try to parse the $

@tpetrina
Copy link

@tpetrina tpetrina commented Jul 15, 2018

@onpaws Wow, that did the trick! Thanks!

@vivaladan
Copy link

@vivaladan vivaladan commented Jul 24, 2018

@jiacfan Thanks for the fix!

@rajatagrawal-dev Any idea when we'll see this available on VSTS hosted agents?

@rajatagrawal-dev
Copy link

@rajatagrawal-dev rajatagrawal-dev commented Jul 25, 2018

@vivaladan This is a fix in the Azure File Copy v2 task itself and not the agent. Your VSTS account will be updated with the new task version soon. The deployment is scheduled to start by early next week.

@EmmaZhu
Copy link
Collaborator

@EmmaZhu EmmaZhu commented Jul 31, 2018

As $web has been supported in AzCopy, close this issue, Please feel free to reopen it or open a new issue if any further assistant needed.

@EmmaZhu EmmaZhu closed this as completed Jul 31, 2018
@mikeclymer
Copy link

@mikeclymer mikeclymer commented Aug 1, 2018

@rajatagrawal-dev - Has this fix been released to the VSTS Azure File Copy v2 task yet? I am still seeing the issue in my release pipeline.

@rajatagrawal-dev
Copy link

@rajatagrawal-dev rajatagrawal-dev commented Aug 2, 2018

@mikeclymer Please follow microsoft/azure-pipelines-tasks#7611 for updates.

@123dev
Copy link

@123dev 123dev commented Aug 14, 2018

Thanks for providing feedback, FYI, v7.3.0 has been released(Windows, based on .Net Framework), involved $web support. The Azure Cloud Shell support hasn't yet get ready, and I have established a tracking item to follow. Will share more details once get any update on the Cloud Shell support.

Thanks,
Jiachen

Thanks, is there a Linux version available for download?

@jiacfan
Copy link
Member

@jiacfan jiacfan commented Aug 15, 2018

@123dev

Yes, please download AzCopy v7.3.0-netcore from here

The document will be updated accordingly as well.

Thanks,
Jiachen

@123dev
Copy link

@123dev 123dev commented Aug 20, 2018

@jiacfan
Thanks, and sorry for the delayed response.
Tried installing it on MacOS
can't install into /usr/lib
So I modified the install script to install it to /usr/local
and the binary into /usr/local/bin
however I always get
-bash: ./azcopy: cannot execute binary file

I assume it doesn't work on a MAC?

Thanks

@brgsstm
Copy link

@brgsstm brgsstm commented Sep 13, 2018

Has this been released into Azure DevOps (VSTS) yet? I am still seeing issues in the release pipeline trying to copy to $web.

EDIT: apologies, this was fixed in preview microsoft/azure-pipelines-tasks#7611

@jiacfan
Copy link
Member

@jiacfan jiacfan commented Sep 14, 2018

@brgsstm

Thanks for the info!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests