Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AzCopy Release 10.16.0 #1851

Merged
merged 28 commits into from
Jul 21, 2022
Merged

AzCopy Release 10.16.0 #1851

merged 28 commits into from
Jul 21, 2022

Conversation

mohsha-msft
Copy link
Contributor

No description provided.

tiverma-msft and others added 28 commits May 12, 2022 22:03
- This fix in respect to support 190TB files.
  As of now due to wrong calculation after 24T azcopy fails.
…9-348f-4807-9ca8-da332f99cbb8

Adding Microsoft SECURITY.MD
Introduce xdm-relevant changes to and fix frontend
* output-level=default;essential;quiet

* default value of flag

* solving conversations

* adding quiet mode (output-level) to rm and sync

* adding quiet mode (output-level) to rm and sync

* adding dry-run vs output-level validation to copy, rm, sync

* move setting outputVerbosity to root.go

* removing redundant code from Prompt()

* cleaning code in processOutputMessage()
* SIP Implementation

* Opt for an interface instead of a struct

* Implement upload

* Implement file creation

* Implement property setting; todo: error handling

* Error handling

* Add upload support to append/page blob

* Implement flag

* Somewhat fix download

* Handle folder uploading/copying

* Remove download

* Fix getUNIXProperties

* Remove device filtering

* Convert flag to bool

* Attempt to fix accidental folder transfers

* Fix test function signatures

* Add preserve-posix-properties to sync

* Limit auto-setting to sync and copy

* Default to false

* Potentially fix testing

* Add check for flag

* Shift back to single-call

* Handle comments on PR

* Add includeDirectoryStubs to folder property considerations

* Address final comments
* location of bug

* moving log-level to root command

* making logVerbosity variable in root.go

* passing correct values while making logger

* removing logVerbosity from raw and cooked

* removing logVerbosity from zt files raw args

* some prob with conflict resolution
…lsewhere (#1782)

* avoiding creation of .azcopy if log and plan files have user defined loc

* making azcopyAppPathFolder string irrespective of folder creation

* accessToken to be created where plan files are

* adding TODO

* making same changes in main_unix.go

* getting rid of azcopyAppPathFolder

* making azcopyAppPathFolder before making plan folder to avoid err
* adding new files setProperties

* updating copy.go and helpMessages.go

* updating cmd files for setProperties

* updating ste files for setProperties

* updating ste files for setProperties

* solving issues with code

* fixing problem with rehydrate priority

* adding archiveStatus to list

* adding test files

* adding dry-run mode

* reformatting dry-run code

* adding metadata and blobtier to tests

* removing redundant code from makeTransferEnum()

* validating metadata

* assuring empty metadata is handled in set-props

* assuring tier is not archive if BlobFS

* Files and SAS token not allowed

* Files and SAS token not allowed

* adding tests for empty metadata and blob tags

* printing unescaped URL in dry-run

* showing failed when using auto-login resolution

* the specified blob does not exist error and not hang

* totalBytesTransferred = 0

* oopsie

* showing failed when using auto-login resolution - 2

* empty blob tags given to clear existing tags

* removing done TODO

* moving resetSourceSize so that progress is displayed correctly

* complying with pulled changes

* introducing "flush" to flush blobtags and metadata

* avoiding import cycle

* getting up to date with latest merges in dev

* getting up to date with latest merges in dev -2

* printing metadata if error in it

* printing metadata if error in it

* moving flushflag to fe-ste-models.go

* only metadata key should be a C# identifier

* changing flush flag to clear flag

* using strings.EqualFold for case insensitivity

* pretty output

* description and checkIfChangesPossible() change

* metadata can't be set if blob is set to be archived

* doing TODOs and silenting ValidateTier()

* adding short and long descr. and examples

* fixing usage definition

* bytes transferred = 0 not showing correctly, fix

* removing invalid comment
* Combine all JobMgr changes into one.

JobMgr Cleanup.

- Close all the go routines once job is done.

Fix for Report Handler routine cleanup.

Memory Leak Fix.

- Set the nil to address allocated memory.

- Fixing some of memory issues.

- JobMgr is freed without setting channel to nil.

Co-authored-by: Nitin Singla <nitinsingla@microsoft.com>
* Fix some oopsies in the unix properties PR

* Apply changes to append/page blob
* Squash "Fix the symlink" into one commit.

Fix the symlink.

- Calling filepath.evalsymlinks in case of linux.
- Explicit checking "." (current directory) for symlink.

Remove snippet of code not relevant to the cherry-picked commits.

* Fix build error.

* Fix rebase build errors.

Co-authored-by: Nitin Singla <nitinsingla@microsoft.com>
… errors in traverser (#1803)

* This patch for enabling calling app to cancel enumeration.

- Used appCtx in parallel-walk so that when app want to cancel the
enumeration it can do.
- It doesn't effect azcopy working.

* Replace context pointer with context and nil with context.TODO()

* Handle scanning directory errors in traverser.

* Fail visibly when scanning fails for files and directories

* add in more error paths

* fix processOneDirectory changes and add more comments

* Minor fix.

* Fix nil ptr dereference.

* Resolve comments.

* Replace err with err.Error() as per comments.

* Minor fix.

Co-authored-by: Nitin Singla <nitinsingla@microsoft.com>
* Fix race between Updating JobPart and xferDoneMsg

* Rename variable to more appropriate one

* Close xferDone channel

* Add missing continue

* Fix rebase issue
* Improve error if we cannot determine if source is a directory

* Replace ste logger with scanning logger

* Undo white space changes

* Fix CI
* DFS to Blob endpoint conversion.

* DFS to Blob endpoint conversion.

* DFS to Blob endpoint conversion.

Co-authored-by: Mohit Sharma <mohitdtumce@gmail.com>
…isk export account requests it (#1844)

* MD OAuth (mostly)

* Reimplement MD-OAuth as a credential type signifying resource
* Update changelog and version for 10.16.0

* Update ChangeLog.md

Co-authored-by: Narasimha Kulkarni <nakulkar@microsoft.com>
@mohsha-msft mohsha-msft merged commit 13fecd4 into main Jul 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants