Skip to content

Feature sdk 571 resumable mpu new branch#74

Merged
twincitiesguy merged 28 commits intomasterfrom
feature-SDK-571-resumable-mpu-new-branch
Apr 13, 2022
Merged

Feature sdk 571 resumable mpu new branch#74
twincitiesguy merged 28 commits intomasterfrom
feature-SDK-571-resumable-mpu-new-branch

Conversation

@twincitiesguy
Copy link
Copy Markdown
Contributor

No description provided.

xiaoxin-ren and others added 11 commits March 7, 2022 14:06
Fix bug: listMultipartUploads() always returns null nextKeyMarker.
…implementation)

* Moved LFU/LFD test cases to respective test classes (out of S3JerseyClientTest)
* Updated LFU resume logic to encapsulate a ResumeContext, adding some flexibility for calling code to specify an uploadId and partsToSkip
* Added unit test skeleton for LFU multi-part source test
Comment thread src/main/java/com/emc/object/s3/LargeFileUploader.java Outdated
Comment thread src/main/java/com/emc/object/s3/LargeFileUploader.java Outdated
Comment thread src/main/java/com/emc/object/s3/LargeFileUploader.java Outdated
Comment thread src/main/java/com/emc/object/s3/request/CopyObjectRequest.java
Comment thread src/main/java/com/emc/object/s3/LargeFileUploader.java Outdated
Stu Arnett added 2 commits April 4, 2022 17:42
… be potentially too confusing for users) - to resume an MPU, users must provide the uploadId

* cleaned up logic around part ETag verification (parts specified in resume context are "trusted")
* added logging, comments and javadocs to clarify behavior
xiaoxin-ren and others added 11 commits April 6, 2022 10:44
…ing-eric

Feature sdk 571 resumable mpu working eric
* fixed resume tests
* fixed bug in ETag verification
* lowered min. part size for testing
* added versionId as part of result data after upload is complete
* fixed bug in pause() (have to unwrap CancellationException to detect cancelled tasks)
Copy link
Copy Markdown
Contributor

@xiaoxin-ren xiaoxin-ren left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks good.

…in S3Config, since that is the correct way to set these now

* changed random test bucket suffix to use last-6 digits of UUID string, instead of random 5-digit number, to eliminate possibility of multiple parallel unit tests sharing the same bucket
@twincitiesguy twincitiesguy force-pushed the feature-SDK-571-resumable-mpu-new-branch branch from e67a1b2 to e19c64c Compare April 13, 2022 17:35
@twincitiesguy twincitiesguy merged commit 68139de into master Apr 13, 2022
@twincitiesguy twincitiesguy deleted the feature-SDK-571-resumable-mpu-new-branch branch April 13, 2022 17:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants