Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement pause/resume for downloadFile in S3 transfer manager #3169

Merged
merged 8 commits into from
Apr 27, 2022

Conversation

zoewangg
Copy link
Contributor

@zoewangg zoewangg commented Apr 25, 2022

Motivation and Context

Implement pause/resume for downloadFile in S3 transfer manager

Modifications

Merging the feature branch to mainline. All implementation related changes have been reviewed in separate PRs(#3125, #3094, #3157).

Testing

Added unit tests and integ tests.
Running the tests now. Integ tests passed

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)

Checklist

  • I have read the CONTRIBUTING document
  • Local run of mvn install succeeds
  • My code follows the code style of this project
  • My change requires a change to the Javadoc documentation
  • I have updated the Javadoc documentation accordingly
  • I have added tests to cover my changes
  • All new and existing tests passed
  • I have added a changelog entry. Adding a new entry must be accomplished by running the scripts/new-change script and following the instructions. Commit the new file created by the script in .changes/next-release with your changes.
  • My change is to implement 1.11 parity feature and I have updated LaunchChangelog

License

  • I confirm that this pull request can be released under the Apache 2 license

…e overwriting existing files (#3125)

* Expose an option to overwrite an existing file in FileAsyncResponseTransformer

* Add changelog entries and make TM use CREATE_OR_REPLACE_EXISTING write option by default

* Address feedback

* Update and address feedback
…adFile operation (#3094)

* Part 1: Implement pause for downloadFile operation

* Address feedback

* Refactor the logic

* Address feedback

* Fix merging issue
…le (#3157)

* Implement resumeDownloadFile

* Move test code around

* Address feedback

* Fix flaky test

* fix flaky integ test
@zoewangg zoewangg requested a review from a team as a code owner April 25, 2022 18:31
@zoewangg zoewangg force-pushed the zoewang/tm-download-pause-resume branch 6 times, most recently from 70ba9cf to 7a63469 Compare April 26, 2022 18:40
@zoewangg zoewangg force-pushed the zoewang/tm-download-pause-resume branch from 7a63469 to 99c14f7 Compare April 26, 2022 19:27
}

@ParameterizedTest
@MethodSource("configurations")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice!

@sonarcloud
Copy link

sonarcloud bot commented Apr 27, 2022

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 4 Code Smells

84.6% 84.6% Coverage
0.0% 0.0% Duplication

@zoewangg zoewangg merged commit 5724210 into master Apr 27, 2022
@zoewangg zoewangg deleted the zoewang/tm-download-pause-resume branch May 16, 2022 01:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants