This repository has been archived by the owner on Aug 25, 2023. It is now read-only.
YACHT-1301: BBQ now handles Deadline Exceeded while listing partitions #142
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
YACHT-1023: Filtering out not existing tables. Refactor to reuse tabl…
…1). Location is passing as parameter during getting statuses of big query jobs (as it is required for all regions except EU and US.
…ct encapsulating job_id and location instead.
…heduler_service YACHT-927: Removing synchonous copy job service scheduler as it is no…
…ackup and restore modules.
…ackup and restore modules.
…pyJobAsyncService level.
…pyJobAsyncService level.
…t1_region NON-JIRA: BBQ is ready for new introduced regions (eg. asia-northeast…
added information about default credentials
…ts (and it occurs even if copy job failed), passing these as result check request parameter is not needed anymore.
YACHT-1092: Create and Write copy job dispositions are now configurable from AsyncCopyJobService level
YACHT-1186: Migrate requests and requests_toolbelt dependencies to tests requirements
YACHT-1254: Fixed ValueError: Arguments http and credentials are mutu…
YACHT-1254: fixed new service creation in appinfo
YACHT-917: Removed redundant parameters from configuration
YACHT-1274: Fixed ValueError: Arguments http and credentials are mutu…
* NON-JIRA: Copy job service now handles deadline exceeded error
…of given table is not empty and lastModification time is newer than date of newest backup
…at creating new backup of table, which previous backup has more than 7 months, causes removing previous version of backup. Removing unused code. Adding units tests for all currently known situations.
…, 10 young backups and there is created 4 new backups in the same day (duplicates). Expectation is that during retention deduplication will happen first, only the newest today version will stay, then as 1+10 =11, 11th, oldest young backup will be removed. Old backup will stay as it was.
…ness. Adding test: Should make backup if source table is empty and existing backup is also empty (eg. schema change but without adding any data).
…he only one retention policy currently implemented and it's now taking more details into consideration than mentioned in previous name.
YACHT-1316: Updating retention process to avoid possible situation th…
…ged from partitioned version to unpartioned/view version is treated as deleted. (#138)
… policy. Gif also updated. Adding unit test for situation when there is an old backup, then is new change and new backup and then source table is deleted.
YACHT-1256: Updating documentation - details about modified retention…
YACHT-1246: BBQ will not backup empty table if current newest backup …
…rtitions for tables
Pull Request Test Coverage Report for Build 1133
💛 - Coveralls |
przemyslaw-jasinski
force-pushed
the
YACHT_1301
branch
from
4fca4fd
to
2902350
Compare
|
Why this PR is so big? |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.