Skip to content
This repository has been archived by the owner on Aug 25, 2023. It is now read-only.

YACHT-972: Each partition of empty partitioned table is now backed up. #35

Merged
merged 4 commits into from
Aug 21, 2018

Conversation

radkomateusz
Copy link
Contributor

Earlier, empty but still partitioned table was backes up as not-partitoned one. It caused a bug in situation when earlier partitions (and whole table in consequence was not empty) were not empty, and then after data deletion, BBQ doesn't update each partition, but instead creates new backup of whole table. It makes this backup unrestorable as we assume that at given point of time there shouldn't be any Table entites which has both X:Y.Z$null and X:Y.Z$any_partition entries.

Earlier, empty but still partitioned table was backes up as not-partitoned one.  It caused a bug in situation when earlier partitions (and whole table in consequence was not empty) were not empty, and then after data deletion, BBQ doesn't update each partition, but instead creates new backup of whole table. It makes this backup unrestorable as we assume that at given point of time there shouldn't be any Table entites which has both X:Y.Z$null and X:Y.Z$any_partition entries.
@coveralls
Copy link

coveralls commented Aug 20, 2018

Pull Request Test Coverage Report for Build 438

  • 3 of 4 (75.0%) changed or added relevant lines in 2 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage decreased (-0.04%) to 80.943%

Changes Missing Coverage Covered Lines Changed/Added Lines %
src/restore/test/table_randomizer.py 2 3 66.67%
Totals Coverage Status
Change from base Build 428: -0.04%
Covered Lines: 2162
Relevant Lines: 2671

💛 - Coveralls

Previously it performs two checks:
- if table has daily partitioning set in metadata
- if table is not single partition (as single partition has also set daily partitioning)

It could produce bugs, as in some cases we could want to know if table is daily partitioned but we don't care if table is single partition or main table. In other cases we want to know if the table is single partition.

We decided to divide it to different methods.
…which will cause retry during daily random table restore test in case when partitioned table is without partitions.

Update of documentation about the fact that BBQ doesn't backup partitioned tables without any partitions.
@radkomateusz radkomateusz merged commit 95342a7 into master Aug 21, 2018
@radkomateusz radkomateusz deleted the YACHT-972 branch August 21, 2018 11:41
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants