Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make bulk import metadata scan split tolerant #469

Closed
keith-turner opened this issue May 7, 2018 · 0 comments
Closed

Make bulk import metadata scan split tolerant #469

keith-turner opened this issue May 7, 2018 · 0 comments
Assignees
@keith-turner
Labels
blocker This issue blocks any release version labeled on it. enhancement This issue describes a new feature, improvement, or optimization.
Milestone
2.0.0

Comments

@keith-turner
Copy link
Contributor

This is follow on work for #436. The metadata scan that is done for loading files should be split tolerant. The scan should check that the metadata table form a linked list and back up when it does not. The GC scans the metadata table like this.
@keith-turner keith-turner added v2.0.0 blocker This issue blocks any release version labeled on it. enhancement This issue describes a new feature, improvement, or optimization. labels May 7, 2018
@keith-turner keith-turner self-assigned this May 7, 2018
keith-turner added a commit to keith-turner/accumulo that referenced this issue May 16, 2018
@keith-turner
fixes apache#469 made bul import scan split tolerant
e5da77a 
 * Made MetadataScanner check metadata table structure and retry when linked list broken
 * Removed TabletIterator
 * Made code that used TabletIterator use MetadataScanner
keith-turner added a commit to keith-turner/accumulo that referenced this issue May 16, 2018
@keith-turner
fixes apache#469 made bulk import scan split tolerant
6e7d218 
 * Made MetadataScanner check structure and retry when linked list broken
 * Removed TabletIterator
 * Made code that used TabletIterator use MetadataScanner
keith-turner added a commit that referenced this issue May 30, 2018
@keith-turner
#469 Fix bug with GC not scanning root table for file refs (#503)
780c4ca 
This bug was introduced in 9feb5e1. In addition to fixing the bug,
specifying the table was made mandatory for the metadata scanner
builder.

The bug was found by MetadataMaxFilesIT
@ctubbsii ctubbsii added this to the 2.0.0 milestone Jul 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@keith-turner keith-turner

Labels
blocker This issue blocks any release version labeled on it. enhancement This issue describes a new feature, improvement, or optimization.
Projects
None yet
Milestone
2.0.0
Development

No branches or pull requests
2 participants
@keith-turner @ctubbsii