Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor HoodieTableFileSystemView using FileGroups & FileSlices #201

Merged
merged 3 commits into from
Jun 23, 2017

Commits on Jun 19, 2017

  1. Rename IO Handles & introduce stub for BucketedIndex

     - UpdateHandle -> MergeHandle, InsertHandle -> CreateHandle
     - Also bunch of code cleanup in different places
    Vinoth Chandar committed Jun 19, 2017
    Configuration menu
    Copy the full SHA
    31535e1 View commit details
    Browse the repository at this point in the history
  2. Refactoring HoodieTableFileSystemView using FileGroups/FileSlices

     - Merged all filter* and get* methods
     - new constructor takes filestatus[]
     - All existing tests pass
     - FileGroup is all files that belong to a fileID within a partition
     - FileSlice is a generation of data and log files, starting at a base commit
    Vinoth Chandar committed Jun 19, 2017
    Configuration menu
    Copy the full SHA
    a0a810d View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2017

  1. Introduce ReadOptimizedView & RealtimeView out of TableFileSystemView

      - Usage now marks code as clearly using either RO or RT views, for future evolution
      - Tests on all of FileGroups and FileSlices
    Vinoth Chandar committed Jun 20, 2017
    Configuration menu
    Copy the full SHA
    7aa8484 View commit details
    Browse the repository at this point in the history