Skip to content
This repository has been archived by the owner on Mar 24, 2021. It is now read-only.

[WIP] Support RecordBatch #844

Open
wants to merge 19 commits into
base: master
Choose a base branch
from
Open

[WIP] Support RecordBatch #844

wants to merge 19 commits into from

Commits on Jul 26, 2018

  1. stub out Record class inheriting from Message

    @emmettbutler
    emmettbutler committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    d095bbc View commit details
    Browse the repository at this point in the history

  2. add basic support for varint format string to struct_helpers

    @emmettbutler
    emmettbutler committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    37b6afb View commit details
    Browse the repository at this point in the history

  3. simplify format string splitting and add some basic tests for varint

    @emmettbutler
    emmettbutler committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    51ecd63 View commit details
    Browse the repository at this point in the history

  4. first pass at actual encode/decode varint impl

    @emmettbutler
    emmettbutler committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    3440d54 View commit details
    Browse the repository at this point in the history

  5. fix endianness bug

    @emmettbutler
    emmettbutler committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    57cacf7 View commit details
    Browse the repository at this point in the history

  6. complicate test case

    @emmettbutler
    emmettbutler committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    d79f01d View commit details
    Browse the repository at this point in the history

  7. test for endianness prefix

    @emmettbutler
    emmettbutler committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    aa898e9 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2018

  1. Merge branch 'master' into enhancement/recordbatch

    @emmettbutler
    emmettbutler committed Jul 30, 2018
    Configuration menu
    Copy the full SHA
    2e36e63 View commit details
    Browse the repository at this point in the history

  2. start implementing Record.pack_into

    @emmettbutler
    emmettbutler committed Jul 30, 2018
    Configuration menu
    Copy the full SHA
    277120d View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2018

  1. split calcsize functionality out from pack_into for varints

    @emmettbutler
    emmettbutler committed Jul 31, 2018
    Configuration menu
    Copy the full SHA
    98c2522 View commit details
    Browse the repository at this point in the history

  2. flesh out Record.__len__ and use it in Record.pack_into

    @emmettbutler
    emmettbutler committed Jul 31, 2018
    Configuration menu
    Copy the full SHA
    98a8c71 View commit details
    Browse the repository at this point in the history

  3. stub out Record.decode()

    @emmettbutler
    emmettbutler committed Jul 31, 2018
    Configuration menu
    Copy the full SHA
    0f6e1d2 View commit details
    Browse the repository at this point in the history

  4. handle G as a varint-prefixed string format character

    @emmettbutler
    emmettbutler committed Jul 31, 2018
    Configuration menu
    Copy the full SHA
    478e22e View commit details
    Browse the repository at this point in the history

  5. use B instead of c for single-byte packing

    @emmettbutler
    emmettbutler committed Jul 31, 2018
    Configuration menu
    Copy the full SHA
    dde6419 View commit details
    Browse the repository at this point in the history

  6. stub RecordBatch and the pack_into method

    @emmettbutler
    emmettbutler committed Jul 31, 2018
    Configuration menu
    Copy the full SHA
    5dbc6e6 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2018

  1. handle the addition of messages to a RecordBatch

    @emmettbutler
    emmettbutler committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    c312f67 View commit details
    Browse the repository at this point in the history

  2. first attempt at length and crc calculations for recordbatch

    @emmettbutler
    emmettbutler committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    e1a4529 View commit details
    Browse the repository at this point in the history

  3. first implementation of RecordBatch.decode

    @emmettbutler
    emmettbutler committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    32f5237 View commit details
    Browse the repository at this point in the history

  4. rough ideation for recordbatch compression

    @emmettbutler
    emmettbutler committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    7370c9d View commit details
    Browse the repository at this point in the history