Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Iceberg support #68

Merged
merged 46 commits into from
Apr 23, 2023
Merged

Add Iceberg support #68

merged 46 commits into from
Apr 23, 2023

Commits on Dec 10, 2022

  1. support kinesis firehose, unify kinesis config, add better metric sup… 

    …port
    @nextdude
    nextdude committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    da1b21f View commit details
    Browse the repository at this point in the history

  2. clean up warnings

    @nextdude
    nextdude committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    ba67682 View commit details
    Browse the repository at this point in the history

  3. fix registerGauge declaration and change deprecated setDeliverGuarant… 

    …ee method call
    @nextdude
    nextdude committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    f7aa264 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2022

  1. added test for firehose config

    @nextdude
    nextdude committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    601f530 View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2023

  1. initial version

    @nextdude
    nextdude committed Jan 26, 2023
    Configuration menu
    Copy the full SHA
    e8e9ba4 View commit details
    Browse the repository at this point in the history

  2. compileable

    @nextdude
    nextdude committed Jan 26, 2023
    Configuration menu
    Copy the full SHA
    bfb2530 View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2023

  1. close to testable

    @nextdude
    nextdude committed Feb 19, 2023
    Configuration menu
    Copy the full SHA
    fbc21be View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2023

  1. writing tests

    @nextdude
    nextdude committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    ec65e38 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/kinesis-firehose

    @nextdude
    nextdude committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    22966be View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2023

  1. Adding parallelism to sink

    @LizaMo
    LizaMo committed Feb 24, 2023
    Configuration menu
    Copy the full SHA
    0f15d71 View commit details
    Browse the repository at this point in the history

Commits on Feb 25, 2023

  1. got basic test working

    @nextdude
    nextdude committed Feb 25, 2023
    Configuration menu
    Copy the full SHA
    61d20cc View commit details
    Browse the repository at this point in the history

  2. fix bug in test

    @nextdude
    nextdude committed Feb 25, 2023
    Configuration menu
    Copy the full SHA
    945e1cb View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2023

  1. improve tests

    @nextdude
    nextdude committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    497486e View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2023

  1. support consuming from multiple streams

    @nextdude
    nextdude committed Mar 17, 2023
    Configuration menu
    Copy the full SHA
    cbd7329 View commit details
    Browse the repository at this point in the history

  2. add tests

    @nextdude
    nextdude committed Mar 17, 2023
    Configuration menu
    Copy the full SHA
    2479985 View commit details
    Browse the repository at this point in the history

  3. reformat/optimize imports

    @nextdude
    nextdude committed Mar 17, 2023
    Configuration menu
    Copy the full SHA
    4ba8faf View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2023

  1. refactored several things

    @nextdude
    nextdude committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    7a43919 View commit details
    Browse the repository at this point in the history

  2. fixed conflicts

    @nextdude
    nextdude committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    f91a60b View commit details
    Browse the repository at this point in the history

  3. fix typo

    @nextdude
    nextdude committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    e4b18d4 View commit details
    Browse the repository at this point in the history

  4. refactor addSink() method in cassandra sink

    @nextdude
    nextdude committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    de06b2f View commit details
    Browse the repository at this point in the history

  5. try to fix cluster builder serialization issues

    @nextdude
    nextdude committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    e98e2fa View commit details
    Browse the repository at this point in the history

  6. refactor closures in JdbcSink and CassandraSink

    @nextdude
    nextdude committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    6cb6dcd View commit details
    Browse the repository at this point in the history

  7. fix type and reformat

    @nextdude
    nextdude committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    cf6e521 View commit details
    Browse the repository at this point in the history

  8. turn off debugging in tests

    @nextdude
    nextdude committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    8e32184 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2023

  1. updates

    @nextdude
    nextdude committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    b6ecf93 View commit details
    Browse the repository at this point in the history

  2. updates

    @nextdude
    nextdude committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    bba65e6 View commit details
    Browse the repository at this point in the history

  3. add print sink and iceberg tests

    @nextdude
    nextdude committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    19f0093 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2023

  1. refactor iceberg source

    @nextdude
    nextdude committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    73ab8e7 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2023

  1. fix iceberg tests

    @nextdude
    nextdude committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    6ce8473 View commit details
    Browse the repository at this point in the history

  2. update iceberg version to 1.2.0

    @nextdude
    nextdude committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    c73917a View commit details
    Browse the repository at this point in the history

  3. add aws.region setting for tests

    @nextdude
    nextdude committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    5f2393e View commit details
    Browse the repository at this point in the history

  4. remove aws.region setting for tests

    @nextdude
    nextdude committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    eb64c60 View commit details
    Browse the repository at this point in the history

  5. set aws creds for iceberg test

    @nextdude
    nextdude committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    e7e6e3a View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. update iceberg direct access test

    @nextdude
    nextdude committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    52b3d63 View commit details
    Browse the repository at this point in the history

  2. try to fix test on travis

    @nextdude
    nextdude committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    538316d View commit details
    Browse the repository at this point in the history

  3. remove testcontainers debug from tests

    @nextdude
    nextdude committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    235109c View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2023

  1. fixed test

    @nextdude
    nextdude committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    4f89df6 View commit details
    Browse the repository at this point in the history

  2. remove duplicative trait extension

    @nextdude
    nextdude committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    3398a49 View commit details
    Browse the repository at this point in the history

  3. merge main

    @nextdude
    nextdude committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    a29cd4c View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2023

  1. merged PR#64

    @nextdude
    nextdude committed Apr 7, 2023
    Configuration menu
    Copy the full SHA
    7693447 View commit details
    Browse the repository at this point in the history

  2. fix id64 test

    @nextdude
    nextdude committed Apr 7, 2023
    Configuration menu
    Copy the full SHA
    3db983d View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2023

  1. add simple stream node inspection for testing

    @nextdude
    nextdude committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    9646809 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2023

  1. fix confluent avro deserialization

    @nextdude
    nextdude committed Apr 23, 2023
    Configuration menu
    Copy the full SHA
    1d3f939 View commit details
    Browse the repository at this point in the history

  2. optimize imports/scalafmt

    @nextdude
    nextdude committed Apr 23, 2023
    Configuration menu
    Copy the full SHA
    2552110 View commit details
    Browse the repository at this point in the history

  3. reenable ConfluentAvroRegistryKafkaRecordDeserializationSchemaTest

    @nextdude
    nextdude committed Apr 23, 2023
    Configuration menu
    Copy the full SHA
    6600e5c View commit details
    Browse the repository at this point in the history

  4. fix tests

    @nextdude
    nextdude committed Apr 23, 2023
    Configuration menu
    Copy the full SHA
    2342fc4 View commit details
    Browse the repository at this point in the history