Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add AirbyteLib devcontainer config #33876

Closed
wants to merge 69 commits into from
Closed

add AirbyteLib devcontainer config #33876

wants to merge 69 commits into from

Commits on Dec 13, 2023

  1. base implementation

    Joe Reuter committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    f76a0d3 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/master' into flash1293/airbyte-lib

    Joe Reuter committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    19eba07 View commit details
    Browse the repository at this point in the history

  3. implement peek

    Joe Reuter committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    a960851 View commit details
    Browse the repository at this point in the history

  4. prepare

    Joe Reuter committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    17c17b9 View commit details
    Browse the repository at this point in the history

  5. various things

    Joe Reuter committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    6dd8815 View commit details
    Browse the repository at this point in the history

  6. tests and stuff

    Joe Reuter committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    81cc214 View commit details
    Browse the repository at this point in the history

  7. format

    Joe Reuter committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    585631c View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2023

  1. Merge remote-tracking branch 'origin/master' into flash1293/airbyte-lib

    Joe Reuter committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    73b5b18 View commit details
    Browse the repository at this point in the history

  2. hook into CI

    Joe Reuter committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    7a96d61 View commit details
    Browse the repository at this point in the history

  3. format

    Joe Reuter committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    796ca18 View commit details
    Browse the repository at this point in the history

  4. run integration_tests via airbyte-ci

    @alafanechere
    alafanechere committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    24b7df6 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/master' into flash1293/airbyte-lib

    Joe Reuter committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    44bf767 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'flash1293/airbyte-lib' of github.com:airbytehq/airbyte … 

    …into flash1293/airbyte-lib
    Joe Reuter committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    8734cfc View commit details
    Browse the repository at this point in the history

  7. fix CI invocation

    Joe Reuter committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    4f349cc View commit details
    Browse the repository at this point in the history

  8. clean up

    Joe Reuter committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    aae69e5 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2023

  1. Merge branch 'master' into flash1293/airbyte-lib

    Joe Reuter committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    90cbc7a View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2023

  1. Merge branch 'master' into flash1293/airbyte-lib

    Joe Reuter committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    ceea28d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into flash1293/airbyte-lib

    Joe Reuter committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    22f9504 View commit details
    Browse the repository at this point in the history

  3. base airbyte-lib caches implementation 

    improve sql handling, add duckdb and pgsql

poetry init

cleanup imports

add pandas option

delete stale file

set parquet config class

Merge 'origin/flash1293/airbyte-lib' into aj/airbyt-lib-caches

update deps

move all non-public methods to be protected members

consolidate public interface in code file

delete files from missing .gitignore rules

decouple file writers from caches

mypy fixes, refactor filewriters,

cleanup finalize_batches implementation
    @aaronsteers
    aaronsteers committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    d384150 View commit details
    Browse the repository at this point in the history

  4. initial commit - airbyte-lib caches implementation 

    improve sql handling, add duckdb and pgsql

poetry init

cleanup imports

add pandas option

delete stale file

set parquet config class

Merge 'origin/flash1293/airbyte-lib' into aj/airbyt-lib-caches

update deps

move all non-public methods to be protected members

consolidate public interface in code file

delete files from missing .gitignore rules

decouple file writers from caches

mypy fixes, refactor filewriters,

cleanup finalize_batches implementation

cleanup sql cache implementation
    @aaronsteers
    aaronsteers committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    e5d76c9 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2023

  1. fix sql cache base name

    @aaronsteers
    aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    6eceb7f View commit details
    Browse the repository at this point in the history

  2. base implementation

    @aaronsteers
    Joe Reuter authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    38e7df8 View commit details
    Browse the repository at this point in the history

  3. implement peek

    @aaronsteers
    Joe Reuter authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    9ed829e View commit details
    Browse the repository at this point in the history

  4. prepare

    @aaronsteers
    Joe Reuter authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    4db998f View commit details
    Browse the repository at this point in the history

  5. various things

    @aaronsteers
    Joe Reuter authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    76485cf View commit details
    Browse the repository at this point in the history

  6. tests and stuff

    @aaronsteers
    Joe Reuter authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    d432172 View commit details
    Browse the repository at this point in the history

  7. format

    @aaronsteers
    Joe Reuter authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    2031de7 View commit details
    Browse the repository at this point in the history

  8. hook into CI

    @aaronsteers
    Joe Reuter authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    470a76d View commit details
    Browse the repository at this point in the history

  9. format

    @aaronsteers
    Joe Reuter authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    e77fb36 View commit details
    Browse the repository at this point in the history

  10. run integration_tests via airbyte-ci

    @alafanechere @aaronsteers
    alafanechere authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    9a64147 View commit details
    Browse the repository at this point in the history

  11. fix CI invocation

    @aaronsteers
    Joe Reuter authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    ba627ea View commit details
    Browse the repository at this point in the history

  12. clean up

    @aaronsteers
    Joe Reuter authored and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    8906687 View commit details
    Browse the repository at this point in the history

  13. base airbyte-lib caches implementation 

    improve sql handling, add duckdb and pgsql

poetry init

cleanup imports

add pandas option

delete stale file

set parquet config class

Merge 'origin/flash1293/airbyte-lib' into aj/airbyt-lib-caches

update deps

move all non-public methods to be protected members

consolidate public interface in code file

delete files from missing .gitignore rules

decouple file writers from caches

mypy fixes, refactor filewriters,

cleanup finalize_batches implementation
    @aaronsteers
    aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    be42017 View commit details
    Browse the repository at this point in the history

  14. initial commit - airbyte-lib caches implementation 

    improve sql handling, add duckdb and pgsql

poetry init

cleanup imports

add pandas option

delete stale file

set parquet config class

Merge 'origin/flash1293/airbyte-lib' into aj/airbyt-lib-caches

update deps

move all non-public methods to be protected members

consolidate public interface in code file

delete files from missing .gitignore rules

decouple file writers from caches

mypy fixes, refactor filewriters,

cleanup finalize_batches implementation

cleanup sql cache implementation
    @aaronsteers
    aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    e341d96 View commit details
    Browse the repository at this point in the history

  15. fix sql cache base name

    @aaronsteers
    aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    605bc83 View commit details
    Browse the repository at this point in the history

  16. Merge branch 'aj/airbyte-lib-caches-base' of https://github.com/airby… 

    …tehq/airbyte into aj/airbyte-lib-caches-base
    @aaronsteers
    aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    6a854bf View commit details
    Browse the repository at this point in the history

  17. Merge branch 'master' into flash1293/airbyte-lib

    @aaronsteers
    aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    e35b0c6 View commit details
    Browse the repository at this point in the history

  18. airbyte-lib: Add path executor (#33600) 

    Co-authored-by: Aaron ("AJ") Steers <aj@airbyte.io>
    @aaronsteers
    Joe Reuter and aaronsteers committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    9e003a9 View commit details
    Browse the repository at this point in the history

  19. Merge branch 'flash1293/airbyte-lib' of github.com:airbytehq/airbyte … 

    …into flash1293/airbyte-lib
    Joe Reuter committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    a5869e3 View commit details
    Browse the repository at this point in the history

  20. Merge remote-tracking branch 'origin/master' into flash1293/airbyte-lib

    Joe Reuter committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    89059c8 View commit details
    Browse the repository at this point in the history

  21. code format

    Joe Reuter committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    8418dca View commit details
    Browse the repository at this point in the history

  22. Merge remote-tracking branch 'origin/master' into flash1293/airbyte-lib

    Joe Reuter committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    6d11890 View commit details
    Browse the repository at this point in the history

  23. mypy

    Joe Reuter committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    babf999 View commit details
    Browse the repository at this point in the history

  24. always show last log messages

    Joe Reuter committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    d2e1e46 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. Merge remote-tracking branch 'origin/master' into flash1293/airbyte-lib

    Joe Reuter committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    8c86f9f View commit details
    Browse the repository at this point in the history

  2. add py.typed

    Joe Reuter committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    e090490 View commit details
    Browse the repository at this point in the history

  3. add mypy checks

    Joe Reuter committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    4ca3a6b View commit details
    Browse the repository at this point in the history

  4. rename peek to read_stream

    Joe Reuter committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    c6ec803 View commit details
    Browse the repository at this point in the history

  5. refactor to match new API

    Joe Reuter committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    e69c568 View commit details
    Browse the repository at this point in the history

  6. more refactoring

    Joe Reuter committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    19f675e View commit details
    Browse the repository at this point in the history

  7. add header to registry request and fix test

    Joe Reuter committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    6d4278e View commit details
    Browse the repository at this point in the history

  8. fix wrong variable used

    Joe Reuter committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    966fe43 View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2023

  1. rename classes, update dir structure

    @aaronsteers
    aaronsteers committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    878dbe0 View commit details
    Browse the repository at this point in the history

  2. mypy fixes

    @aaronsteers
    aaronsteers committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    401e5b5 View commit details
    Browse the repository at this point in the history

  3. update from branch 'origin/flash1293/airbyte-lib'

    @aaronsteers
    aaronsteers committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    9e9f61e View commit details
    Browse the repository at this point in the history

  4. poetry lock

    @aaronsteers
    aaronsteers committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    7331d13 View commit details
    Browse the repository at this point in the history

  5. resolved all mypy issues

    @aaronsteers
    aaronsteers committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    f210cbd View commit details
    Browse the repository at this point in the history

  6. add duckdb test (failing)

    @aaronsteers
    aaronsteers committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    fa87002 View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2023

  1. checkpoint: working duckdb cache

    @aaronsteers
    aaronsteers committed Dec 22, 2023
    Configuration menu
    Copy the full SHA
    a60b3c0 View commit details
    Browse the repository at this point in the history

Commits on Dec 23, 2023

  1. checkpoint: all tests passing

    @aaronsteers
    aaronsteers committed Dec 23, 2023
    Configuration menu
    Copy the full SHA
    21e41d9 View commit details
    Browse the repository at this point in the history

  2. checkpoint: postgres passing test

    @aaronsteers
    aaronsteers committed Dec 23, 2023
    Configuration menu
    Copy the full SHA
    5d51ea4 View commit details
    Browse the repository at this point in the history

  3. update fixme comments

    @aaronsteers
    aaronsteers committed Dec 23, 2023
    Configuration menu
    Copy the full SHA
    17fcf28 View commit details
    Browse the repository at this point in the history

  4. add faker example script (not yet working)

    @aaronsteers
    aaronsteers committed Dec 23, 2023
    Configuration menu
    Copy the full SHA
    14b0408 View commit details
    Browse the repository at this point in the history

  5. set space-x example script to install-if-missing=true

    @aaronsteers
    aaronsteers committed Dec 23, 2023
    Configuration menu
    Copy the full SHA
    7cb3e4b View commit details
    Browse the repository at this point in the history

  6. Update airbyte-lib/airbyte_lib/file_writers/base.py

    @aaronsteers
    aaronsteers committed Dec 23, 2023
    Configuration menu
    Copy the full SHA
    d1e062e View commit details
    Browse the repository at this point in the history

  7. small fixes

    @aaronsteers
    aaronsteers committed Dec 23, 2023
    Configuration menu
    Copy the full SHA
    5099e58 View commit details
    Browse the repository at this point in the history

  8. update docstring

    @aaronsteers
    aaronsteers committed Dec 23, 2023
    Configuration menu
    Copy the full SHA
    a3bd109 View commit details
    Browse the repository at this point in the history

  9. update docstring

    @aaronsteers
    aaronsteers committed Dec 23, 2023
    Configuration menu
    Copy the full SHA
    492e254 View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. add devcontainer config

    @aaronsteers
    aaronsteers committed Jan 3, 2024
    Configuration menu
    Copy the full SHA
    618282f View commit details
    Browse the repository at this point in the history