Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CAT tools/acceptance_test_config_migration: Make relatively configurable per migration, add (hacky) ability to run CAT tests locally for multiple connectors #24377

Merged
merged 78 commits into from
Apr 18, 2023
Merged

CAT tools/acceptance_test_config_migration: Make relatively configurable per migration, add (hacky) ability to run CAT tests locally for multiple connectors #24377

merged 78 commits into from
Apr 18, 2023

Commits on Mar 13, 2023

  1. Pass argument along, add test that should pass and test that should fail

    @erohmensing
    erohmensing committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    f596e3f View commit details
    Browse the repository at this point in the history

  2. Add tests with additionalProperties

    @erohmensing
    erohmensing committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    c88305e View commit details
    Browse the repository at this point in the history

  3. Set additionalproperties=false when not set|

    @erohmensing
    erohmensing committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    1f91a59 View commit details
    Browse the repository at this point in the history

  4. Parametrize test cases

    @erohmensing
    erohmensing committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    a8ef276 View commit details
    Browse the repository at this point in the history

  5. Make the behavior 'optional'

    @erohmensing
    erohmensing committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    3e5cf1f View commit details
    Browse the repository at this point in the history

  6. Fix parametrization for all combinations

    @erohmensing
    erohmensing committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    a7eb6f6 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2023

  1. Improve CI credentials README and rename param

    @erohmensing
    erohmensing committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    2545f8f View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2023

  1. Update naming to be clearer about columns only

    @erohmensing
    erohmensing committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    356b12a View commit details
    Browse the repository at this point in the history

  2. record_has_unexpected_field > record_has_unexpected_column

    @erohmensing
    erohmensing committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    a53c31a View commit details
    Browse the repository at this point in the history

  3. Automated Change

    @marcosmarxm @octavia-squidington-iii
    marcosmarxm authored and octavia-squidington-iii committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    c82879e View commit details
    Browse the repository at this point in the history

  4. Hacking the CAT dockerfile and run script to test my changes specific… 

    …ally
    @erohmensing
    erohmensing committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    646b372 View commit details
    Browse the repository at this point in the history

  5. First crack at running CAT on all connectors

    @erohmensing
    erohmensing committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    fa72e00 View commit details
    Browse the repository at this point in the history

  6. Write during instead of after all tests

    @erohmensing
    erohmensing committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    be92aef View commit details
    Browse the repository at this point in the history

  7. Async-ify it

    @erohmensing
    erohmensing committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    96eb3fc View commit details
    Browse the repository at this point in the history

  8. Add ability to define max concurrency

    @erohmensing
    erohmensing committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    9fc650c View commit details
    Browse the repository at this point in the history

  9. Write successes

    @erohmensing
    erohmensing committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    ede50bd View commit details
    Browse the repository at this point in the history

  10. ci_credentials: fix overwriting 'data' before getting nextPageToken

    @erohmensing
    erohmensing committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    cea154a View commit details
    Browse the repository at this point in the history

  11. Adjustible num_semaphores, check to make sure it's an airbyte connect… 

    …or first
    @erohmensing
    erohmensing committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    a2569e4 View commit details
    Browse the repository at this point in the history

  12. Automated Change

    @erohmensing @octavia-squidington-iii
    erohmensing authored and octavia-squidington-iii committed Mar 20, 2023
    Configuration menu
    Copy the full SHA
    63a273b View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2023

  1. Make create_issues and create_prs more configurable, add issue for fa… 

    …il_on_extra_columns
    @erohmensing
    erohmensing committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    f729dc2 View commit details
    Browse the repository at this point in the history

  2. Add ability to pass in sources as a list or from a txt file

    @erohmensing
    erohmensing committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    1aa9644 View commit details
    Browse the repository at this point in the history

  3. Add logs to issue, make project nullable

    @erohmensing
    erohmensing committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    6535110 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into ella/no-extra-fields

    @erohmensing
    erohmensing committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    9de27c3 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2023

  1. Migrate multiple connectors

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    ae1c263 View commit details
    Browse the repository at this point in the history

  2. Add cli args

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    b538a8c View commit details
    Browse the repository at this point in the history

  3. use ruamel.yaml to preserve ordering

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    358b0f8 View commit details
    Browse the repository at this point in the history

  4. Separate config loading from config migration

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    f42a3a9 View commit details
    Browse the repository at this point in the history

  5. Add ability to pass in lists of sources to test. Sort output by exit … 

    …codes. Fix max_concurrency flag
    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    abe4006 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into ella/run-all-CATS

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    f61804d View commit details
    Browse the repository at this point in the history

  7. Default to testing only beta and GA connectors

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    7655714 View commit details
    Browse the repository at this point in the history

  8. Always write test output when available

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    b460b1c View commit details
    Browse the repository at this point in the history

  9. Merge branch 'master' into ella/no-extra-fields

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    532a35e View commit details
    Browse the repository at this point in the history

  10. Merge branch 'ella/no-extra-fields' into ella/run-all-CATS

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    c498f9f View commit details
    Browse the repository at this point in the history

  11. Revert "Add cli args" 

    This reverts commit b538a8c.
    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    6a17ba1 View commit details
    Browse the repository at this point in the history

  12. Remove slash

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    92bf491 View commit details
    Browse the repository at this point in the history

  13. Don't run on alpha connetors, handle older config style

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    8d9cfa7 View commit details
    Browse the repository at this point in the history

  14. Don't migrate to new format, preserve quotes and long lines

    @erohmensing
    erohmensing committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    e739e12 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. Automated Change

    @erohmensing @octavia-squidington-iii
    erohmensing authored and octavia-squidington-iii committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    fb06bd6 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into ella/run-all-CATS

    @erohmensing
    erohmensing committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    6091f69 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2023

  1. Merge branch 'master' into ella/run-all-CATS

    @erohmensing
    erohmensing committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    9f865fe View commit details
    Browse the repository at this point in the history

  2. Update issue, don't run for alpha connectors

    @erohmensing
    erohmensing committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    a9003ed View commit details
    Browse the repository at this point in the history

  3. Automated Change

    @erohmensing @octavia-squidington-iii
    erohmensing authored and octavia-squidington-iii committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    a487f30 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2023

  1. Merge branch 'master' into ella/run-all-CATS

    @erohmensing
    erohmensing committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    1827e5d View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2023

  1. Add bypass for extra fields test

    @erohmensing
    erohmensing committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    027fd23 View commit details
    Browse the repository at this point in the history

  2. Add bypass for extra fields test

    @erohmensing
    erohmensing committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    18b9c10 View commit details
    Browse the repository at this point in the history

  3. Rename run_tests script

    @erohmensing
    erohmensing committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    20f0c96 View commit details
    Browse the repository at this point in the history

  4. Rename module

    @erohmensing
    erohmensing committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    022ce66 View commit details
    Browse the repository at this point in the history

  5. Update args usage, small changes

    @erohmensing
    erohmensing committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    7876cdf View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2023

  1. Refactor create_issues.py

    @erohmensing
    erohmensing committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    c603e9f View commit details
    Browse the repository at this point in the history

  2. Clean up run_tests.py

    @erohmensing
    erohmensing committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    73cc08e View commit details
    Browse the repository at this point in the history

  3. Sort out arg parsers

    @erohmensing
    erohmensing committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    b8364d1 View commit details
    Browse the repository at this point in the history

  4. Pull out get_valid_definitions_from_args

    @erohmensing
    erohmensing committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    99d1100 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into ella/run-all-CATS

    @erohmensing
    erohmensing committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    4265ff8 View commit details
    Browse the repository at this point in the history

  6. Import definitions module instead of methods

    @erohmensing
    erohmensing committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    fc3fa2b View commit details
    Browse the repository at this point in the history

  7. Use config files to provide constants for each migration

    @erohmensing
    erohmensing committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    42da5f1 View commit details
    Browse the repository at this point in the history

  8. Handle FileNotFoundError in create_issues.py, improve logging

    @erohmensing
    erohmensing committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    d0896c5 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2023

  1. Rename to migrations, reference name of folder via utils

    @erohmensing
    erohmensing committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    b1d91fe View commit details
    Browse the repository at this point in the history

  2. Update readmes for migration modules, add script for getting outputs

    @erohmensing
    erohmensing committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    1a6157d View commit details
    Browse the repository at this point in the history

  3. Use tmp dir, correct path for issue reference

    @erohmensing
    erohmensing committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    5858e4d View commit details
    Browse the repository at this point in the history

  4. Fix bash script

    @erohmensing
    erohmensing committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    be8b8e2 View commit details
    Browse the repository at this point in the history

  5. Fix create command, pull out test results insertion

    @erohmensing
    erohmensing committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    ba0b757 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2023

  1. Update call to update_configuration

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    94bbf12 View commit details
    Browse the repository at this point in the history

  2. add precommit to requirements

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    46b9c5e View commit details
    Browse the repository at this point in the history

  3. Reorder README

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    66446be View commit details
    Browse the repository at this point in the history

  4. README cleanup for test and create issues

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    887f2dc View commit details
    Browse the repository at this point in the history

  5. README cleanup for create_prs and config_migration

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    6bfeb69 View commit details
    Browse the repository at this point in the history

  6. More readmes! Readmes galore

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    7fe82b0 View commit details
    Browse the repository at this point in the history

  7. allow_beta

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    d05404e View commit details
    Browse the repository at this point in the history

  8. Restore hacky changes to dockerfile and acceptance-test-docker

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    7d9fb14 View commit details
    Browse the repository at this point in the history

  9. Handle 'other' release stages

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    3aa0d33 View commit details
    Browse the repository at this point in the history

  10. Update readme

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    511476b View commit details
    Browse the repository at this point in the history

  11. Remove TODO, add comments to shell script

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    eefc8d2 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'master' into ella/run-all-CATS

    @erohmensing
    erohmensing committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    330b59c View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2023

  1. format according to gradle

    @erohmensing
    erohmensing committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    9e7d6ce View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2023

  1. fix merge conflict

    @erohmensing
    erohmensing committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    a328ec1 View commit details
    Browse the repository at this point in the history

  2. format

    @erohmensing
    erohmensing committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    dc8d20a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into ella/run-all-CATS

    @erohmensing
    erohmensing committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    5ba051c View commit details
    Browse the repository at this point in the history

  4. Fix formatting

    @erohmensing
    erohmensing committed Apr 18, 2023
    Configuration menu
    Copy the full SHA
    7c88cb1 View commit details
    Browse the repository at this point in the history