Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✨Source Plaid: Migrate Python CDK to No-code CDK #29127

Merged
merged 40 commits into from Aug 17, 2023
Merged
Show file tree
Hide file tree
Changes from 38 commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
7a59078
airbyte: add no-code plaid connector
masyagin1998 Aug 6, 2023
c2d2f6b
airbyte: add support of `/transactions/get` api
masyagin1998 Aug 7, 2023
9c5935a
airbyte: add airbyte_secret to access_token
masyagin1998 Aug 7, 2023
0df79e9
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 7, 2023
ab5cc9e
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 8, 2023
36f7d86
airbyte: add .dockerignore file
masyagin1998 Aug 8, 2023
92d178d
Merge branch 'plaid-no-code-connector' of github.com:masyagin1998/air…
masyagin1998 Aug 8, 2023
4099956
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 8, 2023
153d1bf
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 8, 2023
4e8a081
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 9, 2023
7852cf1
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 9, 2023
d65b2bc
airbyte: update plaid source to no-code
masyagin1998 Aug 9, 2023
7ced7ba
Merge branch 'plaid-no-code-connector' of github.com:masyagin1998/air…
masyagin1998 Aug 9, 2023
812137f
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 9, 2023
d56138d
airbyte: add incremental test
masyagin1998 Aug 9, 2023
e310553
Merge branch 'plaid-no-code-connector' of github.com:masyagin1998/air…
masyagin1998 Aug 9, 2023
08fc19e
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 9, 2023
61322a6
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 9, 2023
8bbb0b4
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 9, 2023
ec208ed
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 9, 2023
6963696
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 9, 2023
63e382e
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 10, 2023
60c1825
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 10, 2023
0d865b0
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 11, 2023
4b9d76d
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 11, 2023
b2a41e5
anecdote-api: requirements fix
masyagin1998 Aug 11, 2023
f5fdbe6
Merge branch 'plaid-no-code-connector' of github.com:masyagin1998/air…
masyagin1998 Aug 11, 2023
f8e7bfc
anecdote-api: fix requirements.txt
masyagin1998 Aug 11, 2023
da0a458
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 11, 2023
5debcff
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 12, 2023
f0f6f02
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 15, 2023
9555e81
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 15, 2023
83a4a24
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 16, 2023
e9e725b
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 17, 2023
79332fd
Merge branch 'master' into plaid-no-code-connector
sajarin Aug 17, 2023
8e22630
Merge branch 'master' into plaid-no-code-connector
masyagin1998 Aug 17, 2023
728537a
fix: update versioning
sajarin Aug 17, 2023
7089a54
versioning
sh4sh Aug 17, 2023
ed6d71a
versioning
sh4sh Aug 17, 2023
5031a6e
update changelog
sh4sh Aug 17, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-plaid/Dockerfile
Expand Up @@ -34,5 +34,5 @@ COPY source_plaid ./source_plaid
ENV AIRBYTE_ENTRYPOINT "python /airbyte/integration_code/main.py"
ENTRYPOINT ["python", "/airbyte/integration_code/main.py"]

LABEL io.airbyte.version=0.3.2
LABEL io.airbyte.version=0.4.2
sh4sh marked this conversation as resolved.
Show resolved Hide resolved
LABEL io.airbyte.name=airbyte/source-plaid
@@ -1,24 +1,31 @@
# See [Connector Acceptance Tests](https://docs.airbyte.com/connector-development/testing-connectors/connector-acceptance-tests-reference)
# for more information about how to configure these tests
connector_image: airbyte/source-plaid:dev
tests:
acceptance_tests:
spec:
- spec_path: "source_plaid/spec.json"
tests:
- spec_path: "source_plaid/spec.yaml"
connection:
- config_path: "secrets/config.json"
status: "succeed"
- config_path: "integration_tests/invalid_config.json"
status: "failed"
tests:
- config_path: "secrets/config.json"
status: "succeed"
- config_path: "integration_tests/invalid_config.json"
status: "failed"
discovery:
- config_path: "secrets/config.json"
tests:
- config_path: "secrets/config.json"
basic_read:
- config_path: "secrets/config.json"
configured_catalog_path: "integration_tests/configured_catalog.json"
empty_streams: []
tests:
- config_path: "secrets/config.json"
configured_catalog_path: "integration_tests/configured_catalog.json"
empty_streams: []
incremental:
- config_path: "secrets/config.json"
configured_catalog_path: "integration_tests/configured_catalog.json"
future_state_path: "integration_tests/abnormal_state.json"
tests:
- config_path: "secrets/config.json"
configured_catalog_path: "integration_tests/configured_catalog_incremental.json"
future_state:
future_state_path: "integration_tests/abnormal_state.json"
full_refresh:
- config_path: "secrets/config.json"
configured_catalog_path: "integration_tests/configured_catalog.json"
tests:
- config_path: "secrets/config.json"
configured_catalog_path: "integration_tests/configured_catalog.json"
1 change: 1 addition & 0 deletions airbyte-integrations/connectors/source-plaid/acceptance-test-docker.sh 100644 → 100755
@@ -1,2 +1,3 @@
#!/usr/bin/env sh

source "$(git rev-parse --show-toplevel)/airbyte-integrations/bases/connector-acceptance-test/acceptance-test-docker.sh"
@@ -0,0 +1,107 @@
{
"streams": [
{
"stream": {
"name": "balance",
"supported_sync_modes": ["full_refresh"],
"json_schema": {
"required": ["account_id", "current"],
"type": "object",
"properties": {
"account_id": {
"type": "string"
},
"available": {
"type": ["number", "null"]
},
"current": {
"type": "number"
},
"iso_currency_code": {
"type": ["string", "null"]
},
"limit": {
"type": ["number", "null"]
},
"unofficial_currency_code": {
"type": ["string", "null"]
}
}
}
},
"sync_mode": "full_refresh",
"destination_sync_mode": "overwrite"
},
{
"stream": {
"name": "transaction",
"supported_sync_modes": ["full_refresh", "incremental"],
"source_defined_cursor": true,
"json_schema": {
"type": "object",
"required": [
"account_id",
"amount",
"iso_currency_code",
"name",
"transaction_id",
"category",
"date",
"transaction_type"
],
"properties": {
"account_id": { "type": "string" },
"amount": { "type": "number" },
"category": { "type": "array", "items": { "type": "string" } },
"category_id": { "type": ["string", "null"] },
"date": { "type": "string" },
"iso_currency_code": { "type": "string" },
"name": { "type": "string" },
"payment_channel": { "type": ["string", "null"] },
"pending": { "type": ["boolean", "null"] },
"transaction_id": { "type": "string" },
"transaction_type": { "type": "string" },
"location": {
"type": ["object", "null"],
"properties": {
"address": { "type": ["string", "null"] },
"city": { "type": ["string", "null"] },
"country": { "type": ["string", "null"] },
"lat": { "type": ["string", "null"] },
"lon": { "type": ["string", "null"] },
"postal_code": { "type": ["string", "null"] },
"region": { "type": ["string", "null"] },
"store_number": { "type": ["string", "null"] }
}
},
"payment_meta": {
"type": ["object", "null"],
"properties": {
"by_order_of": { "type": ["string", "null"] },
"payee": { "type": ["string", "null"] },
"payer": { "type": ["string", "null"] },
"payment_method": { "type": ["string", "null"] },
"payment_processor": { "type": ["string", "null"] },
"ppd_id": { "type": ["string", "null"] },
"reason": { "type": ["string", "null"] },
"reference_number": { "type": ["string", "null"] }
}
},
"account_owner": { "type": ["string", "null"] },
"authorized_date": { "type": ["string", "null"] },
"authorized_datetime": { "type": ["string", "null"] },
"check_number": { "type": ["string", "null"] },
"datetime": { "type": ["string", "null"] },
"merchant_name": { "type": ["string", "null"] },
"pending_transaction_id": { "type": ["string", "null"] },
"personal_finance_category": { "type": ["string", "null"] },
"transaction_code": { "type": ["string", "null"] },
"unofficial_currency_code": { "type": ["string", "null"] }
}
}
},
"sync_mode": "incremental",
"destination_sync_mode": "append"
}
]
}
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-plaid/metadata.yaml
Expand Up @@ -2,7 +2,7 @@ data:
connectorSubtype: api
connectorType: source
definitionId: ed799e2b-2158-4c66-8da4-b40fe63bc72a
dockerImageTag: 0.3.2
dockerImageTag: 0.4.0
dockerRepository: airbyte/source-plaid
githubIssueLabel: source-plaid
icon: plaid.svg
Expand Down
@@ -1,2 +1,2 @@
# This file is autogenerated -- only edit if you know what you are doing. Use setup.py for declaring dependencies.
-e .
-e ../../bases/connector-acceptance-test
11 changes: 7 additions & 4 deletions airbyte-integrations/connectors/source-plaid/setup.py
Expand Up @@ -5,12 +5,15 @@

from setuptools import find_packages, setup

MAIN_REQUIREMENTS = ["airbyte-cdk", "plaid-python"]
MAIN_REQUIREMENTS = [
"airbyte-cdk~=0.1",
]

TEST_REQUIREMENTS = [
"requests-mock~=1.9.3",
"pytest~=6.2",
"pytest-mock~=3.6.1",
"pytest~=6.1",
"requests-mock~=1.9.3",
"connector-acceptance-test",
]

setup(
Expand All @@ -20,7 +23,7 @@
author_email="contact@airbyte.io",
packages=find_packages(),
install_requires=MAIN_REQUIREMENTS,
package_data={"": ["*.json"]},
package_data={"": ["*.json", "*.yaml", "schemas/*.json", "schemas/shared/*.json"]},
extras_require={
"tests": TEST_REQUIREMENTS,
},
Expand Down
@@ -1,5 +1,5 @@
#
# Copyright (c) 2021 Airbyte, Inc., all rights reserved.
# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
#


Expand Down