Skip to content

Commit

Permalink
Source S3: pin CDK and moto (#34665)
Browse files Browse the repository at this point in the history
  • Loading branch information
clnoll authored Feb 1, 2024
1 parent 38d48d2 commit d05f473
Show file tree
Hide file tree
Showing 4 changed files with 6 additions and 7 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -218,9 +218,6 @@ acceptance_tests:
status: failed
discovery:
tests:
- config_path: secrets/config_iam_role.json
backward_compatibility_tests_config:
disable_for_version: "4.4.0" # new authentication added - IAM role
- config_path: secrets/config.json
backward_compatibility_tests_config:
disable_for_version: "4.0.3" # removing the `streams.*.file_type` field which was redundant with `streams.*.format`
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-s3/metadata.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ data:
connectorSubtype: file
connectorType: source
definitionId: 69589781-7828-43c5-9f63-8925b1c1ccc2
dockerImageTag: 4.4.0
dockerImageTag: 4.4.1
dockerRepository: airbyte/source-s3
documentationUrl: https://docs.airbyte.com/integrations/sources/s3
githubIssueLabel: source-s3
Expand Down
5 changes: 3 additions & 2 deletions airbyte-integrations/connectors/source-s3/setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -6,15 +6,16 @@
from setuptools import find_packages, setup

MAIN_REQUIREMENTS = [
"airbyte-cdk[file-based]>=0.57.7",
"airbyte-cdk[file-based]==0.59.2", # temporarily pin until concurrency can be released
"smart-open[s3]==5.1.0",
"wcmatch==8.4",
"dill==0.3.4",
"pytz",
"python-snappy==0.6.1",
]

TEST_REQUIREMENTS = ["requests-mock~=1.9.3", "pytest-mock~=3.6.1", "pytest~=6.1", "pandas==2.0.3", "docker", "moto"]
# temporarily pin moto due to use of `mock_sts`, which has been deprecated
TEST_REQUIREMENTS = ["requests-mock~=1.9.3", "pytest-mock~=3.6.1", "pytest~=6.1", "pandas==2.0.3", "docker", "moto==4.2.14"]

setup(
name="source_s3",
Expand Down
3 changes: 2 additions & 1 deletion docs/integrations/sources/s3.md
Original file line number Diff line number Diff line change
Expand Up @@ -321,7 +321,8 @@ To perform the text extraction from PDF and Docx files, the connector uses the [

| Version | Date | Pull Request | Subject |
|:--------|:-----------|:----------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------|
| 4.4.0 | 2023-01-12 | [33818](https://github.com/airbytehq/airbyte/pull/33818) | Add IAM Role Authentication |
| 4.4.1 | 2024-01-30 | [34665](https://github.com/airbytehq/airbyte/pull/34665) | Pin moto & CDK version |
| 4.4.0 | 2024-01-12 | [33818](https://github.com/airbytehq/airbyte/pull/33818) | Add IAM Role Authentication |
| 4.3.1 | 2024-01-04 | [33937](https://github.com/airbytehq/airbyte/pull/33937) | Prepare for airbyte-lib |
| 4.3.0 | 2023-12-14 | [33411](https://github.com/airbytehq/airbyte/pull/33411) | Bump CDK version to auto-set primary key for document file streams and support raw txt files |
| 4.2.4 | 2023-12-06 | [33187](https://github.com/airbytehq/airbyte/pull/33187) | Bump CDK version to hide source-defined primary key |
Expand Down

0 comments on commit d05f473

Please sign in to comment.