Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

S3, Azure Blob Storage, GCS, Weviate, Milvus, Chroma, Qdrant: Bump cdk version #32608

Merged
merged 10 commits into from
Nov 30, 2023
Merged

S3, Azure Blob Storage, GCS, Weviate, Milvus, Chroma, Qdrant: Bump cdk version #32608

Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
55fe7df
bump cdk version
Nov 16, 2023
261abde
add changelog
Nov 16, 2023
1e0c270
Automated Commit - Formatting Changes
flash1293 Nov 16, 2023
7511a82
Merge remote-tracking branch 'origin/master' into flash1293/bump-cdk
Nov 27, 2023
754458c
fix dockerfile
Nov 27, 2023
043d275
Merge branch 'master' into flash1293/bump-cdk
Nov 28, 2023
bab1dc3
merge in 32676
Nov 29, 2023
43f86a0
Merge branch 'master' into flash1293/bump-cdk
Nov 29, 2023
113332f
Merge branch 'master' into flash1293/bump-cdk
Nov 29, 2023
034a536
Merge branch 'master' into flash1293/bump-cdk
Nov 29, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-chroma/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,5 +41,5 @@ COPY destination_chroma ./destination_chroma
ENV AIRBYTE_ENTRYPOINT "python /airbyte/integration_code/main.py"
ENTRYPOINT ["python", "/airbyte/integration_code/main.py"]

LABEL io.airbyte.version=0.0.6
LABEL io.airbyte.version=0.0.7
LABEL io.airbyte.name=airbyte/destination-chroma
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-chroma/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ data:
connectorSubtype: vectorstore
connectorType: destination
definitionId: 0b75218b-f702-4a28-85ac-34d3d84c0fc2
dockerImageTag: 0.0.6
dockerImageTag: 0.0.7
dockerRepository: airbyte/destination-chroma
githubIssueLabel: destination-chroma
icon: chroma.svg
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-chroma/setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
from setuptools import find_packages, setup

MAIN_REQUIREMENTS = [
"airbyte-cdk[vector-db-based]==0.53.3",
"airbyte-cdk[vector-db-based]==0.53.8",
"chromadb",
]

Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-milvus/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ data:
connectorSubtype: vectorstore
connectorType: destination
definitionId: 65de8962-48c9-11ee-be56-0242ac120002
dockerImageTag: 0.0.9
dockerImageTag: 0.0.10
dockerRepository: airbyte/destination-milvus
githubIssueLabel: destination-milvus
icon: milvus.svg
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-milvus/setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@

from setuptools import find_packages, setup

MAIN_REQUIREMENTS = ["airbyte-cdk[vector-db-based]==0.53.3", "pymilvus==2.3.0"]
MAIN_REQUIREMENTS = ["airbyte-cdk[vector-db-based]==0.53.8", "pymilvus==2.3.0"]

TEST_REQUIREMENTS = ["pytest~=6.2"]

Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-qdrant/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,5 +41,5 @@ COPY destination_qdrant ./destination_qdrant
ENV AIRBYTE_ENTRYPOINT "python /airbyte/integration_code/main.py"
ENTRYPOINT ["python", "/airbyte/integration_code/main.py"]

LABEL io.airbyte.version=0.0.7
LABEL io.airbyte.version=0.0.8
LABEL io.airbyte.name=airbyte/destination-qdrant
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-qdrant/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ data:
connectorSubtype: vectorstore
connectorType: destination
definitionId: 6eb1198a-6d38-43e5-aaaa-dccd8f71db2b
dockerImageTag: 0.0.7
dockerImageTag: 0.0.8
dockerRepository: airbyte/destination-qdrant
githubIssueLabel: destination-qdrant
icon: qdrant.svg
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-qdrant/setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@

from setuptools import find_packages, setup

MAIN_REQUIREMENTS = ["airbyte-cdk[vector-db-based]==0.53.3", "qdrant-client", "fastembed"]
MAIN_REQUIREMENTS = ["airbyte-cdk[vector-db-based]==0.53.8", "qdrant-client", "fastembed"]

TEST_REQUIREMENTS = ["pytest~=6.2"]

Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-weaviate/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ data:
connectorSubtype: vectorstore
connectorType: destination
definitionId: 7b7d7a0d-954c-45a0-bcfc-39a634b97736
dockerImageTag: 0.2.9
dockerImageTag: 0.2.10
dockerRepository: airbyte/destination-weaviate
documentationUrl: https://docs.airbyte.com/integrations/destinations/weaviate
githubIssueLabel: destination-weaviate
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-weaviate/setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@

from setuptools import find_packages, setup

MAIN_REQUIREMENTS = ["airbyte-cdk[vector-db-based]==0.53.3", "weaviate-client==3.25.2"]
MAIN_REQUIREMENTS = ["airbyte-cdk[vector-db-based]==0.53.8", "weaviate-client==3.25.2"]

TEST_REQUIREMENTS = ["pytest~=6.2", "docker", "pytest-docker"]

Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-azure-blob-storage/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ data:
connectorSubtype: file
connectorType: source
definitionId: fdaaba68-4875-4ed9-8fcd-4ae1e0a25093
dockerImageTag: 0.2.3
dockerImageTag: 0.2.4
dockerRepository: airbyte/source-azure-blob-storage
documentationUrl: https://docs.airbyte.com/integrations/sources/azure-blob-storage
githubIssueLabel: source-azure-blob-storage
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-azure-blob-storage/setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
from setuptools import find_packages, setup

MAIN_REQUIREMENTS = [
"airbyte-cdk[file-based]>=0.53.5",
"airbyte-cdk[file-based]>=0.53.8",
"smart_open[azure]",
"pytz",
]
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-gcs/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ data:
connectorSubtype: file
connectorType: source
definitionId: 2a8c41ae-8c23-4be0-a73f-2ab10ca1a820
dockerImageTag: 0.3.1
dockerImageTag: 0.3.2
dockerRepository: airbyte/source-gcs
documentationUrl: https://docs.airbyte.com/integrations/sources/gcs
githubIssueLabel: source-gcs
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-gcs/setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
from setuptools import find_packages, setup

MAIN_REQUIREMENTS = [
"airbyte-cdk[file-based]>=0.53.5",
"airbyte-cdk[file-based]>=0.53.8",
"google-cloud-storage==2.12.0",
"smart-open[s3]==5.1.0",
"pandas==1.5.3",
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-s3/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ data:
connectorSubtype: file
connectorType: source
definitionId: 69589781-7828-43c5-9f63-8925b1c1ccc2
dockerImageTag: 4.2.2
dockerImageTag: 4.2.3
dockerRepository: airbyte/source-s3
documentationUrl: https://docs.airbyte.com/integrations/sources/s3
githubIssueLabel: source-s3
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-s3/setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
from setuptools import find_packages, setup

MAIN_REQUIREMENTS = [
"airbyte-cdk[file-based]>=0.53.5",
"airbyte-cdk[file-based]>=0.53.8",
"smart-open[s3]==5.1.0",
"wcmatch==8.4",
"dill==0.3.4",
Expand Down
1 change: 1 addition & 0 deletions docs/integrations/destinations/chroma.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -76,6 +76,7 @@ You should now have all the requirements needed to configure Chroma as a destina

| Version | Date | Pull Request | Subject |
| :------ | :--------- | :--------------------------------------------------------- | :----------------------------------------- |
| 0.0.7 | 2023-11-16 | [32608](https://github.com/airbytehq/airbyte/pull/32608) | Support deleting records for CDC sources |
| 0.0.6 | 2023-11-13 | [32357](https://github.com/airbytehq/airbyte/pull/32357) | Improve spec schema |
| 0.0.5 | 2023-10-23 | [#31563](https://github.com/airbytehq/airbyte/pull/31563) | Add field mapping option |
| 0.0.4 | 2023-10-15 | [#31329](https://github.com/airbytehq/airbyte/pull/31329) | Add OpenAI-compatible embedder option |
Expand Down
3 changes: 2 additions & 1 deletion docs/integrations/destinations/milvus.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ You'll need the following information to configure the destination:
| :----------------------------- | :------------------- | :---- |
| Full Refresh Sync | Yes | |
| Incremental - Append Sync | Yes | |
| Incremental - Append + Deduped | Yes | Deleting records via CDC is not supported (see issue [#29827](https://github.com/airbytehq/airbyte/issues/29827)) |
| Incremental - Append + Deduped | Yes | |
| Partitions | No | |
| Record-defined ID | No | Auto-id needs to be enabled |

Expand Down Expand Up @@ -109,6 +109,7 @@ vector_store.similarity_search("test")

| Version | Date | Pull Request | Subject |
|:--------| :--------- |:--------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------|
| 0.0.10 | 2023-11-16 | [32608](https://github.com/airbytehq/airbyte/pull/32608) | Support deleting records for CDC sources |
| 0.0.9 | 2023-11-13 | [32357](https://github.com/airbytehq/airbyte/pull/32357) | Improve spec schema |
| 0.0.8 | 2023-11-08 | [#31563](https://github.com/airbytehq/airbyte/pull/32262) | Auto-create collection if it doesn't exist |
| 0.0.7 | 2023-10-23 | [#31563](https://github.com/airbytehq/airbyte/pull/31563) | Add field mapping option |
Expand Down
1 change: 1 addition & 0 deletions docs/integrations/destinations/qdrant.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -71,6 +71,7 @@ You should now have all the requirements needed to configure Qdrant as a destina

| Version | Date | Pull Request | Subject |
| :------ | :--------- | :--------------------------------------------------------- | :----------------------------------------- |
| 0.0.8 | 2023-11-16 | [32608](https://github.com/airbytehq/airbyte/pull/32608) | Support deleting records for CDC sources |
| 0.0.7 | 2023-11-13 | [32357](https://github.com/airbytehq/airbyte/pull/32357) | Improve spec schema |
| 0.0.6 | 2023-10-23 | [#31563](https://github.com/airbytehq/airbyte/pull/31563) | Add field mapping option |
| 0.0.5 | 2023-10-15 | [#31329](https://github.com/airbytehq/airbyte/pull/31329) | Add OpenAI-compatible embedder option |
Expand Down
3 changes: 2 additions & 1 deletion docs/integrations/destinations/weaviate.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ You'll need the following information to configure the destination:
| :----------------------------- | :------------------- | :---- |
| Full Refresh Sync | Yes | |
| Incremental - Append Sync | Yes | |
| Incremental - Append + Deduped | Yes | Deleting records via CDC is not supported (see issue [#29827](https://github.com/airbytehq/airbyte/issues/29827)) |
| Incremental - Append + Deduped | Yes | |
| Namespaces | No | |
| Provide vector | Yes | Either from field are calculated during the load process |

Expand Down Expand Up @@ -83,6 +83,7 @@ As properties have to start will a lowercase letter in Weaviate, field names mig

| Version | Date | Pull Request | Subject |
| :------ | :--------- | :--------------------------------------------------------- | :------------------------------------------------------------------------------------------------------------------------------- |
| 0.2.10 | 2023-11-16 | [32608](https://github.com/airbytehq/airbyte/pull/32608) | Support deleting records for CDC sources |
| 0.2.9 | 2023-11-13 | [32357](https://github.com/airbytehq/airbyte/pull/32357) | Improve spec schema |
| 0.2.8 | 2023-11-03 | [#32134](https://github.com/airbytehq/airbyte/pull/32134) | Improve test coverage |
| 0.2.7 | 2023-11-03 | [#32134](https://github.com/airbytehq/airbyte/pull/32134) | Upgrade weaviate client library |
Expand Down
1 change: 1 addition & 0 deletions docs/integrations/sources/azure-blob-storage.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -193,6 +193,7 @@ To perform the text extraction from PDF and Docx files, the connector uses the [

| Version | Date | Pull Request | Subject |
|:--------|:-----------|:------------------------------------------------|:------------------------------------------------------------------------|
| 0.2.4 | 2023-11-16 | [32608](https://github.com/airbytehq/airbyte/pull/32608) | Improve document file type parser |
| 0.2.3 | 2023-11-13 | [32357](https://github.com/airbytehq/airbyte/pull/32357) | Improve spec schema |
| 0.2.2 | 2023-10-30 | [31904](https://github.com/airbytehq/airbyte/pull/31904) | Update CDK to support document file types |
| 0.2.1 | 2023-10-18 | [31543](https://github.com/airbytehq/airbyte/pull/31543) | Base image migration: remove Dockerfile and use the python-connector-base image |
Expand Down
1 change: 1 addition & 0 deletions docs/integrations/sources/gcs.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,7 @@ Use the service account ID from above, grant read access to your target bucket.

| Version | Date | Pull Request | Subject |
|:--------|:-----------|:---------------------------------------------------------|:---------------------------|
| 0.3.2 | 2023-11-16 | [32608](https://github.com/airbytehq/airbyte/pull/32608) | Improve document file type parser |
| 0.3.1 | 2023-11-13 | [32357](https://github.com/airbytehq/airbyte/pull/32357) | Improve spec schema |
| 0.3.0 | 2023-10-11 | [31212](https://github.com/airbytehq/airbyte/pull/31212) | Migrated to file based CDK |
| 0.2.0 | 2023-06-26 | [27725](https://github.com/airbytehq/airbyte/pull/27725) | License Update: Elv2 |
Expand Down
1 change: 1 addition & 0 deletions docs/integrations/sources/s3.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -256,6 +256,7 @@ To perform the text extraction from PDF and Docx files, the connector uses the [

| Version | Date | Pull Request | Subject |
|:--------|:-----------|:----------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------|
| 4.2.3 | 2023-11-16 | [32608](https://github.com/airbytehq/airbyte/pull/32608) | Improve document file type parser |
| 4.2.2 | 2023-11-20 | [32677](https://github.com/airbytehq/airbyte/pull/32677) | Only read files with ".zip" extension as zipped files |
| 4.2.1 | 2023-11-13 | [32357](https://github.com/airbytehq/airbyte/pull/32357) | Improve spec schema |
| 4.2.0 | 2023-11-02 | [32109](https://github.com/airbytehq/airbyte/pull/32109) | Fix docs; add HTTPS validation for S3 endpoint; fix coverage |
Expand Down
Loading