Skip to content

Commit

Permalink
Destination Redshift - Reorder Spec options (airbytehq#34014)
Browse files Browse the repository at this point in the history
  • Loading branch information
@jbfbell @jatinyadav-cc
jbfbell authored and jatinyadav-cc committed Feb 26, 2024
1 parent 6acad8a commit 2b051a5
Show file tree
Hide file tree
Showing 4 changed files with 14 additions and 10 deletions.
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/destination-redshift/metadata.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ data:
connectorSubtype: database
connectorType: destination
definitionId: f7a7d195-377f-cf5b-70a5-be6b819019dc
dockerImageTag: 0.7.13
dockerImageTag: 0.7.14
dockerRepository: airbyte/destination-redshift
documentationUrl: https://docs.airbyte.com/integrations/destinations/redshift
githubIssueLabel: destination-redshift
Expand Down
17 changes: 10 additions & 7 deletions airbyte-integrations/connectors/destination-redshift/src/main/resources/spec.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -253,28 +253,31 @@
"type": "boolean",
"description": "(Early Access) Use <a href=\"https://docs.airbyte.com/understanding-airbyte/typing-deduping\" target=\"_blank\">Destinations V2</a>.",
"title": "Use Destinations V2 (Early Access)",
"order": 9
"order": 9,
"group": "connection"
},
"raw_data_schema": {
"type": "string",
"description": "(Early Access) The schema to write raw tables into",
"title": "Destinations V2 Raw Table Schema (Early Access)",
"order": 10
"order": 10,
"group": "connection"
},
"enable_incremental_final_table_updates": {
"type": "boolean",
"default": false,
"description": "When enabled your data will load into your final tables incrementally while your data is still being synced. When Disabled (the default), your data loads into your final tables once at the end of a sync. Note that this option only applies if you elect to create Final tables",
"title": "Enable Loading Data Incrementally to Final Tables",
"order": 11
"title": "Enable Loading Data Incrementally to Final Tables (Early Access)",
"order": 11,
"group": "connection"
},
"disable_type_dedupe": {
"type": "boolean",
"default": false,
"description": "Disable Writing Final Tables. WARNING! The data format in _airbyte_data is likely stable but there are no guarantees that other metadata columns will remain the same in future versions",
"title": "Disable Final Tables. (WARNING! Unstable option; Columns in raw table schema might change between versions)",
"order": 8,
"group": "advanced"
"title": "Disable Final Tables. (WARNING! Unstable option; Columns in raw table schema might change between versions) (Early Access)",
"order": 12,
"group": "connection"
}
},
"groups": [
Expand Down
3 changes: 2 additions & 1 deletion docs/integrations/destinations/redshift.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -215,8 +215,9 @@ Each stream will be output into its own raw table in Redshift. Each table will c

| Version | Date | Pull Request | Subject |
|:--------|:-----------|:-----------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| 0.7.14 | 2024-01-08 | [\#34014](https://github.com/airbytehq/airbyte/pull/34014) | Update order of options in spec |
| 0.7.13 | 2024-01-05 | [\#33948](https://github.com/airbytehq/airbyte/pull/33948) | Fix NPE when prepare tables fail; Add case sensitive session for super; Bastion heartbeats added |
| 0.7.12 | 2024-01-03 | [#33924](https://github.com/airbytehq/airbyte/pull/33924) | Add new ap-southeast-3 AWS region |
| 0.7.12 | 2024-01-03 | [\#33924](https://github.com/airbytehq/airbyte/pull/33924) | Add new ap-southeast-3 AWS region |
| 0.7.11 | 2024-01-04 | [\#33730](https://github.com/airbytehq/airbyte/pull/33730) | Internal code structure changes |
| 0.7.10 | 2024-01-04 | [\#33728](https://github.com/airbytehq/airbyte/pull/33728) | Allow users to disable final table creation |
| 0.7.9 | 2024-01-03 | [\#33877](https://github.com/airbytehq/airbyte/pull/33877) | Fix Jooq StackOverflowError |
Expand Down
2 changes: 1 addition & 1 deletion docs/release_notes/upgrading_to_destinations_v2.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -133,7 +133,7 @@ When you are done testing, you can disable or delete this testing connection, an
If you have written downstream transformations directly from the output of raw tables, or use the "Raw JSON" normalization setting, you should know that:

- Multiple column names are being updated (from `airbyte_ab_id` to `airbyte_raw_id`, and `airbyte_emitted_at` to `airbyte_extracted_at`).
- The location of raw tables will from now on default to an `airbyte` schema in your destination.
- The location of raw tables will from now on default to an `airbyte_internal` schema in your destination.
- When you upgrade to a [Destinations V2 compatible version](#destinations-v2-effective-versions) of your destination, we will leave a copy of your existing raw tables as they are, and new syncs will work from a new copy we make in the new `airbyte_internal` schema. Although existing downstream dashboards will go stale, they will not be broken.
- You can dual write by following the [steps above](#upgrading-connections-one-by-one-with-dual-writing) and copying your raw data to the schema of your newly created connection.

Expand Down

0 comments on commit 2b051a5

Please sign in to comment.