Skip to content

Commit

Permalink
Docs: more removal of dbt for T&D (#31567)
Browse files Browse the repository at this point in the history
  • Loading branch information
evantahler committed Oct 23, 2023
1 parent 556e9ad commit 30612bc
Show file tree
Hide file tree
Showing 2 changed files with 9 additions and 9 deletions.
6 changes: 6 additions & 0 deletions docs/understanding-airbyte/basic-normalization.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,11 @@
# Basic Normalization

:::danger

Basic normalization is being removed in favor of [Typing and Deduping](/understanding-airbyte/typing-deduping), as part of [Destinations V2](/release_notes/upgrading_to_destinations_v2). This pages remains as a guide for legacy connectors.

:::

## High-Level Overview

:::info
Expand Down
12 changes: 3 additions & 9 deletions docs/understanding-airbyte/connections/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -63,19 +63,13 @@ A sync mode is therefore, a combination of a source and destination mode togethe

## Optional operations

### Airbyte basic normalization
### Typing and Deduping

As described by the [Airbyte Protocol from the Airbyte Specifications](../airbyte-protocol.md), replication is composed of source connectors that are transmitting data in a JSON format. It is then written as such by the destination connectors.

On top of this replication, Airbyte provides the option to enable or disable an additional transformation step at the end of the sync called [basic normalization](../basic-normalization.md). This operation is:

- Only available for destinations that support dbt execution
- Automatically generates a pipeline or DAG of dbt transformation models to convert JSON blob objects into normalized tables
- Runs and applies these dbt models to the data written in the destination
As described by the [Airbyte Protocol from the Airbyte Specifications](../airbyte-protocol.md), replication is composed of source connectors that are transmitting data in a JSON format. It is then written as such by the destination connectors. On top of this replication, Airbyte's database and datawarehous destinations can provide converstions from the raw JSON data into type-cast relational columns. Learn more [here](/understanding-airbyte/typing-deduping).

:::note

Normalizing data may cause an increase in your destination's compute cost. This cost will vary depending on the amount of data that is normalized and is not related to Airbyte credit usage.
Typing and Deduping may cause an increase in your destination's compute cost. This cost will vary depending on the amount of data that is transformed and is not related to Airbyte credit usage.

:::

Expand Down

0 comments on commit 30612bc

Please sign in to comment.