Added info about normalization costs to docs #22182
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
octavia-squidington-iv
added
the
area/documentation
sophia-wiley
commented
Jan 31, 2023
docs/cloud/core-concepts.md
Outdated
| @@ -146,8 +146,13 @@ After a sync is complete, Airbyte normalizes the data. When setting up a connect | |||
|
|
|||
| * Raw data (no normalization): Airbyte places the JSON blob version of your data in a table called `_airbyte_raw_<stream name>` | |||
| * Basic Normalization: Airbyte converts the raw JSON blob version of your data to the format of your destination. *Note: Not all destinations support normalization.* | |||
| * [dbt Cloud integration](https://docs.airbyte.com/cloud/dbt-cloud-integration): Airbyte integrates dbt Cloud, allowing you to use dbt Cloud for transforming and cleaning your data during the normalization process. | |||
There was a problem hiding this comment.
@mfsiega-airbyte Is this accurate?
There was a problem hiding this comment.
Phrasing suggestion: Airbyte's dbt Cloud integration allows you to use dbt Cloud for transforming and cleaning your data during the normalization process.
sophia-wiley
commented
Jan 31, 2023
| *Note: Custom normalization through dbt is not yet available for Airbyte Cloud.* | ||
| :::note | ||
|
|
||
| Normalizing data may cause an increase in your destination's compute cost. This cost will vary depending on the amount of data that is normalized and is not related to Airbyte credit usage. |
There was a problem hiding this comment.
@andyjih is there any other info you think users should know about normalization costs?
There was a problem hiding this comment.
I think this looks good to me!
andyjih
approved these changes
Feb 1, 2023
| *Note: Custom normalization through dbt is not yet available for Airbyte Cloud.* | ||
| :::note | ||
|
|
||
| Normalizing data may cause an increase in your destination's compute cost. This cost will vary depending on the amount of data that is normalized and is not related to Airbyte credit usage. |
There was a problem hiding this comment.
I think this looks good to me!
mfsiega-airbyte
approved these changes
Feb 1, 2023
Amruta-Ranade
approved these changes
Feb 1, 2023
docs/cloud/core-concepts.md
Outdated
| @@ -146,8 +146,13 @@ After a sync is complete, Airbyte normalizes the data. When setting up a connect | |||
|
|
|||
| * Raw data (no normalization): Airbyte places the JSON blob version of your data in a table called `_airbyte_raw_<stream name>` | |||
| * Basic Normalization: Airbyte converts the raw JSON blob version of your data to the format of your destination. *Note: Not all destinations support normalization.* | |||
| * [dbt Cloud integration](https://docs.airbyte.com/cloud/dbt-cloud-integration): Airbyte integrates dbt Cloud, allowing you to use dbt Cloud for transforming and cleaning your data during the normalization process. | |||
There was a problem hiding this comment.
Phrasing suggestion: Airbyte's dbt Cloud integration allows you to use dbt Cloud for transforming and cleaning your data during the normalization process.
This was referenced Feb 8, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Added information about normalization costs. Also removed information about dbt cloud transformations not being available yet.
Related to this PRD