Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add trouble shooting guide around loading a lot of tables #3975

Merged
merged 2 commits into from
Jun 9, 2021

Conversation

marcosmarxm
Copy link
Member

What

Adding a new troubleshooting to a problem a user had.
@davinchia adding you because you help me on this and probably can validated the info or add more context too =)

How

Add docs

Recommended reading order

  1. data-loading.md
  2. new-connection.md

@github-actions github-actions bot added the area/documentation Improvements or additions to documentation label Jun 9, 2021
docs/faq/data-loading.md Outdated Show resolved Hide resolved
docs/troubleshooting/new-connection.md Outdated Show resolved Hide resolved
docs/troubleshooting/new-connection.md Outdated Show resolved Hide resolved
Copy link
Contributor

@davinchia davinchia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor changes. Information looks good otherwise. Feel free to merge after you address those.

docs/faq/data-loading.md Show resolved Hide resolved
docs/troubleshooting/new-connection.md Show resolved Hide resolved
docs/troubleshooting/new-connection.md Show resolved Hide resolved
docs/troubleshooting/new-connection.md Show resolved Hide resolved

## Using incremental sync, is it possible to add more fields when some new columns are added to a source table, or when a new table is added?

For the moment, incremental sync doesn't support schema changes, so you would need to perform a full refresh whenever that happens.
Here’s a related [Github issue](https://github.com/airbytehq/airbyte/issues/1601).

## There is a limit of how many tables one connection can handle?

Yes, for more than 6000 thousand tables could be a problem to load the information on UI.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

link this to the new-connection section? centralising this makes it easier to maintain.

something like `Yes. Please see the this section for more information.'

@marcosmarxm marcosmarxm merged commit 4881167 into master Jun 9, 2021
@marcosmarxm marcosmarxm deleted the marcosmarxm/trb-limit-table-loading branch June 9, 2021 20:17
@avaidyanatha avaidyanatha changed the title Add issue about loading a lot of tables Add trouble shooting guide around loading a lot of tables Jun 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants