Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

estuary-cdk: support for initially disabled bindings #1496

Open
williamhbaker opened this issue Apr 16, 2024 · 0 comments
Open

estuary-cdk: support for initially disabled bindings #1496

williamhbaker opened this issue Apr 16, 2024 · 0 comments

Comments

@williamhbaker
Copy link
Member

ATF supports a concept of "selected streams", which will be enabled by defualt, and the rest of the discovered streams will be disabled by default. For example, source-salesforce uses this: https://github.com/estuary/airbyte/blob/master/airbyte-integrations/connectors/source-salesforce/selected_streams.json

The idea is that if a connector can discover hundreds and hundreds of streams but there's only a small set of those that users usually care about, its best not to capture and create collections for all of them, as this can cause downstream issues like limits on how many bindings a single materialization can have.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant