Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

source-airtable: discover generates incomplete schema #17794

Closed
Tracked by #11757
alafanechere opened this issue Oct 10, 2022 · 4 comments · Fixed by #20846
Closed
Tracked by #11757

source-airtable: discover generates incomplete schema #17794

alafanechere opened this issue Oct 10, 2022 · 4 comments · Fixed by #20846
Assignees
Labels

Comments

@alafanechere
Copy link
Contributor

Environment

  • Source-connector: source-airtable:0.1.2

Current Behavior

The generated catalog misses some fields on Airtable stream if these fields are null in the first row of a table.
It breaks downstream normization

Expected Behavior

The discovered catalog is complete

@bazarnov
Copy link
Collaborator

@alafanechere here is the explanation of what is happening during the discovery stage with this connector:
#11757 (comment)

This problem could be resolved only by accessing Metadata API, otherwise, we will have an incomplete or broken schema.

@alafanechere
Copy link
Contributor Author

@bazarnov I opened a PR to suggest a small improvement that could mitigate the problem a bit: #18491

@bazarnov
Copy link
Collaborator

I think this one could be closed for now, until we decide to use Metadata API

@YowanR
Copy link
Contributor

YowanR commented Nov 22, 2022

Hey all, FYI that there's some update on the Metadata part . It's in Beta but might be sufficient to unblock.
cc @lazebnyi can we just see if the changes from Airtable are enough to unblock? Probably work for Q1 2023 :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
4 participants