Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Filter out ctid column from getting emitted to platform #26727

Closed
rodireich opened this issue May 30, 2023 · 1 comment
Closed

Filter out ctid column from getting emitted to platform #26727

rodireich opened this issue May 30, 2023 · 1 comment
Assignees
@subodh1810
Labels
connectors/source/postgres team/db-dw-sources Backlog for Database and Data Warehouse Sources team very-large-tables

Comments

@rodireich
Copy link
Contributor

rodireich commented May 30, 2023 •
edited
Loading

A SELECT query used for ctid may include the ctid column.
The column value should be filtered out and not included in any emitted AirbyteRecordMessage as it is a hidden system column that is useful only for the context of ctid based read by source.
@rodireich rodireich added connectors/source/postgres team/db-dw-sources Backlog for Database and Data Warehouse Sources team very-large-tables labels May 30, 2023
@subodh1810 subodh1810 self-assigned this Jun 21, 2023
@subodh1810
Copy link
Contributor

Will be closed by PR #27302

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@subodh1810 subodh1810

Labels
connectors/source/postgres team/db-dw-sources Backlog for Database and Data Warehouse Sources team very-large-tables
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@rodireich @subodh1810 @octavia-squidington-iii