Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

source-jira: unnesting of issue.fields in normalization fails #13969

Closed
caseywhoop opened this issue Jun 21, 2022 · 2 comments
Closed

source-jira: unnesting of issue.fields in normalization fails #13969

caseywhoop opened this issue Jun 21, 2022 · 2 comments
Labels

Comments

@caseywhoop
Copy link

Environment

  • Airbyte version: 0.38.4-alpha
  • OS Version / Instance: Default from Airbyte Dockerfile
  • Deployment: Kubernetes
  • Source Connector and version: Jira 0.2.20
  • Destination Connector and version: Redshift 0.3.37 (also replicated with postgres 0.3.19)
  • Step where error happened: Normalization

Current Behavior

When syncing the issues table, the issues.fields column contains a nested JSON that should be normalized out into a sub table, issues_fields. Issues_fields is being created, but it only contains the default airbyte columns, and none of the normalized data from issues.fields.

Expected Behavior

I would expect the issues_fields table to contain columns with data from the raw json in issues.fields. I would also expect some error message in the Normalization step of the logs, but it says everything succeeds.

Logs

logs-79.txt

Steps to Reproduce

  1. Set up Kubernetes Airbyte deployment
  2. Set up JIRA Source with Issues data
  3. Set up Redshift or Postgres Destination
  4. Sync Jira Issues to Destination with normalization turned on

Are you willing to submit a PR?

Not at the moment

@caseywhoop caseywhoop added needs-triage type/bug Something isn't working labels Jun 21, 2022
@alafanechere alafanechere changed the title JIRA Issues Normalization Fails Without Error source-jira: unnesting issue.fields in Normalization Fails Without Error Jun 22, 2022
@alafanechere alafanechere changed the title source-jira: unnesting issue.fields in Normalization Fails Without Error source-jira: unnesting of issue.fields in normalization fails Jun 22, 2022
@marcosmarxm
Copy link
Member

Duplicated of #8473

@caseywhoop
Copy link
Author

caseywhoop commented Jun 22, 2022

@alafanechere and @marcosmarxm I thinkissues.fields and issue.fields are two different source streams. My problem is with issues.fields. I have also tried every sync-mode, my issue is not limited to just the Incremental + Deduped mode.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants