🐛 Source Zendesk Support: Tickets to BigQuery Denormalized keeps failing.

[zbrak]

Enviroment

• Airbyte version: 0.32.4-alpha
• OS Version / Instance: 1.21.5-gke.1302
• Deployment: Google Kubernetes Engine
• Source Connector and version: Zendesk Support 0.1.7
• Destination Connector and version: Bigquery Denormalized Struct
• Severity: High
• Step where error happened: Sync Job

Current Behavior

Tickets stream will not complete - have isolated to this stream - says error in error handling?

I've had similar issues with some ticket submissions (the source email) being exceptionally large, and maxes out ingest at 50k characters on a field.

Expected Behavior

Trying to pull our tickets down keeps failing. This is a key endpoint to replicate.

Logs

Logs attached!
logs-522-0.txt

Steps to Reproduce

1. Source Zendesk Support setup.
2. Destination BigQuery denormalized.
3. Connection with tickets as only source endpoint, incremental append.

[zbrak]

Further progress - was able to return full set, but unable to load into BigQuery this time...

logs-860-0.txt

[sherifnada]

@zbrak for the second sync, I'm not seeing any exceptions in the logs? Could you say more about what you're seeing?

[zbrak]

Sure! @sherifnada

Basically failing on the bigquery side, it tries to write over from the temp table, but the import job fails at the first line.

unsure if corruption from the description being too verbose (email tickets), or an issue in declaring the schema on bigquery?

[DoNotPanicUA]

Hi @zbrak ,
I fully reworked the BigQuery Denormalized destination a few weeks before Christmas. Many known bugs were fixed 🐛 🔥
Even in case you still have an issue, we need a new log.
May I ask you to try one more time using the latest destination and source versions?
Source Zendesk : 0.1.12
Destination BigQuery Denormalized : 0.2.7

[misteryeo]

@zbrak I'm going to close this out based on the above comment - if you find that the issue still persists, please let us know and reference this issue.