Stripe to Redshift Sync failing with error (Airbyte: 0.34.4-alpha Stipe: 0.1.25 Redshift: 0.3.23)

[nthbooth-feedr]

Environment

• Airbyte version: 0.34.4-alpha
• OS Version / Instance: AWS EC2 T3a XL $ uname -a
  Linux eu-west-1.compute.internal 4.14.252-195.483.amzn2.x86_64 checkin catalogs #1 SMP Mon Nov 1 20:58:46 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
• Deployment: Docker
• Source Connector and version:Stripe 0.1.25
• Destination Connector and version: Redshift 0.3.23
• Severity: High
• Step where error happened: Sync job

Current Behavior

Sync fails with error seems to be in the redshift destination:
2021-12-21 18:30:30 �[43mdestination�[0m > 2021-12-21 18:30:30 �[32mINFO�[m i.a.i.d.r.RedshiftDestination(main):79 - {} - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination
2021-12-21 18:30:30 �[1;31mERROR�[m i.a.w.DefaultReplicationWorker(run):141 - Sync worker failed.
java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.RuntimeException: Source process exited with non-zero exit code 1
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:134) ~[io.airbyte-airbyte-workers-0.34.4-alpha.jar:?]
at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:49) ~[io.airbyte-airbyte-workers-0.34.4-alpha.jar:?]
at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:174) ~[io.airbyte-airbyte-workers-0.34.4-alpha.jar:?]
at java.lang.Thread.run(Thread.java:833) [?:?]
Suppressed: io.airbyte.workers.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.
at io.airbyte.workers.protocols.airbyte.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.34.4-alpha.jar:?]
at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:118) ~[io.airbyte-airbyte-workers-0.34.4-alpha.jar:?]
at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:49) ~[io.airbyte-airbyte-workers-0.34.4-alpha.jar:?]
at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:174) ~[io.airbyte-airbyte-workers-0.34.4-alpha.jar:?]
at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: Source process exited with non-zero exit code 1
at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$2(DefaultReplicationWorker.java:230) ~[io.airbyte-airbyte-workers-0.34.4-alpha.jar:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
... 1 more
Caused by: java.lang.RuntimeException: Source process exited with non-zero exit code 1
at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$2(DefaultReplicationWorker.java:222) ~[io.airbyte-airbyte-workers-0.34.4-alpha.jar:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
... 1 more
2021-12-21 18:30:30 �[32mINFO�[m i.a.w.DefaultReplicationWorker(run):165 - sync summary: io.airbyte.config.ReplicationAttemptSummary@708683f7[status=failed,recordsSynced=88359,bytesSynced=127797687,startTime=1640106688532,endTime=1640111430546]

Expected Behavior

Sync works!

Logs

logs-208-1.txt
logs-208-2.txt
logs-208-0.txt

[bazarnov]

@nthbooth-feedr
Is there any reason you're using not the latest version of source-stripe? (you're using Source Connector and version: Stripe 0.1.25)
Could you please try to update the connector to the 0.1.28 and try again?

[nthbooth-feedr]

It was the latest when I submitted this. I eneded up removing checkout_sessions_line_items
from the sync which stopped the issue occurring however I have resynced the schema and will run the sync again with the latest version and see what happens.

[misteryeo]

Did that resolve the issue @nthbooth-feedr?

[nthbooth-feedr]

I will upgrade tomorrow and we will see! -- Nick Booth CTO | Feedr Phone: 07957 640078 | Email: ***@***.*** | Slack: ***@***.***

…

On Wed, May 11, 2022 at 2:44 PM Andy ***@***.***> wrote: Did that resolve the issue @nthbooth-feedr <https://github.com/nthbooth-feedr>? — Reply to this email directly, view it on GitHub <#9038 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AUVUMRXUQ5Q32CJ3JZ2LFVTVJO2TDANCNFSM5KSK5BHQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

-- The information contained in this email and in any attachment/s may be proprietary and confidential in nature and is intended for the addressee/s only. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, retention or use of this information is prohibited. If you are our client or vendor, any information contained in this email or in any attachment/s is subject to the terms and conditions in your respective governing contract. The views expressed in this message are personal to the sender and unless specifically stated this e-mail does not constitute any part of an offer or contract. If you have received this email in error, please notify the sender immediately and delete the email. The sender does not accept liability for any errors or omissions in the contents of this message, which arise as a result of faulty email transmission. Feedr Limited - 09956874 - Registered in England - 20 Red Lion Street, London, United Kingdom, WC1R 4PQ