Source Salesforce: failed during normalization step

[alexandr-shegeda]

Clone from the issue airbyte-cloud/529

Environment

• Workspace Name: Superside
• Intercom Conversation: I don't have for this specific problem.
• Source Connector and Version: Salesforce 0.1.2
• Destination Connector and Version: Snowflake 0.3.16
• Step Issue Happened: During the sync at normalization step

Current Behavior

User is trying to use Salesforce connector, ALL streams available to sync data to Snowflake.
This is the current history from all attempts:

Logs

Complete logs for the latest failed sync: logs-5640-0.txt

There are two errors happened in this sync:

1. Reading data from Salesforce, the main error

2021-11-02 08:45:27 INFO  Sleeping 2 seconds while waiting for Job: 7506N000004QB7vQAG to complete
2021-11-02 08:45:27 ERROR Encountered an exception while reading stream SourceSalesforce
Traceback (most recent call last):
  File "/airbyte/integration_code/source_salesforce/source.py", line 79, in read
    internal_config=internal_config,
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 134, in _read_stream
    for record in record_iterator:
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 206, in _read_full_refresh
    for record in records:
  File "/airbyte/integration_code/source_salesforce/streams.py", line 256, in read_records
    raise Exception(f"Job for {self.name} stream using BULK API was failed")
Exception: Job for EntityDefinition stream using BULK API was failed

2021-11-02 08:45:27 ERROR Traceback (most recent call last):
2021-11-02 08:45:27 ERROR   File "/airbyte/integration_code/main.py", line 13, in <module>
2021-11-02 08:45:27 ERROR     launch(source, sys.argv[1:])
2021-11-02 08:45:27 ERROR   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 105, in launch
2021-11-02 08:45:27 ERROR     for message in source_entrypoint.run(parsed_args):
2021-11-02 08:45:27 ERROR   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 96, in run
2021-11-02 08:45:27 ERROR     for message in generator:
2021-11-02 08:45:27 ERROR   File "/airbyte/integration_code/source_salesforce/source.py", line 83, in read
2021-11-02 08:45:27 ERROR     raise e
2021-11-02 08:45:27 ERROR   File "/airbyte/integration_code/source_salesforce/source.py", line 79, in read
2021-11-02 08:45:27 ERROR     internal_config=internal_config,
2021-11-02 08:45:27 ERROR   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 134, in _read_stream
2021-11-02 08:45:27 ERROR     for record in record_iterator:
2021-11-02 08:45:27 ERROR   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 206, in _read_full_refresh
2021-11-02 08:45:27 ERROR     for record in records:
2021-11-02 08:45:27 ERROR   File "/airbyte/integration_code/source_salesforce/streams.py", line 256, in read_records
2021-11-02 08:45:27 ERROR     raise Exception(f"Job for {self.name} stream using BULK API was failed")
2021-11-02 08:45:27 ERROR Exception: Job for EntityDefinition stream using BULK API was failed
2021-11-02 08:45:59 INFO  Exit code for pod source-salesforce-worker-5640-0-ecbtj is 1
2021-11-02 08:45:59 INFO  Closed all resources for pod source-salesforce-worker-5640-0-ecbtj
2021-11-02 08:45:59 INFO  Source thread complete.
2021-11-02 08:45:59 INFO  Waiting for destination thread to join.

2. Snowflake error running normalization (this looks intermittent some attempts don't throw this error)

2021-11-02 09:12:31 INFO  09:12:31 | Finished running 574 table models in 828.65s.
2021-11-02 09:12:33 INFO  
2021-11-02 09:12:33 INFO  �[31mCompleted with 1 error and 0 warnings:�[0m
2021-11-02 09:12:33 INFO  
2021-11-02 09:12:33 INFO  �[33mDatabase Error in model ACTIONLINKGROUPTEMPLATE (models/generated/airbyte_tables/AIRBYTE_SCHEMA/ACTIONLINKGROUPTEMPLATE.sql)�[0m
2021-11-02 09:12:33 INFO    250003: Failed to execute request: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2021-11-02 09:12:33 INFO    compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_tables/AIRBYTE_SCHEMA/ACTIONLINKGROUPTEMPLATE.sql
2021-11-02 09:12:33 INFO  

A Snowflake troubleshooting page talking about the error.

Comments

The last sync failed 3 times ALL failed at normalization step:

Failed at normalization step with same error: 250003: Failed to execute request: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
Same as first.
Failed parsing a json object json.decoder.JSONDecodeError: Expecting ',' delimiter: line 1 column 540257 (char 540256) in normalization step