Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Checkpoint doesn't work when source/destination disconnects and retry will restart from init again. #6413

Closed
lorriexingfang86 opened this issue Sep 23, 2021 · 9 comments
Closed

Checkpoint doesn't work when source/destination disconnects and retry will restart from init again. #6413

lorriexingfang86 opened this issue Sep 23, 2021 · 9 comments
Assignees
@sashaNeshcheret
Labels
area/connectors Connector related issues area/databases connectors/destination/postgres connectors/destinations-database type/bug Something isn't working

Comments

@lorriexingfang86
Copy link

lorriexingfang86 commented Sep 23, 2021 •
edited

Got "Sync worker failed" when syncing 70GB data from source to destination

Enviroment

  • Airbyte version: 0.29.19-alpha
  • OS Version / Instance: macOS
  • Deployment: Docker Desktop
  • Source Connector and version: Postgres DB
  • Destination Connector and version: Postgres DB
  • Severity: High
  • Step where error happened: Sync job

Current Behavior

I want to sync up about 70GB data from source (Postgres DB A) to destination (Postgres DB B).

It runs for 10+ hours and encountered

Sync worker failed.
It was stuck at there and had 2 attempts until I canceled it. From UI I found this job has 63.08 GB data with 17M+ records.

Expected Behavior

It should finish syncing and I should be able to see all source records in destination.

Logs

Please see complete log from attachment: logs-19-0.txt
logs-19-0 (1).txt

LOG 

2021-09-23 21:12:31 INFO () WorkerRun(call):62 - Executing worker wrapper. Airbyte version: 0.29.19-alpha
2021-09-23 21:12:32 INFO () TemporalAttemptExecution(get):114 - Executing worker wrapper. Airbyte version: 0.29.19-alpha
2021-09-23 21:12:32 WARN () Databases(createPostgresDatabaseWithRetry):58 - Waiting for database to become available...
2021-09-23 21:12:32 INFO () JobsDatabaseInstance(lambda$static$2):45 - Testing if jobs database is ready...
2021-09-23 21:12:33 INFO () Databases(createPostgresDatabaseWithRetry):75 - Database available!
2021-09-23 21:12:34 INFO () DefaultReplicationWorker(run):102 - start sync worker. job id: 20 attempt id: 0
2021-09-23 21:12:34 INFO () DefaultReplicationWorker(run):111 - configured sync modes: {public.statements=full_refresh - append, public.patients=full_refresh - append}
2021-09-23 21:12:34 INFO () DefaultAirbyteDestination(start):78 - Running destination...
2021-09-23 21:12:34 INFO () LineGobbler(voidCall):85 - Checking if airbyte/destination-postgres:0.3.11 exists...
2021-09-23 21:12:35 INFO () LineGobbler(voidCall):85 - airbyte/destination-postgres:0.3.11 was found locally.
2021-09-23 21:12:35 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/20/0 --network host --log-driver none airbyte/destination-postgres:0.3.11 write --config destination_config.json --catalog destination_catalog.json
2021-09-23 21:12:35 INFO () LineGobbler(voidCall):85 - Checking if airbyte/source-postgres:0.3.11 exists...
2021-09-23 21:12:35 INFO () LineGobbler(voidCall):85 - airbyte/source-postgres:0.3.11 was found locally.
2021-09-23 21:12:35 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/20/0 --network host --log-driver none airbyte/source-postgres:0.3.11 read --config source_config.json --catalog source_catalog.json --state input_state.json
2021-09-23 21:12:35 INFO () DefaultReplicationWorker(run):139 - Waiting for source thread to join.
2021-09-23 21:12:35 INFO () DefaultReplicationWorker(lambda$getDestinationOutputRunnable$3):246 - Destination output thread started.
2021-09-23 21:12:35 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):210 - Replication thread started.
2021-09-23 21:12:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:39 �[32mINFO�[m i.a.i.s.p.PostgresSource(main):267 - {} - starting source: class io.airbyte.integrations.source.postgres.PostgresSource
2021-09-23 21:12:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:39 �[32mINFO�[m i.a.i.d.p.PostgresDestination(main):85 - {} - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination
2021-09-23 21:12:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:39 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):96 - {} - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2021-09-23 21:12:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:39 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):96 - {} - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination
2021-09-23 21:12:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:39 �[32mINFO�[m i.a.i.b.IntegrationCliParser(parseOptions):135 - {} - integration args: {read=null, catalog=source_catalog.json, state=input_state.json, config=source_config.json}
2021-09-23 21:12:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:39 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):100 - {} - Command: READ
2021-09-23 21:12:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:39 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):101 - {} - Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='input_state.json'}
2021-09-23 21:12:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:39 �[32mINFO�[m i.a.i.b.IntegrationCliParser(parseOptions):135 - {} - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2021-09-23 21:12:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:39 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):100 - {} - Command: WRITE
2021-09-23 21:12:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:39 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):101 - {} - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[32mINFO�[m i.a.i.b.s.SshTunnel(getInstance):190 - {} - Starting connection with method: NO_TUNNEL
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[32mINFO�[m i.a.i.b.s.SshTunnel(getInstance):190 - {} - Starting connection with method: NO_TUNNEL
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=patients, namespace=public, outputSchemaName=public, tmpTableName=_airbyte_tmp_djo_patients, outputTableName=_airbyte_raw_patients, syncMode=append}
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=statements, namespace=public, outputSchemaName=public, tmpTableName=_airbyte_tmp_rjb_statements, outputTableName=_airbyte_raw_statements, syncMode=append}
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[32mINFO�[m i.a.i.d.b.BufferedStreamConsumer(startTracked):143 - {} - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):139 - {} - Preparing tmp tables in destination started for 2 streams
2021-09-23 21:12:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:40 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream patients. schema: public, tmp table name: _airbyte_tmp_djo_patients
2021-09-23 21:12:42 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:42 �[32mINFO�[m i.a.i.s.p.PostgresSource(isCdc):217 - {} - using CDC: false
2021-09-23 21:12:42 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:42 �[32mINFO�[m i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):97 - {} - Attempting to get metadata from the database to see if we can connect.
2021-09-23 21:12:42 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:42 �[32mINFO�[m i.a.i.s.r.CdcStateManager(<init>):46 - {} - Initialized CDC state with: null
2021-09-23 21:12:42 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:42 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='statements', namespace='public'}, New Cursor Field: null. Resetting cursor value
2021-09-23 21:12:42 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:42 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='patients', namespace='public'}, New Cursor Field: null. Resetting cursor value
2021-09-23 21:12:42 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:42 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream statements. schema: public, tmp table name: _airbyte_tmp_rjb_statements
2021-09-23 21:12:43 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:43 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):149 - {} - Preparing tables in destination completed.
2021-09-23 21:12:46 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:46 �[32mINFO�[m i.a.i.s.p.PostgresSource(isCdc):217 - {} - using CDC: false
2021-09-23 21:12:46 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:46 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(queryTableFullRefresh):468 - {} - Queueing query for table: patients
2021-09-23 21:12:46 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:12:46 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(queryTableFullRefresh):468 - {} - Queueing query for table: statements
2021-09-23 21:12:48 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 1000
2021-09-23 21:12:49 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 2000
2021-09-23 21:12:49 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 3000
2021-09-23 21:12:51 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 4000
2021-09-23 21:12:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 5000
2021-09-23 21:12:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 6000
2021-09-23 21:12:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 7000
2021-09-23 21:12:56 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 8000
2021-09-23 21:12:57 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 9000
2021-09-23 21:12:58 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 10000
2021-09-23 21:13:15 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 11000
2021-09-23 21:13:16 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 12000
2021-09-23 21:13:17 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 13000
2021-09-23 21:13:17 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:13:17 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 10000
2021-09-23 21:13:18 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 14000
2021-09-23 21:13:19 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 15000
2021-09-23 21:13:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 16000
2021-09-23 21:13:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 17000
2021-09-23 21:13:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 18000
2021-09-23 21:13:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 19000
2021-09-23 21:13:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 20000
2021-09-23 21:13:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 21000
2021-09-23 21:13:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 22000
2021-09-23 21:13:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 23000
2021-09-23 21:13:54 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:13:54 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 20000
2021-09-23 21:13:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 24000
2021-09-23 21:13:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 25000
2021-09-23 21:13:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 26000
2021-09-23 21:13:56 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 27000
2021-09-23 21:13:56 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 28000
2021-09-23 21:13:57 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 29000
2021-09-23 21:13:57 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 30000
2021-09-23 21:14:17 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 31000
2021-09-23 21:14:17 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 32000
2021-09-23 21:14:18 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 33000
2021-09-23 21:14:18 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:14:18 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 30000
2021-09-23 21:14:18 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 34000
2021-09-23 21:14:19 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 35000
2021-09-23 21:14:19 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 36000
2021-09-23 21:14:20 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 37000
2021-09-23 21:14:20 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 38000
2021-09-23 21:14:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 39000
2021-09-23 21:14:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 40000
2021-09-23 21:14:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 41000
2021-09-23 21:14:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42000
2021-09-23 21:14:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 43000
2021-09-23 21:14:43 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:14:43 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 40000
2021-09-23 21:14:44 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 44000
2021-09-23 21:14:44 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 45000
2021-09-23 21:14:44 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 46000
2021-09-23 21:14:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 47000
2021-09-23 21:14:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 48000
2021-09-23 21:14:46 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 49000
2021-09-23 21:14:46 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 50000
2021-09-23 21:15:12 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 51000
2021-09-23 21:15:12 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 52000
2021-09-23 21:15:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 53000
2021-09-23 21:15:13 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:15:13 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 50000
2021-09-23 21:15:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 54000
2021-09-23 21:15:14 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 55000
2021-09-23 21:15:14 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 56000
2021-09-23 21:15:14 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 57000
2021-09-23 21:15:15 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 58000
2021-09-23 21:15:15 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 59000
2021-09-23 21:15:16 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 60000
2021-09-23 21:15:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 61000
2021-09-23 21:15:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 62000
2021-09-23 21:15:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 63000
2021-09-23 21:15:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:15:53 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 60000
2021-09-23 21:15:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 64000
2021-09-23 21:15:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 65000
2021-09-23 21:15:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 66000
2021-09-23 21:15:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 67000
2021-09-23 21:15:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 68000
2021-09-23 21:15:56 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 69000
2021-09-23 21:15:58 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 70000
2021-09-23 21:16:35 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 71000
2021-09-23 21:16:41 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 72000
2021-09-23 21:16:44 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 73000
2021-09-23 21:16:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:16:44 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 70000
2021-09-23 21:16:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 74000
2021-09-23 21:16:46 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 75000
2021-09-23 21:16:47 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 76000
2021-09-23 21:16:47 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 77000
2021-09-23 21:16:48 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 78000
2021-09-23 21:16:49 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 79000
2021-09-23 21:16:49 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 80000
2021-09-23 21:17:30 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 81000
2021-09-23 21:17:30 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 82000
2021-09-23 21:17:31 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 83000
2021-09-23 21:17:31 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:17:31 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 80000
2021-09-23 21:17:31 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 84000
2021-09-23 21:17:32 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 85000
2021-09-23 21:17:32 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 86000
2021-09-23 21:17:33 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 87000
2021-09-23 21:17:33 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 88000
2021-09-23 21:17:34 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 89000
2021-09-23 21:17:34 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 90000
2021-09-23 21:18:11 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 91000
2021-09-23 21:18:12 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 92000
2021-09-23 21:18:12 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 93000
2021-09-23 21:18:12 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:18:12 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 90000
2021-09-23 21:18:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 94000
2021-09-23 21:18:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 95000
2021-09-23 21:18:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 96000
2021-09-23 21:18:14 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 97000
2021-09-23 21:18:15 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 98000
2021-09-23 21:18:15 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 99000
2021-09-23 21:18:16 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 100000
2021-09-23 21:18:48 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 101000
2021-09-23 21:18:48 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 102000
2021-09-23 21:18:49 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 103000
2021-09-23 21:18:49 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:18:49 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 100000
2021-09-23 21:18:50 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 104000
2021-09-23 21:18:50 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 105000
2021-09-23 21:18:50 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 106000
2021-09-23 21:18:51 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 107000
2021-09-23 21:18:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 108000
2021-09-23 21:18:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 109000
2021-09-23 21:18:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 110000
2021-09-23 21:19:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 111000
2021-09-23 21:19:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 112000
2021-09-23 21:19:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 113000
2021-09-23 21:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:19:25 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 110000
2021-09-23 21:19:26 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 114000
2021-09-23 21:19:26 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 115000
2021-09-23 21:19:27 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 116000
2021-09-23 21:19:27 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 117000
2021-09-23 21:19:27 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 118000
2021-09-23 21:19:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 119000
2021-09-23 21:19:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 120000
2021-09-23 21:20:05 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 121000
2021-09-23 21:20:06 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 122000
2021-09-23 21:20:06 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 123000
2021-09-23 21:20:06 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:20:06 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 120000
2021-09-23 21:20:07 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 124000
2021-09-23 21:20:07 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 125000
2021-09-23 21:20:07 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 126000
2021-09-23 21:20:08 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 127000
2021-09-23 21:20:08 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 128000
2021-09-23 21:20:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 129000
2021-09-23 21:20:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 130000
2021-09-23 21:20:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 131000
2021-09-23 21:20:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 132000
2021-09-23 21:20:44 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 133000
2021-09-23 21:20:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:20:44 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 130000
2021-09-23 21:20:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 134000
2021-09-23 21:20:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 135000
2021-09-23 21:20:46 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 136000
2021-09-23 21:20:46 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 137000
2021-09-23 21:20:47 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 138000
2021-09-23 21:20:47 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 139000
2021-09-23 21:20:48 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 140000
2021-09-23 21:21:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 141000
2021-09-23 21:21:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 142000
2021-09-23 21:21:29 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 143000
2021-09-23 21:21:29 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:21:29 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 140000
2021-09-23 21:21:29 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 144000
2021-09-23 21:21:29 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 145000
2021-09-23 21:21:30 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 146000
2021-09-23 21:21:30 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 147000
2021-09-23 21:21:31 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 148000
2021-09-23 21:21:31 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 149000
2021-09-23 21:21:31 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 150000
2021-09-23 21:22:11 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 151000
2021-09-23 21:22:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 152000
2021-09-23 21:22:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 153000
2021-09-23 21:22:14 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:22:13 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 150000
2021-09-23 21:22:14 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 154000
2021-09-23 21:22:14 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 155000
2021-09-23 21:22:15 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 156000
2021-09-23 21:22:15 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 157000
2021-09-23 21:22:16 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 158000
2021-09-23 21:22:16 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 159000
2021-09-23 21:22:17 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 160000
2021-09-23 21:22:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 161000
2021-09-23 21:22:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 162000
2021-09-23 21:22:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 163000
2021-09-23 21:22:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:22:55 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 160000
2021-09-23 21:22:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 164000
2021-09-23 21:22:56 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 165000
2021-09-23 21:22:56 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 166000
2021-09-23 21:22:57 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 167000
2021-09-23 21:22:57 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 168000
2021-09-23 21:22:58 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 169000
2021-09-23 21:22:58 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 170000
2021-09-23 21:23:37 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 171000
2021-09-23 21:23:38 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 172000
2021-09-23 21:23:38 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 173000
2021-09-23 21:23:38 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:23:38 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 170000
2021-09-23 21:23:38 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 174000
2021-09-23 21:23:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 175000
2021-09-23 21:23:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 176000
2021-09-23 21:23:40 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 177000
2021-09-23 21:23:41 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 178000
2021-09-23 21:23:41 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 179000
2021-09-23 21:23:41 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 180000
2021-09-23 21:24:20 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 181000
2021-09-23 21:24:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 182000
2021-09-23 21:24:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 183000
2021-09-23 21:24:21 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:24:21 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 180000
2021-09-23 21:24:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 184000
2021-09-23 21:24:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 185000
2021-09-23 21:24:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 186000
2021-09-23 21:24:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 187000
2021-09-23 21:24:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 188000
2021-09-23 21:24:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 189000
2021-09-23 21:24:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 190000
2021-09-23 21:24:51 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 191000
2021-09-23 21:24:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 192000
2021-09-23 21:24:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 193000
2021-09-23 21:24:52 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:24:52 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 190000
2021-09-23 21:24:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 194000
2021-09-23 21:24:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 195000
2021-09-23 21:24:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 196000
2021-09-23 21:24:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 197000
2021-09-23 21:24:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 198000
2021-09-23 21:24:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 199000
2021-09-23 21:24:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 200000
2021-09-23 21:25:30 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 201000
2021-09-23 21:25:31 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 202000
2021-09-23 21:25:31 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 203000
2021-09-23 21:25:32 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:25:31 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 200000
2021-09-23 21:25:32 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 204000
2021-09-23 21:25:32 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 205000
2021-09-23 21:25:33 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 206000
2021-09-23 21:25:33 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 207000
2021-09-23 21:25:34 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 208000
2021-09-23 21:25:34 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 209000
2021-09-23 21:25:35 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 210000
2021-09-23 21:26:05 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 211000
2021-09-23 21:26:06 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 212000
2021-09-23 21:26:07 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 213000
2021-09-23 21:26:07 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:26:07 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 210000
2021-09-23 21:26:07 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 214000
2021-09-23 21:26:08 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 215000
2021-09-23 21:26:08 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 216000
2021-09-23 21:26:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 217000
2021-09-23 21:26:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 218000
2021-09-23 21:26:10 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 219000
2021-09-23 21:26:10 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 220000
2021-09-23 21:26:38 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 221000
2021-09-23 21:26:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 222000
2021-09-23 21:26:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 223000
2021-09-23 21:26:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:26:39 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 220000
2021-09-23 21:26:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 224000
2021-09-23 21:26:40 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 225000
2021-09-23 21:26:40 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 226000
2021-09-23 21:26:41 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 227000
2021-09-23 21:26:41 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 228000
2021-09-23 21:26:42 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 229000
2021-09-23 21:26:42 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 230000
2021-09-23 21:27:11 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 231000
2021-09-23 21:27:12 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 232000
2021-09-23 21:27:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 233000
2021-09-23 21:27:13 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:27:13 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 230000
2021-09-23 21:27:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 234000
2021-09-23 21:27:14 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 235000
2021-09-23 21:27:15 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 236000
2021-09-23 21:27:17 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 237000
2021-09-23 21:27:17 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 238000
2021-09-23 21:27:18 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 239000
2021-09-23 21:27:19 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 240000
2021-09-23 21:27:59 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 241000
2021-09-23 21:27:59 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 242000
2021-09-23 21:28:00 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 243000
2021-09-23 21:28:00 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:28:00 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 240000
2021-09-23 21:28:00 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 244000
2021-09-23 21:28:01 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 245000
2021-09-23 21:28:01 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 246000
2021-09-23 21:28:02 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 247000
2021-09-23 21:28:02 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 248000
2021-09-23 21:28:03 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 249000
2021-09-23 21:28:03 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 250000
2021-09-23 21:28:59 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 251000
2021-09-23 21:29:00 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 252000
2021-09-23 21:29:00 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 253000
2021-09-23 21:29:00 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:29:00 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 250000
2021-09-23 21:29:00 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 254000
2021-09-23 21:29:01 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 255000
2021-09-23 21:29:01 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 256000
2021-09-23 21:29:02 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 257000
2021-09-23 21:29:02 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 258000
2021-09-23 21:29:03 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 259000
2021-09-23 21:29:03 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 260000
2021-09-23 21:29:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 261000
2021-09-23 21:29:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 262000
2021-09-23 21:29:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 263000
2021-09-23 21:29:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:29:54 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 260000
2021-09-23 21:29:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 264000
2021-09-23 21:29:56 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 265000
2021-09-23 21:29:56 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 266000
2021-09-23 21:29:57 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 267000
2021-09-23 21:29:57 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 268000
2021-09-23 21:29:58 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 269000
2021-09-23 21:29:58 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 270000
2021-09-23 21:30:38 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 271000
2021-09-23 21:30:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 272000
2021-09-23 21:30:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 273000
2021-09-23 21:30:40 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:30:39 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 270000
2021-09-23 21:30:40 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 274000
2021-09-23 21:30:40 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 275000
2021-09-23 21:30:41 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 276000
2021-09-23 21:30:41 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 277000
2021-09-23 21:30:42 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 278000
2021-09-23 21:30:42 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 279000
2021-09-23 21:30:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 280000
2021-09-23 21:31:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 281000
2021-09-23 21:31:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 282000
2021-09-23 21:31:29 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 283000
2021-09-23 21:31:29 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:31:29 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 280000
2021-09-23 21:31:29 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 284000
2021-09-23 21:31:29 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 285000
2021-09-23 21:31:30 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 286000
2021-09-23 21:31:30 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 287000
2021-09-23 21:31:31 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 288000
2021-09-23 21:31:31 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 289000
2021-09-23 21:31:32 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 290000
2021-09-23 21:32:18 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 291000
2021-09-23 21:32:20 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 292000
2021-09-23 21:32:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 293000
2021-09-23 21:32:21 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:32:21 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 290000
2021-09-23 21:32:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 294000
2021-09-23 21:32:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 295000
2021-09-23 21:32:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 296000
2021-09-23 21:32:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 297000
2021-09-23 21:32:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 298000
2021-09-23 21:32:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 299000
2021-09-23 21:32:26 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 300000
2021-09-23 21:32:58 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 301000
2021-09-23 21:32:59 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 302000
2021-09-23 21:33:00 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 303000
2021-09-23 21:33:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:33:00 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 300000
2021-09-23 21:33:01 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 304000
2021-09-23 21:33:01 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 305000
2021-09-23 21:33:02 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 306000
2021-09-23 21:33:03 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 307000
2021-09-23 21:33:04 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 308000
2021-09-23 21:33:04 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 309000
2021-09-23 21:33:05 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 310000
2021-09-23 21:33:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 311000
2021-09-23 21:33:46 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 312000
2021-09-23 21:33:46 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 313000
2021-09-23 21:33:46 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:33:46 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 310000
2021-09-23 21:33:47 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 314000
2021-09-23 21:33:47 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 315000
2021-09-23 21:33:48 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 316000
2021-09-23 21:33:48 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 317000
2021-09-23 21:33:49 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 318000
2021-09-23 21:33:49 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 319000
2021-09-23 21:33:50 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 320000
2021-09-23 21:34:41 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 321000
2021-09-23 21:34:42 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 322000
2021-09-23 21:34:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 323000
2021-09-23 21:34:43 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:34:43 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 320000
2021-09-23 21:34:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 324000
2021-09-23 21:34:44 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 325000
2021-09-23 21:34:44 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 326000
2021-09-23 21:34:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 327000
2021-09-23 21:34:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 328000
2021-09-23 21:34:46 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 329000
2021-09-23 21:34:46 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 330000
2021-09-23 21:35:36 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 331000
2021-09-23 21:35:36 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 332000
2021-09-23 21:35:37 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 333000
2021-09-23 21:35:37 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:35:37 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 330000
2021-09-23 21:35:37 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 334000
2021-09-23 21:35:38 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 335000
2021-09-23 21:35:38 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 336000
2021-09-23 21:35:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 337000
2021-09-23 21:35:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 338000
2021-09-23 21:35:40 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 339000
2021-09-23 21:35:40 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 340000
2021-09-23 21:36:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 341000
2021-09-23 21:36:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 342000
2021-09-23 21:36:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 343000
2021-09-23 21:36:22 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:36:22 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 340000
2021-09-23 21:36:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 344000
2021-09-23 21:36:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 345000
2021-09-23 21:36:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 346000
2021-09-23 21:36:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 347000
2021-09-23 21:36:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 348000
2021-09-23 21:36:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 349000
2021-09-23 21:36:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 350000
2021-09-23 21:37:06 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 351000
2021-09-23 21:37:07 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 352000
2021-09-23 21:37:07 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 353000
2021-09-23 21:37:07 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:37:07 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 350000
2021-09-23 21:37:07 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 354000
2021-09-23 21:37:08 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 355000
2021-09-23 21:37:08 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 356000
2021-09-23 21:37:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 357000
2021-09-23 21:37:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 358000
2021-09-23 21:37:10 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 359000
2021-09-23 21:37:10 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 360000
2021-09-23 21:37:50 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 361000
2021-09-23 21:37:51 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 362000
2021-09-23 21:37:51 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 363000
2021-09-23 21:37:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:37:51 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 360000
2021-09-23 21:37:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 364000
2021-09-23 21:37:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 365000
2021-09-23 21:37:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 366000
2021-09-23 21:37:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 367000
2021-09-23 21:37:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 368000
2021-09-23 21:37:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 369000
2021-09-23 21:37:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 370000
2021-09-23 21:38:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 371000
2021-09-23 21:38:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 372000
2021-09-23 21:38:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 373000
2021-09-23 21:38:23 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:38:23 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 370000
2021-09-23 21:38:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 374000
2021-09-23 21:38:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 375000
2021-09-23 21:38:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 376000
2021-09-23 21:38:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 377000
2021-09-23 21:38:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 378000
2021-09-23 21:38:26 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 379000
2021-09-23 21:38:26 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 380000
2021-09-23 21:39:18 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 381000
2021-09-23 21:39:19 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 382000
2021-09-23 21:39:19 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 383000
2021-09-23 21:39:19 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:39:19 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 380000
2021-09-23 21:39:20 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 384000
2021-09-23 21:39:20 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 385000
2021-09-23 21:39:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 386000
2021-09-23 21:39:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 387000
2021-09-23 21:39:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 388000
2021-09-23 21:39:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 389000
2021-09-23 21:39:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 390000
2021-09-23 21:40:03 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 391000
2021-09-23 21:40:03 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 392000
2021-09-23 21:40:03 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 393000
2021-09-23 21:40:04 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:40:03 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 390000
2021-09-23 21:40:04 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 394000
2021-09-23 21:40:04 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 395000
2021-09-23 21:40:05 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 396000
2021-09-23 21:40:05 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 397000
2021-09-23 21:40:06 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 398000
2021-09-23 21:40:06 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 399000
2021-09-23 21:40:06 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 400000
2021-09-23 21:40:41 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 401000
2021-09-23 21:40:42 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 402000
2021-09-23 21:40:42 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 403000
2021-09-23 21:40:42 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:40:42 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 400000
2021-09-23 21:40:42 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 404000
2021-09-23 21:40:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 405000
2021-09-23 21:40:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 406000
2021-09-23 21:40:44 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 407000
2021-09-23 21:40:44 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 408000
2021-09-23 21:40:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 409000
2021-09-23 21:40:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 410000
2021-09-23 21:41:26 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 411000
2021-09-23 21:41:27 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 412000
2021-09-23 21:41:27 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 413000
2021-09-23 21:41:27 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:41:27 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 410000
2021-09-23 21:41:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 414000
2021-09-23 21:41:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 415000
2021-09-23 21:41:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 416000
2021-09-23 21:41:29 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 417000
2021-09-23 21:41:29 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 418000
2021-09-23 21:41:30 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 419000
2021-09-23 21:41:30 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 420000
2021-09-23 21:42:07 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 421000
2021-09-23 21:42:08 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 422000
2021-09-23 21:42:08 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 423000
2021-09-23 21:42:09 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:42:08 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 420000
2021-09-23 21:42:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 424000
2021-09-23 21:42:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 425000
2021-09-23 21:42:10 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 426000
2021-09-23 21:42:10 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 427000
2021-09-23 21:42:11 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 428000
2021-09-23 21:42:11 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 429000
2021-09-23 21:42:12 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 430000
2021-09-23 21:42:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 431000
2021-09-23 21:42:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 432000
2021-09-23 21:42:52 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 433000
2021-09-23 21:42:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:42:53 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 430000
2021-09-23 21:42:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 434000
2021-09-23 21:42:53 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 435000
2021-09-23 21:42:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 436000
2021-09-23 21:42:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 437000
2021-09-23 21:42:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 438000
2021-09-23 21:42:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 439000
2021-09-23 21:42:56 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 440000
2021-09-23 21:43:35 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 441000
2021-09-23 21:43:36 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 442000
2021-09-23 21:43:36 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 443000
2021-09-23 21:43:37 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:43:36 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 440000
2021-09-23 21:43:37 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 444000
2021-09-23 21:43:37 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 445000
2021-09-23 21:43:38 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 446000
2021-09-23 21:43:38 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 447000
2021-09-23 21:43:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 448000
2021-09-23 21:43:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 449000
2021-09-23 21:43:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 450000
2021-09-23 21:44:19 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 451000
2021-09-23 21:44:20 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 452000
2021-09-23 21:44:20 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 453000
2021-09-23 21:44:20 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:44:20 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 450000
2021-09-23 21:44:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 454000
2021-09-23 21:44:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 455000
2021-09-23 21:44:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 456000
2021-09-23 21:44:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 457000
2021-09-23 21:44:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 458000
2021-09-23 21:44:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 459000
2021-09-23 21:44:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 460000
2021-09-23 21:45:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 461000
2021-09-23 21:45:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 462000
2021-09-23 21:45:10 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 463000
2021-09-23 21:45:10 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-09-23 21:45:10 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$createReadIterator$6):323 - {} - Reading stream statements. Records read: 460000
2021-09-23 21:45:10 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 464000
2021-09-23 21:45:10 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 465000
2021-09-23 21:45:11 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 466000
2021-09-23 21:45:11 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 467000
2021-09-23 21:45:12 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 468000
2021-09-23 21:45:12 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 469000
2021-09-23 21:45:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 470000

Follow up questions

  1. Is it failing because the source data size are huge? How can we avoid it?
  2. I found multiple _airbyte_temp_xxx tables are generated in my destination db. Can I delete them since I guess they are generated because of several failed sync job?
  3. Does every sync job start syncing from the 1st data? I thought airbyte has some check point feature so every new sync could start just from where it stopped last time. then for 70GB data it's a huge amount of time for each sync job. or is it only because it's the 1st time to fetch all of the data, and after that it will only check the new data from source and append to destination?
  4. How does airbyte work to prevent dups data in destination for each sync job?
  5. Can we set up a meeting later if my company is interested in using more of your services?

Thank you very much!
@lorriexingfang86 lorriexingfang86 added the type/bug Something isn't working label Sep 23, 2021
@sherifnada sherifnada added the area/connectors Connector related issues label Sep 23, 2021
@sherifnada
Copy link
Contributor

@lorriexingfang86 where are you seing "sync worker failed"? I'm not seeing it in the logs. Are these the full logs?

@lorriexingfang86
Copy link
Author

logs-19-0.txt

@lorriexingfang86
Copy link
Author

@sherifnada uploaded. thanks!

@lorriexingfang86
Copy link
Author

@sherifnada also updated it in PR.

@lorriexingfang86 lorriexingfang86 changed the title Got "Sync worker failed" when syncing 70GB data from source to destination Checkpoint doesn't work when source/destination disconnects and retry will restart from init again. Oct 5, 2021
@tuliren tuliren mentioned this issue Nov 3, 2021
Closed
@sashaNeshcheret sashaNeshcheret self-assigned this Nov 17, 2021
@sashaNeshcheret
Copy link
Contributor

sashaNeshcheret commented Nov 23, 2021 •
edited

Hi @lorriexingfang86. I started investigation of the issue and could not reproduce it locally. Additionally we have gap between your logs and current code base. Can you check if it is still reproducible with latest versions and if yes, please, provide new logs. Thanks

@sashaNeshcheret
Copy link
Contributor

sashaNeshcheret commented Nov 26, 2021 •
edited

After deep investigation we can assume that root cause can be with db connection. @lorriexingfang86 Can you provide db log, to check the assumption.

cc: @sherifnada, @alexandr-shegeda

@sashaNeshcheret
Copy link
Contributor

@lorriexingfang86 can you check if the problem is still reproducing?

@sashaNeshcheret
Copy link
Contributor

@sherifnada can we close the issue as far as we cannot reproduce root exception and don't have additional info from @lorriexingfang86?

@lorriexingfang86
Copy link
Author

@sherifnada yes pls close this issue.thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sashaNeshcheret sashaNeshcheret

Labels
area/connectors Connector related issues area/databases connectors/destination/postgres connectors/destinations-database type/bug Something isn't working
Projects
GL Roadmap
Archived in project
Milestone
No milestone
Development

No branches or pull requests
5 participants
@sherifnada @alexandr-shegeda @sashaNeshcheret @lorriexingfang86 @igrankova