Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed CDC job does not cancel job #5516

Closed
danieldiamond opened this issue Aug 19, 2021 · 1 comment
Closed

Failed CDC job does not cancel job #5516

danieldiamond opened this issue Aug 19, 2021 · 1 comment
Assignees
@subodh1810
Labels
area/connectors Connector related issues connectors/destination/snowflake connectors/destinations-warehouse type/bug Something isn't working
Milestone
Core 2021-09-01

Comments

@danieldiamond
Copy link
Contributor

Enviroment

  • **OS Version / Instance: **Linux EC2 m5.xlarge
  • **Deployment: **Docker
  • **Airbyte Version: **0.29.7-alpha
  • **Source name: **MySQL 0.4.3
  • **Destination: **Snowflake 0.3.12
  • Severity: Critical
  • Step where error happened: Sync job

Current Behavior

Failed CDC job doesn't cancel the sync job. Just hangs

Expected Behavior

Failed CDC job should cause the job to fail

Logs

If applicable, please upload the logs from the failing operation.
For sync jobs, you can download the full logs from the UI by going to the sync attempt page and
clicking the download logs button at the top right of the logs display window.

LOG 

2021-08-18 08:56:09 INFO () WorkerRun(call):62 - Executing worker wrapper. Airbyte version: 0.29.7-alpha
2021-08-18 08:56:09 INFO () TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.29.7-alpha
2021-08-18 08:56:09 INFO () DefaultReplicationWorker(run):102 - start sync worker. job id: 6555 attempt id: 0
2021-08-18 08:56:09 INFO () DefaultReplicationWorker(run):111 - configured sync modes: {...}
2021-08-18 08:56:09 INFO () DefaultAirbyteDestination(start):78 - Running destination...
2021-08-18 08:56:09 INFO () LineGobbler(voidCall):85 - Checking if airbyte/destination-snowflake:0.3.12 exists...
2021-08-18 08:56:09 INFO () LineGobbler(voidCall):85 - airbyte/destination-snowflake:0.3.12 was found locally.
2021-08-18 08:56:09 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/6555/0 --network host --log-driver none airbyte/destination-snowflake:0.3.12 write --config destination_config.json --catalog destination_catalog.json
2021-08-18 08:56:09 INFO () LineGobbler(voidCall):85 - Checking if airbyte/source-mysql:0.4.3 exists...
2021-08-18 08:56:09 INFO () LineGobbler(voidCall):85 - airbyte/source-mysql:0.4.3 was found locally.
2021-08-18 08:56:09 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/6555/0 --network host --log-driver none airbyte/source-mysql:0.4.3 read --config source_config.json --catalog source_catalog.json
2021-08-18 08:56:09 INFO () DefaultReplicationWorker(run):139 - Waiting for source thread to join.
2021-08-18 08:56:09 INFO () DefaultReplicationWorker(lambda$getDestinationOutputRunnable$3):246 - Destination output thread started.
2021-08-18 08:56:09 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):210 - Replication thread started.
2021-08-18 08:56:14 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:14 �[32mINFO�[m i.a.i.d.s.SnowflakeDestination(main):81 - {} - starting destination: class io.airbyte.integrations.destination.snowflake.SnowflakeDestination
2021-08-18 08:56:14 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:14 �[32mINFO�[m i.a.i.s.m.MySqlSource(main):249 - {} - starting source: class io.airbyte.integrations.source.mysql.MySqlSource
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):96 - {} - Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.b.IntegrationCliParser(parseOptions):135 - {} - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):100 - {} - Command: WRITE
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):101 - {} - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):96 - {} - Running integration: io.airbyte.integrations.source.mysql.MySqlSource
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.b.IntegrationCliParser(parseOptions):135 - {} - integration args: {read=null, catalog=source_catalog.json, config=source_config.json}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):100 - {} - Command: READ
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):101 - {} - Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.c.SwitchingDestination(getConsumer):83 - {} - Using destination type: INSERT
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=... namespace=... outputSchemaName=... tmpTableName=... outputTableName=... syncMode=append_dedup}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=... namespace=... outputSchemaName=... tmpTableName=... outputTableName=... syncMode=append_dedup}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=... namespace=... outputSchemaName=... tmpTableName=... outputTableName=... syncMode=append_dedup}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=... namespace=... outputSchemaName=... tmpTableName=... outputTableName=... syncMode=append_dedup}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=... namespace=... outputSchemaName=... tmpTableName=... outputTableName=... syncMode=append_dedup}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=... namespace=... outputSchemaName=... tmpTableName=... outputTableName=... syncMode=append_dedup}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=... namespace=... outputSchemaName=... tmpTableName=... outputTableName=... syncMode=append_dedup}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=... namespace=... outputSchemaName=... tmpTableName=... outputTableName=... syncMode=append_dedup}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=... namespace=... outputSchemaName=... tmpTableName=... outputTableName=... syncMode=append_dedup}
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.b.BufferedStreamConsumer(startTracked):142 - {} - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):139 - {} - Preparing tmp tables in destination started for 9 streams
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream my_table. schema: myschema, tmp table name:...-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.s.r.CdcStateManager(<init>):46 - {} - Initialized CDC state with: null
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{...', namespace=...'}, New Cursor Field: null. Resetting cursor value
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{...', namespace=...'}, New Cursor Field: null. Resetting cursor value
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{...', namespace=...'}, New Cursor Field: null. Resetting cursor value
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{...', namespace=...'}, New Cursor Field: null. Resetting cursor value
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{...', namespace=...'}, New Cursor Field: null. Resetting cursor value
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{...', namespace=...'}, New Cursor Field: null. Resetting cursor value
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{...', namespace=...'}, New Cursor Field: null. Resetting cursor value
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{...', namespace=...'}, New Cursor Field: null. Resetting cursor value
2021-08-18 08:56:15 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:15 �[32mINFO�[m i.a.i.s.r.StateManager(createCursorInfoForStream):137 - {} - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{...', namespace=...'}, New Cursor Field: null. Resetting cursor value
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.a.i.s.m.MySqlCdcTargetPosition(targetPosition):81 - {} - Target table position : tableName:...-changelog.160472, Position : 98156
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.a.i.d.AirbyteDebeziumHandler(getIncrementalIterators):92 - {} - using CDC: true
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m o.a.k.c.c.AbstractConfig(logAll):354 - {} - EmbeddedConfig values:
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	access.control.allow.methods =
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	access.control.allow.origin =
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	admin.listeners = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	bootstrap.servers = [localhost:9092]
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	client.dns.lookup = use_all_dns_ips
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	config.providers = []
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	connector.client.config.override.policy = None
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	internal.key.converter = class org.apache.kafka.connect.json.JsonConverter
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	internal.value.converter = class org.apache.kafka.connect.json.JsonConverter
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	key.converter = class org.apache.kafka.connect.json.JsonConverter
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	listeners = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	metric.reporters = []
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	metrics.num.samples = 2
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	metrics.recording.level = INFO
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	metrics.sample.window.ms = 30000
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	offset.flush.interval.ms = 1000
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	offset.flush.timeout.ms = 5000
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	offset.storage.table.tablename .../cdc-state-offset1147230147055210619/offset.dat
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	offset.storage.partitions = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	offset.storage.replication.factor = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	offset.storage.topic =
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	plugin.path = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	response.http.headers.config =
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	rest.advertised.host.name ...
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	rest.advertised.listener = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	rest.advertised.port = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	rest.extension.classes = []
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	rest.host.name ...
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	rest.port = 8083
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.cipher.suites = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.client.auth = none
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.endpoint.identification.algorithm = https
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.engine.factory.class = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.key.password = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.keymanager.algorithm = SunX509
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.keystore.location = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.keystore.password = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.keystore.type = JKS
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.protocol = TLSv1.3
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.provider = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.secure.random.implementation = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.trustmanager.algorithm = PKIX
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.truststore.location = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.truststore.password = null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	ssl.truststore.type = JKS
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	task.shutdown.graceful.timeout.ms = 5000
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	topic.creation.enable = true
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	topic.tracking.allow.reset = true
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	topic.tracking.enable = true
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 	value.converter = class org.apache.kafka.connect.json.JsonConverter
2021-08-18 08:56:16 INFO () JsonSchemaValidator(test):76 - JSON schema validation failed.
errors: $: unknown found, object expected
2021-08-18 08:56:16 ERROR () DefaultAirbyteStreamFactory(lambda$create$1):83 - Validation failed: null
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m o.a.k.c.r.WorkerConfig(logPluginPathConfigProviderWarning):420 - {} - Variables cannot be used in the 'plugin.path' property, since the property is used by plugin scanning before the config providers that replace the variables are initialized. The raw value 'null' was used for plugin scanning, as opposed to the transformed value 'null', and this may cause unexpected results.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {} - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {} - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {} - Using configuration property "database.blacklist" is deprecated and will be removed in future versions. Please use "database.exclude.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {} - Using configuration property "database.blacklist" is deprecated and will be removed in future versions. Please use "database.exclude.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {} - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {} - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {} - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {} - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {} - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {} - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(start):100 - {} - Starting MySqlConnectorTask with configuration:
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    connector.class = io.debezium.connector.mysql.MySqlConnector
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    snapshot.locking.mode = none
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    database.history.table.tablename .../cdc-db-history11841601615089980846/dbhistory.dat
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    database.user =
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    database.dbname ...
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    offset.storage = org.apache.kafka.connect.storage.tableOffsetBackingStore
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    boolean.type = io.debezium.connector.mysql.converters.TinyIntOneToBooleanConverter
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    database.server.name ...
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    include.schema.changes = false
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    database.port = 3306
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    offset.flush.interval.ms = 1000
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    key.converter.schemas.enable = false
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    offset.storage.table.tablename .../cdc-state-offset1147230147055210619/offset.dat
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    decimal.handling.mode = string
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    database.hostname
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    database.password = ********
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    name ...
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    value.converter.schemas.enable = false
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    converters = boolean, datetime
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    datetime.type = io.airbyte.integrations.debezium.internals.MySQLDateTimeConverter
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    table.include.list = tables
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    snapshot.mode = initial
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    database.history = io.airbyte.integrations.debezium.internals.FilteredtableDatabaseHistory
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.c.BaseSourceTask(lambda$start$0):102 - {} -    database.include.list = schema
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Using configuration property "database.blacklist" is deprecated and will be removed in future versions. Please use "database.exclude.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[33mWARN�[m i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
...
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(logServerInformation):992 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - MySQL server variables related to change data capture:
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_cache_size                             = 32768
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_checksum                               = NONE
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_direct_non_transactional_updates       = OFF
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_error_action                           = ABORT_SERVER
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_format                                 = ROW
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_group_commit_sync_delay                = 0
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_group_commit_sync_no_delay_count       = 0
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_gtid_simple_recovery                   = ON
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_max_flush_queue_time                   = 0
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_order_commits                          = ON
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_row_image                              = FULL
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_rows_query_log_events                  = OFF
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_stmt_cache_size                        = 32768
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_transaction_dependency_history_size    = 25000
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	binlog_transaction_dependency_tracking        = COMMIT_ORDER
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	character_set_client                          = utf8mb4
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	character_set_connection                      = utf8mb4
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	character_set_database                        = utf8mb4
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	character_set_tablesystem                      = binary
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	character_set_results                         = utf8mb4
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	character_set_server                          = latin1
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	character_set_system                          = utf8
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	character_sets_dir                            = /rdsdbbin/mysql-5.7.33.R2/share/charsets/
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	collation_connection                          = utf8mb4_general_ci
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	collation_database                            = utf8mb4_unicode_520_ci
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	collation_server                              = latin1_swedish_ci
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	enforce_gtid_consistency                      = OFF
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	gtid_executed_compression_period              = 1000
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	gtid_mode                                     = OFF_PERMISSIVE
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	gtid_next                                     = AUTOMATIC
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	gtid_owned                                    =
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	gtid_purged                                   =
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	innodb_api_enable_binlog                      = OFF
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	innodb_locks_unsafe_for_binlog                = OFF
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	innodb_version                                = 5.7.33
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	log_statements_unsafe_for_binlog              = OFF
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	max_binlog_cache_size                         = 18446744073709547520
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	max_binlog_size                               = 134217728
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	max_binlog_stmt_cache_size                    = 18446744073709547520
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	protocol_version                              = 10
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	session_track_gtids                           = OFF
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	slave_type_conversions                        =
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	sync_binlog                                   = 1
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	system_time_zone                              = UTC
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	time_zone                                     = UTC
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	tls_version                                   = TLSv1,TLSv1.1,TLSv1.2
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	tx_isolation                                  = REPEATABLE-READ
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	tx_read_only                                  = OFF
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	version                                       = 5.7.33-log
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	version_comment                               = Source distribution
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	version_compile_machine                       = x86_64
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$logServerInformation$19):995 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	version_compile_os                            = Linux
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(execute):282 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - Step 0: disabling autocommit, enabling repeatable read transactions, and setting lock wait timeout to 10
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(execute):342 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - Step 2: start transaction with consistent snapshot
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(execute):367 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - Step 3: read list of available databases
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(execute):375 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	 list of available databases is: [...]
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(execute):386 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - Step 4: read list of available tables in each database
...
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(execute):448 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	snapshot continuing with database(s): [schema]
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(readBinlogPosition):906 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - Step 5: read binlog position of MySQL primary server
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$readBinlogPosition$18):918 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - 	 using binlog 'mysql-bin-changelog.160472' at position '98156' and gtid ''
2021-08-18 08:56:16 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:16 �[32mINFO�[m i.d.c.m.SnapshotReader(execute):494 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - Step 6: generating DROP and CREATE statements to reflect current database schemas:
2021-08-18 08:56:18 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:18 �[32mINFO�[m i.d.c.m.SnapshotReader(execute):595 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - Step 7: scanning contents of 9 tables while still in transaction
2021-08-18 08:56:18 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:18 �[32mINFO�[m i.d.c.m.SnapshotReader(execute):646 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - Step 7: - scanning table 'myschema.table' (1 of 9 tables)
2021-08-18 08:56:18 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:18 �[32mINFO�[m i.d.c.m.SnapshotReader(execute):651 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - For table 'myschema.table' using select statement: 'SELECT * FROM `schema`.`table`'
...
2021-08-18 08:56:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 1000
2021-08-18 08:56:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 2000
2021-08-18 08:56:28 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 08:56:18 �[32mINFO�[m i.d.c.m.SnapshotReader(lambda$execute$16):677 - {dbz.connectorContext=snapshot, dbz.connectorName=... dbz.connectorType=MySQL} - Step 7: - 20000 of 12718965 rows scanned from table 'myschema.table' after 00:00:00.709
2021-08-18 08:56:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 3000
2021-08-18 08:56:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 4000
2021-08-18 08:56:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 5000
2021-08-18 08:56:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 6000

...

2021-08-18 14:14:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42767000
2021-08-18 14:14:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42768000
2021-08-18 14:14:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42769000
2021-08-18 14:14:22 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42770000
2021-08-18 14:14:22 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:22 �[32mINFO�[m i.a.i.d.s.SnowflakeSqlOperations(insertRecords):56 - {} - actual size of batch: 10000
2021-08-18 14:14:22 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:21 �[32mINFO�[m i.d.c.m.ChainedReader(startNextReader):201 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Transitioning from the snapshot reader to the binlog reader
2021-08-18 14:14:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42771000
2021-08-18 14:14:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42772000
2021-08-18 14:14:25 ERROR () LineGobbler(voidCall):85 - Aug 18, 2021 2:14:22 PM com.github.shyiko.mysql.binlog.BinaryLogClient connect
2021-08-18 14:14:25 ERROR () LineGobbler(voidCall):85 - INFO: Connected to schema
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:21 �[32mINFO�[m i.d.c.m.BinlogReader(doStart):367 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - GTID set purged on server:
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:22 �[32mINFO�[m i.d.u.Threads$3(newThread):287 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Creating thread debezium-mysqlconnector-schema-binlog-client
2021-08-18 14:14:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42773000
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:22 �[32mINFO�[m i.d.u.Threads$3(newThread):287 - {} - Creating thread debezium-mysqlconnector-schema-binlog-client
2021-08-18 14:14:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42774000
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:22 �[32mINFO�[m i.d.c.m.BinlogReader$ReaderThreadLifecycleListener(onConnect):1128 - {dbz.connectorContext=binlog, dbz.connectorName=... dbz.connectorType=MySQL} - Connected to MySQL binlog at schema
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:22 �[32mINFO�[m i.d.c.m.BinlogReader(doStart):415 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Waiting for keepalive thread to start
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:22 �[32mINFO�[m i.d.u.Threads$3(newThread):287 - {dbz.connectorContext=binlog, dbz.connectorName=... dbz.connectorType=MySQL} - Creating thread debezium-mysqlconnector-schema-binlog-client
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:22 �[32mINFO�[m i.d.c.m.BinlogReader(doStart):422 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Keepalive thread is running
2021-08-18 14:14:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42775000
2021-08-18 14:14:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42776000
2021-08-18 14:14:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42777000
2021-08-18 14:14:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42778000
2021-08-18 14:14:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42779000
2021-08-18 14:14:25 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 42780000
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:25 �[32mINFO�[m i.a.i.s.m.MySqlCdcTargetPosition(reachedTargetPosition):103 - {} - Signalling close because record's binlog table : mysql-bin-changelog.160472 , position : 98360 is after target table : mysql-bin-changelog.160472 , target position : 98156
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:25 �[32mINFO�[m i.d.e.EmbeddedEngine(stop):996 - {} - Stopping the embedded engine
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:25 �[32mINFO�[m i.d.e.EmbeddedEngine(stop):1004 - {} - Waiting for PT5M for connector to stop
2021-08-18 14:14:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:14:25 �[32mINFO�[m i.a.i.d.s.SnowflakeSqlOperations(insertRecords):56 - {} - actual size of batch: 10000
2021-08-18 14:16:22 ERROR () LineGobbler(voidCall):85 - Aug 18, 2021 2:16:22 PM com.github.shyiko.mysql.binlog.BinaryLogClient$5 run
2021-08-18 14:16:22 ERROR () LineGobbler(voidCall):85 - INFO: Trying to restore lost connection to schema
2021-08-18 14:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:19:25 �[32mINFO�[m i.d.c.c.BaseSourceTask(stop):192 - {} - Stopping down connector
2021-08-18 14:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:19:25 �[32mINFO�[m i.d.c.m.MySqlConnectorTask(doStop):453 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Stopping MySQL connector task
2021-08-18 14:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:19:25 �[32mINFO�[m i.d.c.m.ChainedReader(stop):121 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - ChainedReader: Stopping the binlog reader
2021-08-18 14:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:19:25 �[32mINFO�[m i.d.c.m.AbstractReader(stop):140 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Discarding 8192 unsent record(s) due to the connector shutting down
2021-08-18 14:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:19:25 �[32mINFO�[m i.d.c.m.AbstractReader(stop):140 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Discarding 1 unsent record(s) due to the connector shutting down
2021-08-18 14:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:19:25 �[32mINFO�[m i.d.j.JdbcConnection(lambda$doClose$3):945 - {} - Connection gracefully closed
2021-08-18 14:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:19:25 �[32mINFO�[m i.d.c.m.MySqlConnectorTask(completeReaders):491 - {dbz.connectorContext=task, dbz.connectorName=... dbz.connectorType=MySQL} - Connector task finished all work and is now shutdown
2021-08-18 14:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:19:25 �[32mINFO�[m i.a.i.d.i.DebeziumRecordPublisher(lambda$start$1):112 - {} - Debezium engine shutdown.
2021-08-18 14:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:19:25 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$read$2):200 - {} - Closing database connection pool.
2021-08-18 14:19:25 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 14:19:25 �[32mINFO�[m i.a.i.s.r.AbstractRelationalDbSource(lambda$read$2):202 - {} - Closed database connection pool.
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.InterruptedException: sleep interrupted
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.integrations.debezium.internals.DebeziumRecordIterator.requestClose(DebeziumRecordIterator.java:150)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.integrations.debezium.internals.DebeziumRecordIterator.computeNext(DebeziumRecordIterator.java:107)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.integrations.debezium.internals.DebeziumRecordIterator.computeNext(DebeziumRecordIterator.java:52)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:141)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:136)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.TransformedIterator.hasNext(TransformedIterator.java:42)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.commons.util.DefaultAutoCloseableIterator.computeNext(DefaultAutoCloseableIterator.java:58)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:141)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:136)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.commons.util.CompositeIterator.computeNext(CompositeIterator.java:83)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:141)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:136)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.commons.util.CompositeIterator.computeNext(CompositeIterator.java:83)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:141)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:136)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.commons.util.DefaultAutoCloseableIterator.computeNext(DefaultAutoCloseableIterator.java:58)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:141)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:136)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at java.base/java.util.Iterator.forEachRemaining(Iterator.java:132)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:139)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.integrations.source.mysql.MySqlSource.main(MySqlSource.java:250)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.InterruptedException: sleep interrupted
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.integrations.debezium.internals.DebeziumRecordPublisher.close(DebeziumRecordPublisher.java:144)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.commons.concurrency.VoidCallable.call(VoidCallable.java:35)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.integrations.debezium.internals.DebeziumRecordIterator.requestClose(DebeziumRecordIterator.java:148)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	... 20 more
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - Caused by: java.lang.RuntimeException: java.lang.InterruptedException: sleep interrupted
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.integrations.debezium.internals.DebeziumRecordPublisher.lambda$start$0(DebeziumRecordPublisher.java:105)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.debezium.embedded.ConvertingEngineBuilder.lambda$notifying$0(ConvertingEngineBuilder.java:71)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.debezium.embedded.EmbeddedEngine$1.handleBatch(EmbeddedEngine.java:472)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:812)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.debezium.embedded.ConvertingEngineBuilder$2.run(ConvertingEngineBuilder.java:171)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at java.base/java.lang.Thread.run(Thread.java:832)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - Caused by: java.lang.InterruptedException: sleep interrupted
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at java.base/java.lang.Thread.sleep(Native Method)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	at io.airbyte.integrations.debezium.internals.DebeziumRecordPublisher.lambda$start$0(DebeziumRecordPublisher.java:103)
2021-08-18 14:19:25 ERROR () LineGobbler(voidCall):85 - 	... 7 more
2021-08-18 23:12:29 INFO () TemporalAttemptExecution(lambda$getCancellationChecker$3):180 - Running sync worker cancellation...
2021-08-18 23:12:29 INFO () DefaultReplicationWorker(cancel):270 - Cancelling replication worker...
2021-08-18 23:12:39 INFO () DefaultReplicationWorker(cancel):278 - Cancelling destination...
2021-08-18 23:12:39 INFO () DefaultAirbyteDestination(cancel):134 - Attempting to cancel destination process...
2021-08-18 23:12:39 INFO () DefaultAirbyteDestination(cancel):139 - Destination process exists, cancelling...
2021-08-18 23:12:39 WARN () LineGobbler(voidCall):88 - airbyte-destination gobbler IOException: Stream closed. Typically happens when cancelling a job.
2021-08-18 23:12:39 INFO () DefaultAirbyteDestination(cancel):141 - Cancelled destination process!
2021-08-18 23:12:39 INFO () DefaultReplicationWorker(cancel):285 - Cancelling source...
2021-08-18 23:12:39 INFO () DefaultAirbyteSource(cancel):141 - Attempting to cancel source process...
2021-08-18 23:12:39 INFO () DefaultAirbyteSource(cancel):146 - Source process exists, cancelling...
2021-08-18 23:12:41 INFO () DefaultReplicationWorker(run):141 - Source thread complete.
2021-08-18 23:12:41 INFO () DefaultReplicationWorker(run):142 - Waiting for destination thread to join.
2021-08-18 23:12:41 INFO () DefaultReplicationWorker(run):144 - Destination thread complete.
2021-08-18 23:12:41 INFO () DefaultAirbyteSource(cancel):148 - Cancelled source process!
2021-08-18 23:12:41 INFO () TemporalAttemptExecution(lambda$getCancellationChecker$3):184 - Interrupting worker thread...
2021-08-18 23:12:41 INFO () TemporalAttemptExecution(lambda$getCancellationChecker$3):187 - Cancelling completable future...
2021-08-18 23:12:41 WARN () CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):71 - Job either timeout-ed or was cancelled.
2021-08-18 23:12:41 INFO () TemporalAttemptExecution(get):133 - Stopping cancellation check scheduling...
2021-08-18 23:12:41 WARN () POJOActivityTaskHandler$POJOActivityImplementation(execute):243 - Activity failure. ActivityId=6e0b1ad2-9d18-3f31-b3a6-066c361f37a8, activityType=Replicate, attempt=1
java.util.concurrent.CancellationException: null
	at java.util.concurrent.CompletableFuture.cancel(CompletableFuture.java:2468) ~[?:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getCancellationChecker$3(TemporalAttemptExecution.java:190) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
	at io.airbyte.workers.temporal.CancellationHandler$TemporalCancellationHandler.checkAndHandleCancellation(CancellationHandler.java:70) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getCancellationChecker$4(TemporalAttemptExecution.java:193) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?]
	at java.lang.Thread.run(Thread.java:832) [?:?]
2021-08-18 23:12:41 ERROR () DefaultReplicationWorker(run):148 - Sync worker failed.
io.airbyte.workers.WorkerException: Source process exit with code 143. This warning is normal if the job was cancelled.
	at io.airbyte.workers.protocols.airbyte.DefaultAirbyteSource.close(DefaultAirbyteSource.java:135) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:146) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:52) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:146) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
	at java.lang.Thread.run(Thread.java:832) [?:?]
	Suppressed: java.io.IOException: Stream closed
		at java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:442) ~[?:?]
		at java.io.OutputStream.write(OutputStream.java:162) ~[?:?]
		at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81) ~[?:?]
		at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:142) ~[?:?]
		at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:327) ~[?:?]
		at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:159) ~[?:?]
		at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:251) ~[?:?]
		at java.io.BufferedWriter.flush(BufferedWriter.java:257) ~[?:?]
		at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.notifyEndOfStream(DefaultAirbyteDestination.java:107) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
		at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:120) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
		at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:121) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
		at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:52) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
		at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:146) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?]
		at java.lang.Thread.run(Thread.java:832) [?:?]
2021-08-18 23:12:41 INFO () DefaultReplicationWorker(run):172 - sync summary: io.airbyte.config.ReplicationAttemptSummary@4408a01e[status=cancelled,recordsSynced=42780030,bytesSynced=29081498547,startTime=1629276969396,endTime=1629328361780]
2021-08-18 23:12:41 INFO () DefaultReplicationWorker(run):181 - Source did not output any state messages
2021-08-18 23:12:41 WARN () DefaultReplicationWorker(run):192 - State capture: No state retained.
2021-08-18 23:12:41 WARN () CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):71 - Job either timeout-ed or was cancelled.

Steps to Reproduce

  1. Create CDC connection
  2. Make sure its a very large source that will take + 12 hour to sync or find some way to cause it to fail

Are you willing to submit a PR?

Sure
@danieldiamond danieldiamond added the type/bug Something isn't working label Aug 19, 2021
@danieldiamond
Copy link
Contributor Author

I wonder if this is associated with this issue #5277

@sherifnada sherifnada mentioned this issue Aug 27, 2021
Merged
36 tasks
@sherifnada sherifnada added the area/connectors Connector related issues label Aug 27, 2021
@subodh1810 subodh1810 self-assigned this Aug 30, 2021
@subodh1810 subodh1810 added this to the Core 2021-09-01 milestone Aug 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@subodh1810 subodh1810

Labels
area/connectors Connector related issues connectors/destination/snowflake connectors/destinations-warehouse type/bug Something isn't working
Projects
None yet
Milestone
Core 2021-09-01
Development

No branches or pull requests
4 participants
@sherifnada @karinakuz @subodh1810 @danieldiamond