[CDCSDK] [PG Parity] Issue with Connector Task Restart Logic: Auto-restart not occurring

[shamanthchandra-yb]

Jira Link: DB-11329

Description

Please refer slack thread and stress run link in JIRA.

Verified connector ybconnector_cdc_56efe3_test_cdc_e82f91 path.

This connector was neither restarted nor its tasks were restarted from the task.

Still test failed.

Conclusion from slack msg:

This connector’s task is not restarted from test side. So, because of some nemesis, there could be restarts/failures in connector, ideally those should be restarted automatically, but somehow its not happening and has caused issue here.
There seems to be a bug from connector task retry logic.

Source connector version

fourpointfour/ybdb-debezium:0.7

Connector configuration

add connector connector_name='ybconnector_cdc_ed98ba_test_cdc_048724' stream_id='rs_cdc_ed98ba_870f' db_name='cdc_ed98ba' connector_host='172.151.28.159' table_list=['test_cdc_048724'] {'name': 'ybconnector_cdc_ed98ba_test_cdc_048724', 'config': {'database.master.addresses': '172.151.21.64:7100,172.151.23.88:7100,172.151.24.236:7100', 'database.hostname': '172.151.21.64:5433,172.151.23.88:5433,172.151.24.236:5433', 'database.port': 5433, 'database.masterhost': '172.151.24.236', 'database.masterport': '7100', 'database.user': 'yugabyte', 'database.password': 'yugabyte', 'database.dbname': 'cdc_ed98ba', 'snapshot.mode': 'initial', 'admin.operation.timeout.ms': 600000, 'socket.read.timeout.ms': 300000, 'max.connector.retries': '10', 'operation.timeout.ms': 600000, 'topic.creation.default.compression.type': 'lz4', 'topic.creation.default.cleanup.policy': 'delete', 'topic.creation.default.partitions': 2, 'topic.creation.default.replication.factor': '1', 'tasks.max': '5', 'connector.class': 'io.debezium.connector.postgresql.PostgresConnector', 'topic.prefix': 'ybconnector_cdc_ed98ba_test_cdc_048724', 'plugin.name': 'pgoutput', 'slot.name': 'rs_cdc_ed98ba_870f_from_con_e617', 'publication.autocreate.mode': 'filtered', 'publication.name': 'pn_ybconnector_cdc_ed98ba_test_cdc_048724', 'table.include.list': 'public.test_cdc_048724'}}

YugabyteDB version

2024.1.1.0-b18

Issue Type

kind/bug

Warning: Please confirm that this issue does not contain any sensitive information

• I confirm this issue does not contain any sensitive information.