[Bug] 使用 OracleIncrementalSource 数据库连接数持续上升 #2092
Description
Search before asking
- I searched in the issues and found nothing similar.
Flink version
1.16.0
Flink CDC version
2.3 release
Database and its version
Oracle 11g
Minimal reproduce step
builder.hostname(source.getHost())
.port(Integer.valueOf(source.getPort()))
.databaseList(source.getDatabase())
.tableList(source.tablesArray())
.username(source.getUser())
.password(source.getPwd())
.debeziumProperties(this.defaultDebeziumConfig(config))
.deserializer(new JsonDebeziumDeserializationSchema(false))
.includeSchemaChanges(true) // output the schema changes as well
.splitSize(config.getSplitSize())
.connectionPoolSize(config.getPoolSize())
.build();
What did you expect to see?
2023-04-19 20:22:37,566 INFO org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Adding split(s) to reader: [SnapshotSplit{tableId=UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW, splitId='UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW:33', splitKeyType=[LOB_ID STRING NOT NULL], splitStart=[0120220817021369], splitEnd=[0120220818022037], highWatermark=null}]
2023-04-19 20:22:37,566 INFO org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Starting split fetcher 33
2023-04-19 20:22:37,609 INFO io.debezium.connector.oracle.OracleConnection [] - Database Version: Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
2023-04-19 20:22:37,652 INFO io.debezium.connector.oracle.OracleConnection [] - Database Version: Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
2023-04-19 20:22:37,656 WARN io.debezium.relational.history.DatabaseHistoryMetrics [] - Unable to register the MBean 'debezium.oracle:type=connector-metrics,context=schema-history,server=oracle_logminer': debezium.oracle:type=connector-metrics,context=schema-history,server=oracle_logminer
2023-04-19 20:22:37,657 INFO io.debezium.relational.history.DatabaseHistoryMetrics [] - Started database history recovery
2023-04-19 20:22:37,658 INFO io.debezium.relational.history.DatabaseHistoryMetrics [] - Finished database history recovery of 0 change(s) in 0 ms
2023-04-19 20:22:37,666 INFO com.ververica.cdc.connectors.oracle.source.reader.fetch.OracleScanFetchTask$OracleSnapshotSplitReadTask [] - Snapshot step 1 - Determining low watermark {commit_scn=0, lcr_position=null, scn=15685829289326} for split SnapshotSplit{tableId=UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW, splitId='UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW:33', splitKeyType=[LOB_ID STRING NOT NULL], splitStart=[0120220817021369], splitEnd=[0120220818022037], highWatermark=null}
2023-04-19 20:22:37,666 INFO com.ververica.cdc.connectors.oracle.source.reader.fetch.OracleScanFetchTask$OracleSnapshotSplitReadTask [] - Snapshot step 2 - Snapshotting data
2023-04-19 20:22:37,667 INFO com.ververica.cdc.connectors.oracle.source.reader.fetch.OracleScanFetchTask$OracleSnapshotSplitReadTask [] - Exporting data from split 'UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW:33' of table UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW
2023-04-19 20:22:37,668 INFO com.ververica.cdc.connectors.oracle.source.reader.fetch.OracleScanFetchTask$OracleSnapshotSplitReadTask [] - For split 'UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW:33' of table UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW using select statement: 'SELECT * FROM "HIS_EMR"."SDE_LOB_MEDICALRECORD_NEW" WHERE LOB_ID >= ? AND NOT (LOB_ID = ?) AND LOB_ID <= ?'
2023-04-19 20:22:45,906 INFO com.ververica.cdc.connectors.oracle.source.reader.fetch.OracleScanFetchTask$OracleSnapshotSplitReadTask [] - Finished exporting 49999 records for split 'UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW:33', total duration '00:00:08.238'
2023-04-19 20:22:45,909 INFO com.ververica.cdc.connectors.oracle.source.reader.fetch.OracleScanFetchTask$OracleSnapshotSplitReadTask [] - Snapshot step 3 - Determining high watermark {commit_scn=0, lcr_position=null, scn=15685829289495} for split SnapshotSplit{tableId=UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW, splitId='UTF8_STD.HIS_EMR.SDE_LOB_MEDICALRECORD_NEW:33', splitKeyType=[LOB_ID STRING NOT NULL], splitStart=[0120220817021369], splitEnd=[0120220818022037], highWatermark=null}
What did you see instead?
OracleConnection is never closed in the project
Anything else?
No response
Are you willing to submit a PR?
- I'm willing to submit a PR!