HDDS-7087. Manage RocksObjects to detect leaks

[duongkame]

What changes were proposed in this pull request?

We need a mechanism to detect if any RocksObject is not closed before being GCed.
This PR replaces the usage of RocksObject classes in org.rocksdb.* package by managed RocksObject classes whose finalizers are intercepted to assert of their instances are closed before GCed.

https://issues.apache.org/jira/browse/HDDS-7087

Sample data

Metric showing memory leaks.

Sample error message when RocksObject is used in Ozone.

Banned imports detected:

Reason: Use managed RocksObjects under org.apache.hadoop.hdds.utils.db.managed instead.
	in file: org/apache/hadoop/hdds/utils/db/DBStoreBuilder.java
		org.rocksdb.RocksDB                   	(Line: 52, Matched by: org.rocksdb.**)
	in file: org/apache/hadoop/hdds/utils/db/RDBBatchOperation.java
		org.rocksdb.WriteBatch                	(Line: 22, Matched by: org.rocksdb.**)
		org.rocksdb.WriteOptions              	(Line: 23, Matched by: org.rocksdb.**)
	in file: org/apache/hadoop/hdds/utils/db/TableConfig.java
		org.rocksdb.ColumnFamilyOptions       	(Line: 28, Matched by: org.rocksdb.**)
	in file: org/apache/hadoop/hdds/utils/db/RDBSstFileWriter.java
		org.rocksdb.EnvOptions                	(Line: 23, Matched by: org.rocksdb.**)
		org.rocksdb.Options                   	(Line: 24, Matched by: org.rocksdb.**)
		org.rocksdb.SstFileWriter             	(Line: 26, Matched by: org.rocksdb.**)
	in file: org/apache/hadoop/hdds/utils/db/RDBSstFileLoader.java
		org.rocksdb.IngestExternalFileOptions 	(Line: 20, Matched by: org.rocksdb.**)
	in file: org/apache/hadoop/hdds/utils/db/RDBStore.java
		org.rocksdb.DBOptions                 	(Line: 41, Matched by: org.rocksdb.**)
		org.rocksdb.TransactionLogIterator    	(Line: 43, Matched by: org.rocksdb.**)

How was this patch tested?

Standard CI: https://github.com/duongnguyen0/ozone/actions/runs/2805369172

[kerneltime]

I like this approach; @jojochuang mentioned that there might be ways in the pom for all packages other than managed packaged to block rocks DB import.

[jojochuang]

There's a Maven plugin to ban certain classpath: https://maven.apache.org/enforcer/enforcer-rules/bannedDependencies.html
example: https://github.com/apache/hadoop/pull/2969/files

[szetszwo]

@DuongNguyen0 , thanks a lot for working on this! The idea of having managed objects is great. We should remove the import of org.rockdb.* from the other classes in order to avoid missing the changes. See also the comments inlined.

[duongkame]

Thanks @kerneltime, @jojochuang and @szetszwo for the early review and suggestions. I've updated the code to (mostly) ban the usage of org.rocksdb.

[szetszwo]

+1 the change looks good.

Just a minor comment inlined.

[szetszwo]

2 successful and 8 skipped checks

Why the checks were skipped?

[duongkame]

2 successful and 8 skipped checks

Why the checks were skipped?

Because I was a draft PR. Now all the checks are running.