2024 August APAC Community Sync

[ChenSammi]

Attenders: Xi, Hao, Mingyu, Hongbin, Shilun, Weiming, Coway, Jianghua, Hualong, Wei-Chiu, Sammi

Xi:

• 1.4.1 all patches are cherry picked. Working on first RC package.
• HDDS-11233. Ozone Storage Policy Support. first design is ready. Need review from community. HDDS-11233. Ozone Storage Policy Support. #6989

Weiming/Hongbin :

• OM performance issue caused by thread local usage when using JDK17(OpenJDK 17.0.2). One hot point is identified HDDS-11240.
• High EC read tail latency.

Shilun: EC reconstruction failure fix patch is ready for review #7009

Hao :

• Client side hedge read
• Datanode decommissioning bandwidth throttling

Sammi:

• Apache CoC 2024 Asia status update
• HDDS-10656 Atomic Key Overwrite and Key Replacement is merged into master branch

Wei-Chiu:

• Found Ratis 3.1.0 performance degradation https://issues.apache.org/jira/browse/RATIS-2132
• HBase support feature branch merge back to mater is under vote in community

Conway/Jianghua:

• RocksDB performance tuning. Suggest to tune the block cache size first. https://issues.apache.org/jira/browse/HDDS-11230

[ChenSammi]

Aug 30th
Attenders: Xi, Hao, Minyu, Hongbin, Shikun, Weiming, Jinaghua, Conway, Wei-Chiu, Sammi

Wei-Chiu/Sammi

• Ozone 2.0 release proposal discussion
• OM HA new workflow discussion - basic code flow sumitagrawl/ozone#3
• Ozone meetup in October

Xi

• Ozone 1.4.1 release, waiting for RATIS 3.1.1 release
• Find the workaround for the StorageTypeProto compatibility problem

Minyu/Hao

• Ozone client data pre-fetch discussion. Some ongoing effort in community, https://issues.apache.org/jira/browse/HDDS-10338

Hongbin/Weiming/Shilun/Conway/Jianghua

• Ozone Hadoop 2 filesytem jar is used currently for YARN cluster
• Support RocksDB block cache configuration
• Container balancer has supported EC containers