August 2023 APAC community sync

[ChenSammi]

4th Aug.
Attender: Shopee(Yiyang, Xi), Ebay(Jackson), Cloudera(Sammi, George)
Agenda:

• Yiyang updated 1.4.0 release status. Next step will go through all open JIRAs,
  evaluating any blocker, critical fixes need include in 1.4.0
• Xi discussed the container lock contention between block delete thread and
  KeyValueHandler#checkContainerIsHealthy check. The write lock is held by the block delete thread for more than 30s,
  other read access operation to this container is blocked for quite a long time.
  Please find more detailed information in HDDS-8192.
• Following block delete related MR need review help
  HDDS-8882. Manage status of DeleteBlocksCommand in SCM to avoid sending duplicates to Datanode #4988
  HDDS-8888. Consider Datanode queue capacity when sending DeleteBlocks command #4939
  HDDS-9107. Reduce the granularity of Container locks for BlockDeletingService #5149
  HDDS-8690. Ozone Support deletion related parameter dynamic configuration #4798

[ChenSammi]

25th Aug.
Attender: Shopee(Yiyang, Ivan), Cloudera(Sammi)
Agenda:

• 1.4.0 Release Discussion

  • There are currently 74 Critical + Blocker issues which target 1.4.0.
    https://issues.apache.org/jira/browse/HDDS-9046?jql=project%20%3D%20HDDS%20AND%20resolution%20%3D%20Unresolved%20and%20priority%20in%20(Blocker%2CCritical)%20ORDER%20BY%20%20priority%20DESC%2C%20updated%20DESC
    Next step will go through the list to identify if each issue really needs to be included in 1.4.0 and the estimated finish time if yes.
  • Support RATIS 3.0 in Ozone 1.4.0 is under development HDDS-9192

• Ivan reports that currently open key cleanup is not supported for multi-upload keys. He created the umbrella JIRA HDDS-9095 and is working on it.

• Shopee is planning to migrate all existing Schema V2 containers to Schema V3 containers.