[HUDI-8365] Reduce serialization overhead of HoodieTable

[the-other-tim-brown]

Change Logs

• Lazily initialize the HoodieTableMetadata, HoodieIndex, and HoodieStorageLayout objects within the HoodieTable and avoid serializing it as part of the HoodieTable
• Register classes referenced within HoodieTable and the HoodieTableMetaClient with Kryo

Impact

Reduces serialization overhead of Spark tasks that reference HoodieTable

Risk level (write none, low medium or high below)

Low

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none".

• The config description must be updated if new configs are added or the default value of the configs are changed
• Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
  ticket number here and follow the instruction to make
  changes to the website.

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[danny0405]

what is the criteria for adding these classes?

[the-other-tim-brown]

Kryo recommends registering the classes since it uses a shorter identifier instead of the fully qualified class name when serializing objects. I don't have any context for what the criteria is within the Hudi repo though.

[hudi-bot]

CI report:

• e645460 Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build