[HUDI-7576] Improve efficiency of getRelativePartitionPath, reduce computation of partitionPath in AbstractTableFileSystemView

[the-other-tim-brown]

Change Logs

• Improve the efficiency of getRelativePartitionPath by reducing the number of operations on the path object that are required to get the final result
• Reduce the number of times a partitionPath is computed by supplying a partition path argument where possible in the AbstractFileSystemView

Impact

Reduces overhead of building FSViews with large numbers of files

Risk level (write none, low medium or high below)

None

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none".

• The config description must be updated if new configs are added or the default value of the configs are changed
• Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
  ticket number here and follow the instruction to make
  changes to the website.

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[danny0405]

+1, I love this fix.

[danny0405]

@the-other-tim-brown Can you fix the Azure CI failure?

[the-other-tim-brown]

@danny0405 error is:

TestUpsertPartitioner.testUpsertPartitionerWithSmallFileHandlingPickingMultipleCandidates:470 expected: <[BucketInfo {bucketType=UPDATE, fileIdPrefix=fg-1, partitionPath=2016/03/15}, BucketInfo {bucketType=UPDATE, fileIdPrefix=fg-2, partitionPath=2016/03/15}, BucketInfo {bucketType=UPDATE, fileIdPrefix=fg-3, partitionPath=2016/03/15}]> but was: <[BucketInfo {bucketType=UPDATE, fileIdPrefix=fg-3, partitionPath=2016/03/15}, BucketInfo {bucketType=UPDATE, fileIdPrefix=fg-2, partitionPath=2016/03/15}, BucketInfo {bucketType=UPDATE, fileIdPrefix=fg-1, partitionPath=2016/03/15}]>

I'll put up a separate minor pr to make the ordering deterministic for small file handling

[the-other-tim-brown]

@danny0405 #11008

[hudi-bot]

CI report:

• 22f01c9 UNKNOWN
• dd662ff Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[the-other-tim-brown]

@danny0405 can you take another look when you get a chance? I have updated a few spots in the code