Docs: Update documentation for Spark AddFiles procedure

[dramaticlly]

Based on @szehon-ho suggestion in #6797 (comment)

• adds new check_duplicate_files in parameter
• adds missing output section for both added_files_count and check_duplicate_files
• highlight the impact of tblprop compatibility.snapshot-id-inheritance.enabled and other caveats when using this procedure

CC @szehon-ho @RussellSpitzer

[szehon-ho]

Thanks @dramaticlly for documenting this, some review comments below

[dramaticlly]

I updated per szehon feedback, also use intellij to reformat all tables in markdown syntax to read a little better. appreciate another look @szehon-ho and @rdblue

[szehon-ho]

HI @dramaticlly , sorry about this, while intellij format looks cool, would it be possible to do it in a separate pr? So we have more fine-grained commits and ease of seeing exact changes. Thanks

[dramaticlly]

HI @dramaticlly , sorry about this, while intellij format looks cool, would it be possible to do it in a separate pr? So we have more fine-grained commits and ease of seeing exact changes. Thanks

Thank you @szehon-ho . I reverted format lint to limit the scope only for add-files

[dramaticlly]

@Fokko and @rdblue can I ask for 2nd pair of eyes on docs update? Appredicated!

[szehon-ho]

@dramaticlly i chatted with @RussellSpitzer offline, do you want to make an issue to explore if we can have the SparkUtil itself return these values, instead of using snapshot summary which is missing in some cases? I am ok with this doc for this release, in any case.

[dramaticlly]

• compatibility.snapshot-id-inheritance.enabled

Thank you @szehon-ho , created #6961 as suggested, feel free to edit/update

[szehon-ho]

Merged, thanks @dramaticlly