refactor: Merge FileWithMetadata into StageFileInfo

[Xuanwo]

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

refactor: Merge FileWithMetadata into StageFileInfo

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Comments	Updated
databend	⬜️ Ignored (Inspect)			Mar 16, 2023 at 2:01PM (UTC)

[youngsofun]

I prefer turn Metadata into StageFileInfo only when necessary.
for example, "select from stage" not need metadata other than size and is_dir/is_file.
we can list with minimal metadata fetched, but still carry a MetaData object.
(size is for read meta of parquet, not actually used for now, due to limitation of arrow2 interface)

StageFileInfo with all metas is only used when 'color' a file, and list stage

MetaKey should be decided by diff apps.

---

Rest LGTM.

[Xuanwo]

I prefer turn Metadata into StageFileInfo only when necessary.

Great catch! I understand and agree with your suggestion to turn Metadata into StageFileInfo when necessary. However, I will need some time to review the logic and come up with a better solution.

As this pull request does not have any negative impact (since we used to receive full metadata before), how about merging it first and then refining it later?

[BohuTANG]

Will merge, then we can refine it in another PR.