local file system and remote object storage

[hopeyen]

Description

Instead of std::fs, use [object_store] (https://crates.io/crates/object_store) from Apache Arrow.

• Allowed for both consumer write and provider read
• multipart write and vectorized read for both FS and OS
• /tmp/bucket/... is used to store the bytes during download for precise writing of the chunks, then uploaded to the bucket after complete download
• file system files and objects can be used interchangeably, but with different configurations
• updated unit/e2e tests and benchmarks

Issue link (if applicable)

Resolves #15

Checklist

• Are tests up-to-date with the new changes?
• Are docs up-to-date with the new changes? (Open PR on docs repo if necessary)

[github-actions]

Pull Request Test Coverage Report for Build 8194223349

Details

• 0 of 672 (0.0%) changed or added relevant lines in 16 files are covered.
• 8 unchanged lines in 4 files lost coverage.
• Overall coverage remained the same at 0.0%

---

Changes Missing Coverage	Covered Lines	Changed/Added Lines	%
file-exchange/src/discover/mod.rs	0	1	0.0%
file-exchange/src/download_client/range_request.rs	0	1	0.0%
file-exchange/src/manifest/manifest_fetcher.rs	0	1	0.0%
file-service/src/file_server/cost.rs	0	2	0.0%
file-exchange/src/manifest/mod.rs	0	5	0.0%
file-service/src/file_server/mod.rs	0	5	0.0%
file-service/src/file_server/status.rs	0	5	0.0%
file-exchange/src/test_util.rs	0	7	0.0%
file-exchange/src/config.rs	0	12	0.0%
file-service/src/file_server/service.rs	0	16	0.0%

Files with Coverage Reduction	New Missed Lines	%
file-exchange/src/config.rs	1	0.0%
file-exchange/src/manifest/file_reader.rs	1	0.0%
file-exchange/src/manifest/mod.rs	3	0.0%
file-exchange/src/publisher/mod.rs	3	0.0%

Totals
Change from base Build 8143304729:	0.0%
Covered Lines:	0
Relevant Lines:	3586

---

💛 - Coveralls