Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: switch to upstream object_store interface #14

Merged
merged 9 commits into from
Jun 7, 2022
Merged

Conversation

waynexia
Copy link
Member

@waynexia waynexia commented Jun 2, 2022

Which issue does this PR close?

Ref #13
Closed #15

Rationale for this change

The object_store component and related interfaces were forked from https://github.com/influxdata/influxdb_iox/tree/main/object_store
Now the upstream has separated it into a standalone crate and evolved more feather-rich and ergonomic interfaces. It would be better to migrate to it.

What changes are included in this PR?

Remove the hard fork of object_store, and use a wrapper over docs.rs/object_store instead.

Are there any user-facing changes?

no

How does this change test

UT

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
@waynexia waynexia linked an issue Jun 2, 2022 that may be closed by this pull request
4 tasks
@waynexia waynexia removed a link to an issue Jun 2, 2022
4 tasks
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
@waynexia waynexia changed the title [WIP] refactor: switch to upstream object_store interface refactor: switch to upstream object_store interface Jun 2, 2022
analytic_engine/src/setup.rs Outdated Show resolved Hide resolved
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
analytic_engine/src/table/sst_util.rs Outdated Show resolved Hide resolved
components/parquet/src/lib.rs Outdated Show resolved Hide resolved
analytic_engine/src/sst/parquet/builder.rs Show resolved Hide resolved
analytic_engine/src/sst/parquet/builder.rs Show resolved Hide resolved
analytic_engine/src/sst/parquet/reader.rs Show resolved Hide resolved
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
Copy link
Member

@ShiKaiWi ShiKaiWi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@waynexia waynexia merged commit ae3dcbe into main Jun 7, 2022
@waynexia waynexia deleted the object-store branch June 7, 2022 04:47
@jiacai2050 jiacai2050 mentioned this pull request Oct 27, 2022
chunshao90 referenced this pull request in chunshao90/ceresdb May 15, 2023
* refactor: switch to upstream object_store

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* migrate benchmark suit

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* remove hard fork

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* remove unwrap of create_dir_all

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* style: run cargo fmt

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* chore: add todo and fix style

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix benchmark compile error

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Switch ObjectStore to upstream crate object_store
2 participants