Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Bump hive_metastore to use pure rust thrift impl volo #174

Merged
merged 4 commits into from
Feb 5, 2024

Conversation

Xuanwo
Copy link
Member

@Xuanwo Xuanwo commented Jan 26, 2024

Close #155

Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Copy link
Collaborator

@liurenjie1024 liurenjie1024 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally LGTM, thanks!

crates/catalog/hms/Cargo.toml Outdated Show resolved Hide resolved
.address(address)
// Framed thrift rpc is not enabled by default in HMS, we use
// buffered instead.
.make_codec(volo_thrift::codec::default::DefaultMakeCodec::buffered())
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe it's better to make this a config?

Copy link
Member Author

@Xuanwo Xuanwo Feb 4, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree we should make this setting available to users, though I believe it's a lower priority. I've created an issue at #188 to keep track of this.

}

/// Format an io error into iceberg error.
pub fn from_io_error(error: io::Error) -> Error {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

io::Error is a common error, how about moving it to core crate?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure if moving to core and making it a public API is a good idea. What if we address this once we have the same from_io_error in core?

@liurenjie1024
Copy link
Collaborator

cc @Xuanwo Any updates?

@Fokko Fokko added this to the 0.2.0 Release milestone Feb 2, 2024
Signed-off-by: Xuanwo <github@xuanwo.io>
@Xuanwo
Copy link
Member Author

Xuanwo commented Feb 4, 2024

cc @liurenjie1024, please review again. Sorry for the late.

Copy link
Collaborator

@liurenjie1024 liurenjie1024 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, let's move!

Copy link
Contributor

@Fokko Fokko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR @Xuanwo and @liurenjie1024 for the review 🙌

@Fokko Fokko merged commit 09765db into apache:main Feb 5, 2024
7 checks passed
@Xuanwo Xuanwo deleted the bump-hive-metastore branch February 5, 2024 02:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants