Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add stream splits gRPC. #4109

Merged
merged 10 commits into from
Dec 7, 2023
Merged

Add stream splits gRPC. #4109

merged 10 commits into from
Dec 7, 2023

Conversation

fmassot
Copy link
Contributor

@fmassot fmassot commented Nov 9, 2023

Add the stream_splits gRPC method and remove the list_splits gRPC method.

I found it a bit more convenient to add alist_splits method in the MetastoreServiceExt trait rather than enriching the service stream response by adding some helpers to pump the stream and deserialize the splits.

TODO:

  • Fix tests.
  • Add a test with thousands of splits
  • Run the metastore test suite on the grpc client
  • Reorganize metastore test suite

@fmassot fmassot marked this pull request as draft November 9, 2023 23:14
@fmassot fmassot force-pushed the fmassot/add-stream-splits-rpc branch from 3731e99 to eb3af54 Compare November 9, 2023 23:26
@fmassot fmassot requested a review from guilload November 9, 2023 23:31
@fmassot fmassot marked this pull request as ready for review November 9, 2023 23:31
@fmassot fmassot force-pushed the fmassot/add-stream-splits-rpc branch 3 times, most recently from 22ded45 to d51708f Compare November 13, 2023 23:49
@fmassot fmassot force-pushed the fmassot/add-stream-splits-rpc branch 4 times, most recently from af09056 to 8e193aa Compare December 5, 2023 10:23
@fmassot fmassot requested a review from guilload December 5, 2023 10:25
@fmassot fmassot force-pushed the fmassot/add-stream-splits-rpc branch from d653037 to fa91de5 Compare December 7, 2023 10:02
@fmassot fmassot merged commit 6eb0767 into main Dec 7, 2023
4 checks passed
@fmassot fmassot deleted the fmassot/add-stream-splits-rpc branch December 7, 2023 10:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants