Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support write batch in remote engine #840

Merged
merged 5 commits into from
Apr 14, 2023

Conversation

Rachelint
Copy link
Contributor

@Rachelint Rachelint commented Apr 13, 2023

Which issue does this PR close?

Closes #

Rationale for this change

Support write_batch in RemoteEngine(using for partitioned table), that will send all write requests in the same node in once to reduce the rpc calls.

What changes are included in this PR?

  • Add write_batch in RemoteEngineClient.
  • Add write_batch in RemoteEngineService.
  • Modify write in PartitionTable to make use of write_batch method.

Are there any user-facing changes?

None.

How does this change test

Test by integration tests.

@Rachelint Rachelint marked this pull request as ready for review April 14, 2023 02:29
Cargo.toml Outdated Show resolved Hide resolved
@Rachelint Rachelint force-pushed the add-write-batch-in-remote-engine branch from 3bfb939 to 7eb3c7a Compare April 14, 2023 02:45
partition_table_engine/src/partition.rs Outdated Show resolved Hide resolved
partition_table_engine/src/partition.rs Outdated Show resolved Hide resolved
partition_table_engine/src/partition.rs Outdated Show resolved Hide resolved
remote_engine_client/src/cached_router.rs Show resolved Hide resolved
remote_engine_client/src/client.rs Outdated Show resolved Hide resolved
server/src/grpc/remote_engine_service/mod.rs Show resolved Hide resolved
remote_engine_client/src/client.rs Outdated Show resolved Hide resolved
remote_engine_client/src/client.rs Show resolved Hide resolved
remote_engine_client/src/client.rs Outdated Show resolved Hide resolved
remote_engine_client/src/client.rs Show resolved Hide resolved
Copy link
Member

@ShiKaiWi ShiKaiWi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ShiKaiWi ShiKaiWi changed the title Add write batch in remote engine feat: support write batch in remote engine Apr 14, 2023
@Rachelint Rachelint added this pull request to the merge queue Apr 14, 2023
Merged via the queue into apache:main with commit dea69d4 Apr 14, 2023
4 of 5 checks passed
chunshao90 pushed a commit to chunshao90/ceresdb that referenced this pull request May 15, 2023
* add write batch into `RemoteEngine`.

* make use of write_batch.

* fix clippy.

* update ceresdbproto's path.

* address CR.
@Rachelint Rachelint deleted the add-write-batch-in-remote-engine branch May 27, 2023 12:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants