Skip to content

uber/uReplicator

master
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code

Latest commit

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
February 15, 2021 22:42
March 25, 2019 15:08
July 25, 2017 14:44
March 25, 2019 15:08

uReplicator

Build Status

Update

From 11/20/2018, old master branch (no uReplcator-Manager module) is moved to branch-0.1. New master is backward-compatible and supports both non-federation and federation mode.

Highlight

uReplicator provides a Kafka replication solution with high performance, scalability and stability.

uReplicator is good at:

  • High throughput
    • uReplicator has a controller to assign partitions to workers based on throughput in source cluster so each worker can achieve max throughput. (Currently it depends on Chaperone; We will make it get workload from JMX shortly)
    • uReplicator checks lags on each worker and removes heavy traffic from lagging workers.
  • High availability
    • uReplicator uses smart rebalance instead of high level consumer rebalance which can guarantee smooth replication.
  • High scalability
    • When the scale of Kafka infrastructure increases, simply add more hosts to uReplicator and it will scale up automatically
  • Smart operation (Federated uReplicator)
    • Federated uReplicator can set up replication route automatically.
    • When a route has higher traffic or lag, Federated uReplicator can add workers automatically and release afterwards.
    • uReplicator can detect new partitions in source cluster and start replication automatically

Documentation

You can find quick start and configurations in uReplicator User Guide.