Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Introduce pull based replicator that does not use kafka #2377

Merged
merged 50 commits into from Aug 15, 2019
Merged

Introduce pull based replicator that does not use kafka #2377

merged 50 commits into from Aug 15, 2019

Commits on Aug 12, 2019

  1. thrift file changes and client fan out

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    4842dd2 View commit details
    Browse the repository at this point in the history

  2. Implement get repliation tasks in history shard

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    4f9e918 View commit details
    Browse the repository at this point in the history

  3. Cleanup code, implement mocks and make build pass

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    2ac4006 View commit details
    Browse the repository at this point in the history

  4. Implement replication task fetcher and processor for remote cluster

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    01b9f05 View commit details
    Browse the repository at this point in the history

  5. Wire repliation task pollers with remote frontends

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    29ef78e View commit details
    Browse the repository at this point in the history

  6. Add cluster replication levels in shard info and handle checkpointing

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    090c78a View commit details
    Browse the repository at this point in the history

  7. Set sourceCluster name correctly

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    2e0d0a4 View commit details
    Browse the repository at this point in the history

  8. Local pingpong test passes

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    3d3c1cf View commit details
    Browse the repository at this point in the history

  9. Formatting

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    6e6c806 View commit details
    Browse the repository at this point in the history

  10. Fix startup sequence and other bugs. Made request fetching working.

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    68e1bf9 View commit details
    Browse the repository at this point in the history

  11. Adding kafka initialization back for domain replication

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    5109d66 View commit details
    Browse the repository at this point in the history

  12. Expand getReplicationTasksResp to include readLevel and hasMore

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    69f5bad View commit details
    Browse the repository at this point in the history

  13. Fix bugs and add metrics for task processor

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    71ca345 View commit details
    Browse the repository at this point in the history

  14. bug fix for shard info

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    df21cf2 View commit details
    Browse the repository at this point in the history

  15. Make first xdc unit test working

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    c7f84e7 View commit details
    Browse the repository at this point in the history

  16. Fix minor comments

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    f6c97a0 View commit details
    Browse the repository at this point in the history

  17. Add config knobs and some code cleanup

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    d084de8 View commit details
    Browse the repository at this point in the history

  18. fix license file and comments

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    cef7759 View commit details
    Browse the repository at this point in the history

  19. Merge branch 'master' into pull-replicator

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    2b2d612 View commit details
    Browse the repository at this point in the history

  20. Fix build issue

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    8847088 View commit details
    Browse the repository at this point in the history

  21. Add logger and get rid of printf in client

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    345afc7 View commit details
    Browse the repository at this point in the history

  22. Add missing mock

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    199a044 View commit details
    Browse the repository at this point in the history

  23. Fix shard info unit test

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    01ddc3b View commit details
    Browse the repository at this point in the history

  24. Add consumer config for xdc tests

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    78bafd0 View commit details
    Browse the repository at this point in the history

  25. Fix update shard bug

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    1af9cc5 View commit details
    Browse the repository at this point in the history

  26. Review comments

    Liang Mei committed Aug 12, 2019
    Configuration menu
    Copy the full SHA
    53003be View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2019

  1. Review comments

    Liang Mei committed Aug 13, 2019
    Configuration menu
    Copy the full SHA
    8c03a06 View commit details
    Browse the repository at this point in the history

  2. Update shard info for sql

    Liang Mei committed Aug 13, 2019
    Configuration menu
    Copy the full SHA
    a7e1d6c View commit details
    Browse the repository at this point in the history

  3. Fix mysql

    Liang Mei committed Aug 13, 2019
    Configuration menu
    Copy the full SHA
    f4e23a6 View commit details
    Browse the repository at this point in the history

  4. Add missing mock

    Liang Mei committed Aug 13, 2019
    Configuration menu
    Copy the full SHA
    e489a01 View commit details
    Browse the repository at this point in the history

  5. Introduce config for replication task fetcher

    Liang Mei committed Aug 13, 2019
    Configuration menu
    Copy the full SHA
    b95421d View commit details
    Browse the repository at this point in the history

  6. Add missing mock

    Liang Mei committed Aug 13, 2019
    Configuration menu
    Copy the full SHA
    421b877 View commit details
    Browse the repository at this point in the history

  7. use backoff retry for replication task processor

    Liang Mei committed Aug 13, 2019
    Configuration menu
    Copy the full SHA
    b93f40b View commit details
    Browse the repository at this point in the history

  8. Fix fetcher initialization

    Liang Mei committed Aug 13, 2019
    Configuration menu
    Copy the full SHA
    3d85ced View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2019

  1. Review comments

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    3421726 View commit details
    Browse the repository at this point in the history

  2. Change mock

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    ade24e7 View commit details
    Browse the repository at this point in the history

  3. Review comments

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    6e8b61c View commit details
    Browse the repository at this point in the history

  4. Review comments

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    c6e45f8 View commit details
    Browse the repository at this point in the history

  5. Format code

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    3750430 View commit details
    Browse the repository at this point in the history

  6. Rename get replication tasks to get replication messages

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    63a63c3 View commit details
    Browse the repository at this point in the history

  7. Fix unit tests

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    a890494 View commit details
    Browse the repository at this point in the history

  8. Code format

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    d73754d View commit details
    Browse the repository at this point in the history

  9. Fix unit tests

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    d5dcb66 View commit details
    Browse the repository at this point in the history

  10. Fix comments

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    b610cdb View commit details
    Browse the repository at this point in the history

  11. Fix unit tests

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    a77ff29 View commit details
    Browse the repository at this point in the history

  12. Fix unit test

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    c16642c View commit details
    Browse the repository at this point in the history

  13. Format code and review comment

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    a31417b View commit details
    Browse the repository at this point in the history

  14. Fix unit test

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    13fb8bd View commit details
    Browse the repository at this point in the history

  15. Merge branch 'master' into pull-replicator

    Liang Mei committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    8cb75b5 View commit details
    Browse the repository at this point in the history

  16. Merge branch 'master' into pull-replicator

    @meiliang86
    meiliang86 committed Aug 14, 2019
    Configuration menu
    Copy the full SHA
    e5792fc View commit details
    Browse the repository at this point in the history