Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(relayer): Relayer indexer/processor separation and refactor, messaging queue #14605

Merged
merged 101 commits into from
Sep 6, 2023
Merged

feat(relayer): Relayer indexer/processor separation and refactor, messaging queue #14605

merged 101 commits into from
Sep 6, 2023

Commits on Aug 18, 2023

  1. fix the history page

    @cyberhorsey
    cyberhorsey committed Aug 18, 2023
    Configuration menu
    Copy the full SHA
    2fa81d9 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2023

  1. Merge branch 'main' of github.com:taikoxyz/taiko-mono into main

    @cyberhorsey
    cyberhorsey committed Aug 21, 2023
    Configuration menu
    Copy the full SHA
    06b67b9 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Merge branch 'main' of github.com:taikoxyz/taiko-mono into main

    @cyberhorsey
    cyberhorsey committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    13a1a30 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. Merge branch 'main' of github.com:taikoxyz/taiko-mono into main

    @cyberhorsey
    cyberhorsey committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    bbebdd9 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. wip

    @cyberhorsey
    cyberhorsey committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    01b6922 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into relayer_indexer_separation

    @cyberhorsey
    cyberhorsey committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    c35bf49 View commit details
    Browse the repository at this point in the history

  3. wip cli refactor

    @cyberhorsey
    cyberhorsey committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    e6b1ba8 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' of github.com:taikoxyz/taiko-mono into main

    @cyberhorsey
    cyberhorsey committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    7d91eb0 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' of github.com:taikoxyz/taiko-mono into main

    @cyberhorsey
    cyberhorsey committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    62956c1 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. indexer entire refactor to urfave/cli and taiko-client coding pattern… 

    …, runs
    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    30d708a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'relayer_indexer_separation' of github.com:taikoxyz/taik… 

    …o-mono into relayer_indexer_separation
    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    0afde21 View commit details
    Browse the repository at this point in the history

  3. src/dest eth clients for http

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    f2f332d View commit details
    Browse the repository at this point in the history

  4. lint

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    a1f03a7 View commit details
    Browse the repository at this point in the history

  5. processor updates to urfave/cli and taiko-client architecture

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    cdb8dea View commit details
    Browse the repository at this point in the history

  6. check can process message + move http to indexer

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    6e43ade View commit details
    Browse the repository at this point in the history

  7. better log

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    c96648d View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into relayer_indexer_separation

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    cf6fa1e View commit details
    Browse the repository at this point in the history

  9. missing log should be slog

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    1d3791a View commit details
    Browse the repository at this point in the history

  10. test

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    148a22b View commit details
    Browse the repository at this point in the history

  11. Merge branch 'relayer_indexer_separation' of github.com:taikoxyz/taik… 

    …o-mono into relayer_indexer_separation
    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    192599c View commit details
    Browse the repository at this point in the history

  12. http port

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    4b44c80 View commit details
    Browse the repository at this point in the history

  13. test

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    38b97d0 View commit details
    Browse the repository at this point in the history

  14. .

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    b6c6390 View commit details
    Browse the repository at this point in the history

  15. test

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    df38473 View commit details
    Browse the repository at this point in the history

  16. .env

    @cyberhorsey
    cyberhorsey committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    f94293f View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. output to stdout

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    62ebf3c View commit details
    Browse the repository at this point in the history

  2. server fix

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    9e12865 View commit details
    Browse the repository at this point in the history

  3. use srcchain and dest chain as queue

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    a4e7277 View commit details
    Browse the repository at this point in the history

  4. default .env

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    5d2534b View commit details
    Browse the repository at this point in the history

  5. log

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    1ff6a99 View commit details
    Browse the repository at this point in the history

  6. log

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    a217959 View commit details
    Browse the repository at this point in the history

  7. queue name

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    5b4ebac View commit details
    Browse the repository at this point in the history

  8. ctx cancel for ggraceful processor shutdown

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    94c4d11 View commit details
    Browse the repository at this point in the history

  9. only non nil msgs

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    b213e9b View commit details
    Browse the repository at this point in the history

  10. ack nil body

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    5f3f6f0 View commit details
    Browse the repository at this point in the history

  11. graceful shutdowns and metrics servers

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    6c869b9 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'main' into relayer_indexer_separation

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    4a0149b View commit details
    Browse the repository at this point in the history

  13. Merge branch 'main' into relayer_indexer_separation

    @dantaik
    dantaik committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    b8d4e3c View commit details
    Browse the repository at this point in the history

  14. handle ecdsa publickey error appropriately

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    9c60fed View commit details
    Browse the repository at this point in the history

  15. check http srv error isnt errserverclosed

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    f24830d View commit details
    Browse the repository at this point in the history

  16. add backoff for processor

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    23a48a7 View commit details
    Browse the repository at this point in the history

  17. defaults

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    b871c1e View commit details
    Browse the repository at this point in the history

  18. Merge branch 'relayer_indexer_separation' of github.com:taikoxyz/taik… 

    …o-mono into relayer_indexer_separation
    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    13b4743 View commit details
    Browse the repository at this point in the history

  19. default ctx

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    05a2d1f View commit details
    Browse the repository at this point in the history

  20. go mod

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    2b5f4eb View commit details
    Browse the repository at this point in the history

  21. handle delivery errors, close channels

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    b192cd8 View commit details
    Browse the repository at this point in the history

  22. test

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    346277c View commit details
    Browse the repository at this point in the history

  23. metrics tests

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    5e13d61 View commit details
    Browse the repository at this point in the history

  24. mock chain ids

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    1794e8e View commit details
    Browse the repository at this point in the history

  25. duplicate IDs

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    02b6f9c View commit details
    Browse the repository at this point in the history

  26. only use ch if valid

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    2eea9c8 View commit details
    Browse the repository at this point in the history

  27. logs

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    c0491b9 View commit details
    Browse the repository at this point in the history

  28. rm reset conn

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    473f027 View commit details
    Browse the repository at this point in the history

  29. try a panic here...

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    017d79e View commit details
    Browse the repository at this point in the history

  30. more logs

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    f6835b3 View commit details
    Browse the repository at this point in the history

  31. Reconnect

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    2192c86 View commit details
    Browse the repository at this point in the history

  32. typo

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    8c87e1f View commit details
    Browse the repository at this point in the history

  33. lint

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    36e1cfc View commit details
    Browse the repository at this point in the history

  34. lint

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    0487f45 View commit details
    Browse the repository at this point in the history

  35. return lint

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    2eff29a View commit details
    Browse the repository at this point in the history

  36. try to publish again

    @cyberhorsey
    cyberhorsey committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    f17b7cb View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2023

  1. handle connection closing

    @cyberhorsey
    cyberhorsey committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    acbdb61 View commit details
    Browse the repository at this point in the history

  2. lints

    @cyberhorsey
    cyberhorsey committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    131be79 View commit details
    Browse the repository at this point in the history

  3. notify cancel

    @cyberhorsey
    cyberhorsey committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    31f67a6 View commit details
    Browse the repository at this point in the history

  4. fix connect

    @cyberhorsey
    cyberhorsey committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    016748f View commit details
    Browse the repository at this point in the history

  5. err check

    @cyberhorsey
    cyberhorsey committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    2694a74 View commit details
    Browse the repository at this point in the history

  6. handle reconnect

    @cyberhorsey
    cyberhorsey committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    f76357d View commit details
    Browse the repository at this point in the history

  7. dont panic on scanning block, use backoff retry indefinitely

    @cyberhorsey
    cyberhorsey committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    33437e7 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2023

  1. additional logs

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    67da8e6 View commit details
    Browse the repository at this point in the history

  2. correct ack logs

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    c5a4968 View commit details
    Browse the repository at this point in the history

  3. use a ticker to make sure deliveries get processed

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    338d3bd View commit details
    Browse the repository at this point in the history

  4. notify for queue

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    5470818 View commit details
    Browse the repository at this point in the history

  5. inspect queue every tick

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    5cb1359 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into relayer_indexer_separation

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    77a918f View commit details
    Browse the repository at this point in the history

  7. need new msgs ch after connecting

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    fd49fc1 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'relayer_indexer_separation' of github.com:taikoxyz/taik… 

    …o-mono into relayer_indexer_separation
    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    fc36cd1 View commit details
    Browse the repository at this point in the history

  9. notifiers back in subscribe

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    5401a6e View commit details
    Browse the repository at this point in the history

  10. log

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    14f1f0a View commit details
    Browse the repository at this point in the history

  11. .

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    eebd0ae View commit details
    Browse the repository at this point in the history

  12. Add quick heartbeat

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    a7418b6 View commit details
    Browse the repository at this point in the history

  13. Add a message id

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    350ea25 View commit details
    Browse the repository at this point in the history

  14. more logs + a subscription specific ctx to restart the subscription

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    6fc2d19 View commit details
    Browse the repository at this point in the history

  15. dont ack/nack in a loop, delivery cant be delivered on same channel, … 

    …will be picked up again in subscription
    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    9426c47 View commit details
    Browse the repository at this point in the history

  16. Merge branch 'main' into relayer_indexer_separation

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    58f4e33 View commit details
    Browse the repository at this point in the history

  17. error => info?

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    696426a View commit details
    Browse the repository at this point in the history

  18. Merge branch 'relayer_indexer_separation' of github.com:taikoxyz/taik… 

    …o-mono into relayer_indexer_separation
    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    3d1988b View commit details
    Browse the repository at this point in the history

  19. log...

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    1e52ad1 View commit details
    Browse the repository at this point in the history

  20. check delivery channel

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    d6834f8 View commit details
    Browse the repository at this point in the history

  21. oops

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    37c6ff9 View commit details
    Browse the repository at this point in the history

  22. buffer the msgs chan

    @cyberhorsey
    cyberhorsey committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    40ab3f2 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2023

  1. Done close on channel/conn being closed

    @cyberhorsey
    cyberhorsey committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    3ba7f29 View commit details
    Browse the repository at this point in the history

  2. Dont reconnect on ack/nacks

    @cyberhorsey
    cyberhorsey committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    cc1d75d View commit details
    Browse the repository at this point in the history

  3. Try this...

    @cyberhorsey
    cyberhorsey committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    03ab07c View commit details
    Browse the repository at this point in the history

  4. rm buffer, add some logs

    @cyberhorsey
    cyberhorsey committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    7b1a1a1 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. Merge branch 'main' into relayer_indexer_separation

    @dantaik
    dantaik committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    e89628f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into relayer_indexer_separation

    @cyberhorsey
    cyberhorsey committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    3880033 View commit details
    Browse the repository at this point in the history

  3. add timeouts

    @cyberhorsey
    cyberhorsey committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    b450d05 View commit details
    Browse the repository at this point in the history

  4. timeouts in tests

    @cyberhorsey
    cyberhorsey committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    3ec57ae View commit details
    Browse the repository at this point in the history

  5. dynamic env file via env var

    @cyberhorsey
    cyberhorsey committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    c05e13b View commit details
    Browse the repository at this point in the history

  6. use ethclient timeout

    @cyberhorsey
    cyberhorsey committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    ab8efbb View commit details
    Browse the repository at this point in the history

  7. readme

    @cyberhorsey
    cyberhorsey committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    67a07bc View commit details
    Browse the repository at this point in the history