Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: handle messages concurrently in pickup worker #119

Merged
merged 14 commits into from
Mar 14, 2023
Merged

feat: handle messages concurrently in pickup worker #119

merged 14 commits into from
Mar 14, 2023

Commits on Mar 8, 2023

  1. feat: handle concurrent batches 

    WIP

- switch to an sqs lib that polls for new messages concurrently rather than in batches
- rewrite pickup worker so we can compose it out of single-responsibilty pieces instead of having to pass through the giant config ball.

License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    c95e166 View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2023

  1. chore: tests pass 

    License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    49b0ab3 View commit details
    Browse the repository at this point in the history

  2. chore: docs 

    License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    7bc7d91 View commit details
    Browse the repository at this point in the history

  3. chore: fix init order and docker test 

    test the api is available when start is called.

License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    4342ef8 View commit details
    Browse the repository at this point in the history

  4. chore: fix test race 

    License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    6a9a8f5 View commit details
    Browse the repository at this point in the history

  5. chore: revert err and remove unused fn§ 

    License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    b747064 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2023

  1. fix: add max timeout for fetching 

    fixes #101

License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    027943c View commit details
    Browse the repository at this point in the history

  2. fix: add tests. fix bugs 

    License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    e621bd2 View commit details
    Browse the repository at this point in the history

  3. chore: not testing message count 

    License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    8ed4f00 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2023

  1. chore: only set optional env if set 

    License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    f08cf6b View commit details
    Browse the repository at this point in the history

  2. chore: IPFS_API_URL is not required 

    License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    5a83796 View commit details
    Browse the repository at this point in the history

  3. chore: bump up fetchChunkTimeoutMs 

    2 mins is still timeout after node restarts

License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    4b6a00c View commit details
    Browse the repository at this point in the history

  4. chore: add origins to logs 

    License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    9f7dc1b View commit details
    Browse the repository at this point in the history

  5. chore: fix readme 

    License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
    @olizilla
    olizilla committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    20f6b35 View commit details
    Browse the repository at this point in the history