Skip to content

limit batch size for asynq.BatchBase queries? #114

New issue
New issue
Open
#161
Open
limit batch size for asynq.BatchBase queries?#114
#161
@lambdaq

Description

@lambdaq
lambdaq
opened on Apr 18, 2022

Hi,

When subclassing asynq.BatchBase is it possible to specify batch size?

e.g. limit 1000 items per get_multi command, otherwise the response would be too big and will timeout sometimes.

Activity

JelleZijlstra

JelleZijlstra commented on Apr 18, 2022

@JelleZijlstra
JelleZijlstra
on Apr 18, 2022
Contributor

It's not supported in asynq itself. In our internal code we split up huge batches inside the _flush implementation. I agree it would be a useful feature for asynq itself to add.

SmartManoj
linked a pull request that will close this issue on Jun 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Development

      Participants

      @JelleZijlstra@lambdaq

      Issue actions
        limit batch size for asynq.BatchBase queries? · Issue #114 · quora/asynq