Skip to content

Make autoscaling load signals pluggable #2134

Description

@vdusek

SystemStatus (src/crawlee/_autoscaling/system_status.py) hardcodes the CPU, memory, event loop and client signals with fixed thresholds, so adding a custom signal or dropping an existing one is not possible. Introduce a load signal abstraction that the autoscaling system accepts as a list.

JS implementation: apify/crawlee#3917, apify/crawlee#3976

✍️ Drafted by Claude Code

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request.t-toolingIssues with this label are in the ownership of the tooling team.

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions