Skip to content

Partitioning StackStorm Sensors #4

@arm4b

Description

@arm4b

Moved from https://github.com/StackStorm/k8s-st2/issues/12

See: https://docs.stackstorm.com/reference/sensor_partitioning.html

At the moment st2sensorcontainer K8s configuration consists of Deployment with hardcoded 1 replica and works as a parent responsible to forking/starting/stopping all sensors in the system.

Future plans to re-work this setup (discussion https://github.com/StackStorm/discussions/issues/305) and benefit from Docker-friendly single-sensor-per-container mode (added since st2 v2.9) as a way of Sensor Partitioning, distributing the computing load between many pods and relying on K8s failover/reschedule mechanisms, instead of running everything on 1 single instance of st2sensorcontainer.

Need to codify + config that mode in Docker + K8s Helm templates so user specifies list of sensors he wants to run in values.yaml, Helm takes care about starting a pod for each record.

References

https://github.com/StackStorm/stackstorm-enterprise-ha/blob/ca116b1c20b8953aebde429139022bd4141aa068/values.yaml#L279-L285

https://github.com/StackStorm/stackstorm-enterprise-ha/blob/ca116b1c20b8953aebde429139022bd4141aa068/templates/deployments.yaml#L710-L715

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions