Skip to content

[Task]: [RRIO] [Throttle] transform that slows down element transmission without an external resource #28930

@damondouglas

Description

@damondouglas

The output of this task is a PTransform that throttles a PCollection of elements. See https://s.apache.org/beam-throttle-transform for further details.

Measures of Done

  • Unit tests validate throttling behavior as a function of data size, PCollection boundedness without loss of data
  • Unit tests validate throttling of user custom types
  • Unit tests validate window strategy behavior as a function of PCollection boundedness and upstream and downstream window strategies
  • Load tests validate throttling behavior as a function of large data sizes, PCollection boundedness, Dataflow Runner number of workers without loss of data

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions