Skip to content

Conversation

@aljoscha
Copy link
Contributor

Copy link
Contributor

@alpinegizmo alpinegizmo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the terminology needs clarification. Whether it's called per-window state, or "scoped to a window", what's going on remains unclear to someone coming to this unprepared.

It all hinges on what one means by "a window". I may think of my job as having one window -- e.g. an hour-long TimeWIndow. Or I might think that I have 10 windows, because I'm running with a parallelism of 10. Or a million windows because I have a million unique keys. Or that I'll have 24 windows during the course of the day because there will be 24 hour-long windows during a day. Or ...

I'm not sure how best to make things clear, I just know how easy it is to find this confusing.

### Using per-window state in ProcessWindowFunction

In addition to accessing keyed state (as any rich function can) a `ProcessWindowFunction` can
also use keyed state that is scoped to the window that the function is currently processing. The are
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The are --> There are

Copy link
Contributor

@alpinegizmo alpinegizmo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good. +1

@aljoscha
Copy link
Contributor Author

Thanks for the review! 😃

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants