Skip to content

Conversation

@Adir111
Copy link
Contributor

@Adir111 Adir111 commented Oct 23, 2025

Added explanation for stateType field in algorithm spec under Streaming Algorithm Priority (At Streaming page).


This change is Reviewable

@Adir111 Adir111 requested a review from RonShvarz October 23, 2025 08:09
@Adir111 Adir111 self-assigned this Oct 23, 2025
Copy link
Contributor

@RonShvarz RonShvarz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: 0 of 1 files reviewed, 4 unresolved discussions (waiting on @Adir111)


site/learn/Streaming.md line 170 at r1 (raw file):

### Streaming Algorithm Priority
Streaming algorithms have a special priority setting. To use it, you need to set the `stateType` in your algorithm spec to either **stateless** or **stateful**.

If you are experiencing slower algorithm allocation in stateless pipelines, .. these algorithms have..


site/learn/Streaming.md line 173 at r1 (raw file):

When set:  
- **Stateful algorithms** - A Kubernetes Job is created and launched immediately. These jobs are given the highest priority and start execution right away.  

Stateful , without the word algorithms


site/learn/Streaming.md line 174 at r1 (raw file):

When set:  
- **Stateful algorithms** - A Kubernetes Job is created and launched immediately. These jobs are given the highest priority and start execution right away.  
- **Stateless algorithms** - Each algorithm runs as a Kubernetes Job, but these jobs are launched after all stateful ones.  

Stateless, without algorithms,
(Remove prefix) Jobs are launched ...


site/learn/Streaming.md line 176 at r1 (raw file):

- **Stateless algorithms** - Each algorithm runs as a Kubernetes Job, but these jobs are launched after all stateful ones.  
- **Algorithms without a `stateType` field** - These jobs are created after the stateless ones at controlled intervals to manage cluster load and avoid excessive pod launches at once.
> Note - All jobs are re-requested as needed, following the interval defined in the config settings.

unneeded

Copy link
Contributor Author

@Adir111 Adir111 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: 0 of 1 files reviewed, 4 unresolved discussions (waiting on @Adir111 and @RonShvarz)


site/learn/Streaming.md line 170 at r1 (raw file):

Previously, RonShvarz (Ron Shvarzburd) wrote…

If you are experiencing slower algorithm allocation in stateless pipelines, .. these algorithms have..

Done.


site/learn/Streaming.md line 173 at r1 (raw file):

Previously, RonShvarz (Ron Shvarzburd) wrote…

Stateful , without the word algorithms

Done.


site/learn/Streaming.md line 174 at r1 (raw file):

Previously, RonShvarz (Ron Shvarzburd) wrote…

Stateless, without algorithms,
(Remove prefix) Jobs are launched ...

Done.


site/learn/Streaming.md line 176 at r1 (raw file):

Previously, RonShvarz (Ron Shvarzburd) wrote…

unneeded

Done.

Copy link
Contributor

@RonShvarz RonShvarz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@RonShvarz reviewed 1 of 1 files at r2, all commit messages.
Reviewable status: all files reviewed, 4 unresolved discussions (waiting on @Adir111)

@Adir111 Adir111 merged commit 5bc9c22 into source Oct 29, 2025
1 of 2 checks passed
@Adir111 Adir111 deleted the statetype_explanation_added branch October 29, 2025 09:10
github-actions bot pushed a commit that referenced this pull request Oct 29, 2025
added explanation about stateType (streaming algs priority) .... bump version [skip ci]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants