Please sign in to comment.
[MINOR][DOCS] Fix for contradiction in condition formula of keeping i…
…ntermediate state of window in structured streaming docs This change solves contradiction in structured streaming documentation in formula which tests if specific window will be updated by calculating watermark and comparing with "T" parameter(intermediate state is cleared as (max event time seen by the engine - late threshold > T), otherwise kept(written as "until")). By further examples the "T" seems to be the end of the window, not start like documentation says firstly. For more information please take a look at my question in stackoverflow https://stackoverflow.com/questions/54599594/understanding-window-with-watermark-in-apache-spark-structured-streaming Can be tested by building documentation. Closes #23765 from vitektarasenko/master. Authored-by: Viktor Tarasenko <firstname.lastname@example.org> Signed-off-by: Sean Owen <email@example.com>
- Loading branch information...
Showing with 1 addition and 1 deletion.