[SPARK-35311][SS][UI][DOCS] Structured Streaming Web UI state information documentation

[gaborgsomogyi]

What changes were proposed in this pull request?

In this PR I'm adding Structured Streaming Web UI state information documentation.

Why are the changes needed?

Missing documentation.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

cd docs/
SKIP_API=1 bundle exec jekyll build

Manual webpage check.

[gaborgsomogyi]

cc @gatorsmile @HeartSaVioR

[SparkQA]

Test build #138146 has finished for PR 32433 at commit 5616732.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42667/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42667/

[HeartSaVioR]

+1

I'll merge in tomorrow if there's no further comment.

[dongjoon-hyun]

+1, LGTM.

cc @viirya

[viirya]

lgtm

[viirya]

BTW, shall we also update the screenshot? Current one (https://raw.githubusercontent.com/apache/spark/56167328dc252f338c0c2fb394c97d63da085283/docs/img/webui-structured-streaming-detail.png) doesn't show the added statistics but just original ones.

[HeartSaVioR]

Nice catch!
@gaborgsomogyi Shall we update the screenshot as well? Thanks!

[gaborgsomogyi]

@HeartSaVioR @viirya till now I was fighting to make a screenshot from the whole UI part but I don't have such big screen so I've added an additional image where the rest can be seen.

[gaborgsomogyi]

The alternative was to zoom out in the screen but then the UI was super tiny, hard to read and just ugly.

[HeartSaVioR]

Thanks for the update! Looks great.

@viirya Could you please go through the next round of reviews? If there's no additional feedback I'll merge this at the end of the week.

[SparkQA]

Test build #138446 has finished for PR 32433 at commit e99851d.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42967/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42967/

[HeartSaVioR]

Thanks @gaborgsomogyi ! Merged to master.

[viirya]

sorry for late. lgtm.