Skip to content

Comments

[SPARK-40081][PYTHON][DOCS] Add document parameters for pyspark.sql.streaming.query#37587

Closed
dcoliversun wants to merge 4 commits intoapache:masterfrom
dcoliversun:SPARK-40081
Closed

[SPARK-40081][PYTHON][DOCS] Add document parameters for pyspark.sql.streaming.query#37587
dcoliversun wants to merge 4 commits intoapache:masterfrom
dcoliversun:SPARK-40081

Conversation

@dcoliversun
Copy link
Contributor

What changes were proposed in this pull request?

As mentioned #37482 (comment), this PR proposes to add document parameters for pyspark.sql.streaming.query.

Why are the changes needed?

To make the documentation more readable.

Does this PR introduce any user-facing change?

Yes, it changes the documentation.

How was this patch tested?

Manually ran each doctest.

@dcoliversun
Copy link
Contributor Author

cc @HyukjinKwon @xinrong-meng
It would be good if you could take a look when you have time, thanks!

@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@HyukjinKwon
Copy link
Member

cc @HeartSaVioR if you find some time to take a look

Returns
-------
str or dict or list
An array of the most recent :class:`StreamingQueryProgress` updates for this query.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should probably mention that return a dictionary instead of StreamingQueryProgress instance.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I choose to keep StreamingQueryProgress and add dict here. Because StreamingQueryProgress can help user to understand how it is in dictionary.

@HyukjinKwon
Copy link
Member

Looks pretty good otherwise.

@HyukjinKwon
Copy link
Member

Merged to master.

@HyukjinKwon
Copy link
Member

Thanks for working on this @dcoliversun

@dcoliversun dcoliversun deleted the SPARK-40081 branch August 23, 2022 01:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants