Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-23132][PYTHON][ML] Run doctests in ml.image when testing #20294

Closed
wants to merge 1 commit into from

Conversation

HyukjinKwon
Copy link
Member

What changes were proposed in this pull request?

This PR proposes to actually run the doctests in ml/image.py.

How was this patch tested?

doctests in python/pyspark/ml/image.py.

@HyukjinKwon
Copy link
Member Author

cc @MrBago and @imatiach-msft, could you take a look when you are available please?

>>> df.count()
4
5
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It becomes 5 since we don't dropImageFailures.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice catch!

@SparkQA
Copy link

SparkQA commented Jan 17, 2018

Test build #86268 has finished for PR 20294 at commit 9912444.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@imatiach-msft
Copy link
Contributor

nice fix! Great to see the doctests run.

Copy link
Member

@BryanCutler BryanCutler left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

asfgit pushed a commit that referenced this pull request Jan 17, 2018
## What changes were proposed in this pull request?

This PR proposes to actually run the doctests in `ml/image.py`.

## How was this patch tested?

doctests in `python/pyspark/ml/image.py`.

Author: hyukjinkwon <gurwls223@gmail.com>

Closes #20294 from HyukjinKwon/trigger-image.

(cherry picked from commit 45ad97d)
Signed-off-by: hyukjinkwon <gurwls223@gmail.com>
@HyukjinKwon
Copy link
Member Author

Merged to master and branch-2.3.

Thanks for reviewing this, @srowen, @imatiach-msft, @MrBago and @BryanCutler.

@asfgit asfgit closed this in 45ad97d Jan 17, 2018
@HyukjinKwon HyukjinKwon deleted the trigger-image branch October 16, 2018 12:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
5 participants