Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-37207][PySpark] Add isEmpty method for the Python DataFrame API #34483

Closed
wants to merge 3 commits into from
Closed

Conversation

dhirennavani
Copy link
Contributor

What changes were proposed in this pull request?

Python API to check for emptiness

Why are the changes needed?

For python compatibility with scala api

Does this PR introduce any user-facing change?

Users would be able to check for emptiness

How was this patch tested?

Unit tests

Add forany and forall api for Dataframe/Datasets API

To provide a higher level of abstraction for Spark customers

Yes, forany and forall methods are added to the Dataframe/Dataset API

Added new unit tests
@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@dchvn
Copy link
Contributor

dchvn commented Nov 4, 2021

You should add this api in python/docs/source/reference/pyspark.sql.rst and enable GitHub Actions in your forked repository to run tests

@dhirennavani
Copy link
Contributor Author

I added it to rst file, I am unable to rerun the actions.

@dhirennavani dhirennavani reopened this Nov 4, 2021
@dchvn
Copy link
Contributor

dchvn commented Nov 4, 2021

You can push new commit to rerun actions. BTW, I think you should sort APIs in python/docs/source/reference/pyspark.sql.rst

@dhirennavani
Copy link
Contributor Author

Closing this as I had messed up my forked repo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants