Skip to content

Conversation

@gaogaotiantian
Copy link
Contributor

What changes were proposed in this pull request?

Like all other tests, a test can't just import pyarrow or import pandas.

Why are the changes needed?

https://github.com/apache/spark/actions/runs/21035972618/job/60484152696

Does this PR introduce any user-facing change?

No

How was this patch tested?

CI should continue to pass and we need to wait for the daily scheduled CI.

Was this patch authored or co-authored using generative AI tooling?

No

@github-actions
Copy link

JIRA Issue Information

=== Improvement SPARK-54337 ===
Summary: Expose dataframe interchange protocol on pyspark RDD, SQL DataFrame, and pandas DataFrame APIs
Assignee: Devin Petersohn
Status: Resolved
Affected: ["4.0.1"]


This comment was automatically generated by GitHub Actions

@Yicong-Huang
Copy link
Contributor

maybe add [TESTS] to title?

@gaogaotiantian gaogaotiantian changed the title [SPARK-54337][PS][FOLLOWUP] Fix test_arrow_c_stream when pandas/arrow does not exist [SPARK-54337][PS][TESTS][FOLLOWUP] Fix test_arrow_c_stream when pandas/arrow does not exist Jan 16, 2026
@zhengruifeng
Copy link
Contributor

please also use from pyspark.testing import main btw

@gaogaotiantian
Copy link
Contributor Author

please also use from pyspark.testing import main btw

Done. I also rebased this branch and removed the unnecessary type ignore thanks to #53826

@zhengruifeng
Copy link
Contributor

thanks, merged to master

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants