You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The text was updated successfully, but these errors were encountered:
ion-elgreco
changed the title
[FEATURE] Use _collect_as_arrow for sparkdf.as_arrow()
[FEATURE] Use _collect_as_arrow for fugue_api.as_arrow(spark_df)Sep 22, 2023
Is your feature request related to a problem? Please describe.
Convert spark df to arrow can be done with private method inside pyspark:
_collect_as_arrow
https://github.com/apache/spark/blob/06ccb6d434476afacc08936cf473670102d41010/python/pyspark/sql/pandas/conversion.py#L244The text was updated successfully, but these errors were encountered: