Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-46221][PS][DOCS] Change to_spark_io to spark.to_spark_io in quickstart_ps.ipynb #44135

Closed

Conversation

bjornjorgensen
Copy link
Contributor

@bjornjorgensen bjornjorgensen commented Dec 3, 2023

What changes were proposed in this pull request?

Change to_spark_io to spark.to_spark_io in quickstart_ps.ipynb

Why are the changes needed?

to_spark_io is change to spark.to_spark_io in spark 4.0
To have user guilds that works :)

Does this PR introduce any user-facing change?

No.

How was this patch tested?

image

Was this patch authored or co-authored using generative AI tooling?

No.

@bjornjorgensen bjornjorgensen changed the title [SPARK][PS][DOC] Change to_spark_io to spark.to_spark_io in quickstart_ps.ipynb [SPARK-46221][PS][DOC] Change to_spark_io to spark.to_spark_io in quickstart_ps.ipynb Dec 3, 2023
@bjornjorgensen bjornjorgensen changed the title [SPARK-46221][PS][DOC] Change to_spark_io to spark.to_spark_io in quickstart_ps.ipynb [SPARK-46221][PS][DOCS] Change to_spark_io to spark.to_spark_io in quickstart_ps.ipynb Dec 3, 2023
@bjornjorgensen
Copy link
Contributor Author

@itholic will you have a look.

@@ -14457,7 +14457,7 @@
}
],
"source": [
"psdf.to_spark_io('zoo.orc', format=\"orc\")\n",
"psdf.spark.to_spark_io('zoo.orc', format=\"orc\")\n",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this the only place to be updated for Apache Spark 4.0.0?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

image
Yes, it looks like this is the only one that was not changed in #43384

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you for the confirmation, @bjornjorgensen .

@HyukjinKwon
Copy link
Member

Merged to master.

Since CI doesn't verify the change.

@itholic
Copy link
Contributor

itholic commented Dec 4, 2023

Late LGTM. Thanks for fixing this.

@bjornjorgensen bjornjorgensen deleted the spark.to_spark_io branch December 4, 2023 08:19
asl3 pushed a commit to asl3/spark that referenced this pull request Dec 5, 2023
…n `quickstart_ps.ipynb`

### What changes were proposed in this pull request?
Change `to_spark_io` to `spark.to_spark_io`  in `quickstart_ps.ipynb`

### Why are the changes needed?
`to_spark_io` is change to `spark.to_spark_io` in spark 4.0
To have user guilds that works :)

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
![image](https://github.com/apache/spark/assets/47577197/76f7067a-eeb4-4acc-88f1-3af94f5e78c7)

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes apache#44135 from bjornjorgensen/spark.to_spark_io.

Authored-by: Bjørn Jørgensen <bjornjorgensen@gmail.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
dbatomic pushed a commit to dbatomic/spark that referenced this pull request Dec 11, 2023
…n `quickstart_ps.ipynb`

### What changes were proposed in this pull request?
Change `to_spark_io` to `spark.to_spark_io`  in `quickstart_ps.ipynb`

### Why are the changes needed?
`to_spark_io` is change to `spark.to_spark_io` in spark 4.0
To have user guilds that works :)

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
![image](https://github.com/apache/spark/assets/47577197/76f7067a-eeb4-4acc-88f1-3af94f5e78c7)

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes apache#44135 from bjornjorgensen/spark.to_spark_io.

Authored-by: Bjørn Jørgensen <bjornjorgensen@gmail.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants