New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add 'index_col' parameter to DataFrame.to_spark #906
Conversation
# A function to turn given numbers to Spark columns that represent Koalas index. | ||
SPARK_INDEX_NAME_FORMAT = "__index_level_{}__".format | ||
# A pattern to check if the name of a Spark column is a Koalas index name or not. | ||
SPARK_INDEX_NAME_PATTERN = re.compile(r"__index_level_[0-9]+__") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These changes are not related actually ..
Softagram Impact Report for pull/906 (head commit: 29dab9e)⭐ Change Overview
📄 Full report
Impact Report explained. Give feedback on this report to support@softagram.com |
Codecov Report
@@ Coverage Diff @@
## master #906 +/- ##
==========================================
- Coverage 94.3% 94.27% -0.03%
==========================================
Files 34 34
Lines 6213 6239 +26
==========================================
+ Hits 5859 5882 +23
- Misses 354 357 +3
Continue to review full report at Codecov.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
Thanks! merging. |
Thanks!! |
This PR adds
index_col
parameter toDataFrame.to_spark
. This PR relates to #901.After this PR, we can do a roundtrip in Koalas and Spark DataFrame easily.