-
Notifications
You must be signed in to change notification settings - Fork 356
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implements tail() for DataFrame & Series #1055
Conversation
Codecov Report
@@ Coverage Diff @@
## master #1055 +/- ##
==========================================
+ Coverage 95.13% 95.13% +<.01%
==========================================
Files 34 34
Lines 6765 6767 +2
==========================================
+ Hits 6436 6438 +2
Misses 329 329
Continue to review full report at Codecov.
|
Looks okay. |
Softagram Impact Report for pull/1055 (head commit: 07d67b9)⭐ Change Overview
💡 Insights
📄 Full report
Impact Report explained. Give feedback on this report to support@softagram.com |
This function returns the last `n` rows for the object based | ||
on position. It is useful for quickly verifying data, | ||
for example, after sorting or appending rows. | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
FYI, I plan to propose a new API tail
in Spark itself. If we manage to add it, we could efficiently do that.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we hold on for a while? We could leave a note about that if we add it in Spark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@HyukjinKwon ah, that sounds great!! 👍
Okay, then just let me know for fix this after tail
will be added on spark,
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
PR submitted at apache/spark#26809. Let's see how it goes.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@HyukjinKwon awesome! thanks for reminding me 👍
Now, Apache Spark 3.0 will have an API DataFrame.tail. Let's revisit this when Spark 3.0 is out. |
Implements pandas.DataFrame.tail() (https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.tail.html#pandas.DataFrame.tail) and pandas.Series.tail(https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.Series.tail.html#pandas.Series.tail)
For DataFrame
For Series