Skip to content

[SPARK-41280][CONNECT] Implement DataFrame.tail#38814

Closed
amaliujia wants to merge 1 commit into
apache:masterfrom
amaliujia:tail
Closed

[SPARK-41280][CONNECT] Implement DataFrame.tail#38814
amaliujia wants to merge 1 commit into
apache:masterfrom
amaliujia:tail

Conversation

@amaliujia
Copy link
Copy Markdown

What changes were proposed in this pull request?

This PR implements DataFrame.tail which is different from limit as tail fetches from the last of the dataset which implies tail respects ordering.

Why are the changes needed?

API coverage.

Does this PR introduce any user-facing change?

NO

How was this patch tested?

UT

@HyukjinKwon
Copy link
Copy Markdown
Member

Merged to master.

@zhengruifeng
Copy link
Copy Markdown
Contributor

LATE LGTM

beliefer pushed a commit to beliefer/spark that referenced this pull request Dec 15, 2022
### What changes were proposed in this pull request?

This PR implements DataFrame.tail which is different from limit as tail fetches from the last of the dataset which implies tail respects ordering.

### Why are the changes needed?

API coverage.

### Does this PR introduce _any_ user-facing change?

NO

### How was this patch tested?

UT

Closes apache#38814 from amaliujia/tail.

Authored-by: Rui Wang <rui.wang@databricks.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
beliefer pushed a commit to beliefer/spark that referenced this pull request Dec 18, 2022
### What changes were proposed in this pull request?

This PR implements DataFrame.tail which is different from limit as tail fetches from the last of the dataset which implies tail respects ordering.

### Why are the changes needed?

API coverage.

### Does this PR introduce _any_ user-facing change?

NO

### How was this patch tested?

UT

Closes apache#38814 from amaliujia/tail.

Authored-by: Rui Wang <rui.wang@databricks.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants