Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-17788: [R][Doc] Add example of using Scanner #14184

Merged
merged 4 commits into from
Oct 13, 2022

Conversation

wjones127
Copy link
Member

No description provided.

@github-actions
Copy link

@github-actions
Copy link

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@wjones127 wjones127 changed the title ARROW-17349: [R][Doc] Add example of using Scanner ARROW-17788: [R][Doc] Add example of using Scanner Sep 20, 2022
@github-actions
Copy link

Copy link
Member

@thisisnic thisisnic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding these examples! Just one small change to suggest here.

#' dir.create(tf)
#' on.exit(unlink(tf))
#'
#' data <- dplyr::group_by(mtcars, cyl)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Given we don't have dplyr as a dependency, could it be worth removing the group_by() call here, and manually specifying the partitioning argument to write_dataset() instead?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point. I've replace the call I added as well as the one in the other example I copied from.

Copy link
Member

@thisisnic thisisnic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Excellent, thanks!

@pitrou
Copy link
Member

pitrou commented Sep 27, 2022

Lots of CI failures here, should this be rebased?

@@ -131,8 +131,7 @@
#' dir.create(tf)
#' on.exit(unlink(tf))
#'
#' data <- dplyr::group_by(mtcars, cyl)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The complete removal of data here breaks the example further down write_dataset(data, tf2, format = "ipc") - please can you update that too?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for pointing that out. I've updated that example and tested locally on my computer to make sure it works now.

@thisisnic
Copy link
Member

Lots of CI failures here, should this be rebased?

My bad, missed an error caused by a change as reviewed before the CI had finished running - doesn't need rebasing. Added feedback now.

@nealrichardson nealrichardson merged commit 959a9d5 into apache:master Oct 13, 2022
@ursabot
Copy link

ursabot commented Oct 14, 2022

Benchmark runs are scheduled for baseline = 66e8ba5 and contender = 959a9d5. 959a9d5 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.0% ⬆️0.0%] test-mac-arm
[Failed ⬇️0.0% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.43% ⬆️0.0%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] 959a9d5d ec2-t3-xlarge-us-east-2
[Failed] 959a9d5d test-mac-arm
[Failed] 959a9d5d ursa-i9-9960x
[Finished] 959a9d5d ursa-thinkcentre-m75q
[Finished] 66e8ba5a ec2-t3-xlarge-us-east-2
[Failed] 66e8ba5a test-mac-arm
[Failed] 66e8ba5a ursa-i9-9960x
[Finished] 66e8ba5a ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants