Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-10003: [C++] Create parent dir for any destination fs in CopyFiles #8187

Closed
wants to merge 10 commits into from

Conversation

bkietz
Copy link
Member

@bkietz bkietz commented Sep 14, 2020

Previously only the parent directories of files to be copied to a different filesystem were created.

@bkietz bkietz requested a review from pitrou September 14, 2020 18:11
@github-actions
Copy link

@bkietz bkietz force-pushed the 10003-Create-directories-in-Cop branch 3 times, most recently from 4d0703c to 4ad9abd Compare September 23, 2020 18:04
@bkietz
Copy link
Member Author

bkietz commented Sep 23, 2020

@pitrou CI failure seems unrelated, PTAL

Copy link
Member

@pitrou pitrou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one potential concern.

}

std::vector<std::string> dirs(destination_dirs.size());
std::move(destination_dirs.begin(), destination_dirs.end(), dirs.begin());
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting, I didn't know this std::move override!

cpp/src/arrow/filesystem/filesystem.cc Outdated Show resolved Hide resolved
@bkietz bkietz force-pushed the 10003-Create-directories-in-Cop branch from 1430d19 to 6a8bd29 Compare September 24, 2020 21:07
@bkietz
Copy link
Member Author

bkietz commented Sep 24, 2020

nealrichardson added a commit to nealrichardson/arrow that referenced this pull request Sep 25, 2020
nealrichardson added a commit that referenced this pull request Sep 25, 2020
Somehow #8187 had a passing build but it didn't regenerate the R docs, so R builds are failing on master because the doc signature doesn't match the code.

Closes #8277 from nealrichardson/fix-r

Authored-by: Neal Richardson <neal.p.richardson@gmail.com>
Signed-off-by: Neal Richardson <neal.p.richardson@gmail.com>
emkornfield pushed a commit to emkornfield/arrow that referenced this pull request Oct 16, 2020
Previously only the parent directories of files to be copied to a different filesystem were created.

Closes apache#8187 from bkietz/10003-Create-directories-in-Cop

Authored-by: Benjamin Kietzman <bengilgit@gmail.com>
Signed-off-by: Neal Richardson <neal.p.richardson@gmail.com>
emkornfield pushed a commit to emkornfield/arrow that referenced this pull request Oct 16, 2020
Somehow apache#8187 had a passing build but it didn't regenerate the R docs, so R builds are failing on master because the doc signature doesn't match the code.

Closes apache#8277 from nealrichardson/fix-r

Authored-by: Neal Richardson <neal.p.richardson@gmail.com>
Signed-off-by: Neal Richardson <neal.p.richardson@gmail.com>
@bkietz bkietz deleted the 10003-Create-directories-in-Cop branch February 25, 2021 16:41
GeorgeAp pushed a commit to sirensolutions/arrow that referenced this pull request Jun 7, 2021
Previously only the parent directories of files to be copied to a different filesystem were created.

Closes apache#8187 from bkietz/10003-Create-directories-in-Cop

Authored-by: Benjamin Kietzman <bengilgit@gmail.com>
Signed-off-by: Neal Richardson <neal.p.richardson@gmail.com>
GeorgeAp pushed a commit to sirensolutions/arrow that referenced this pull request Jun 7, 2021
Somehow apache#8187 had a passing build but it didn't regenerate the R docs, so R builds are failing on master because the doc signature doesn't match the code.

Closes apache#8277 from nealrichardson/fix-r

Authored-by: Neal Richardson <neal.p.richardson@gmail.com>
Signed-off-by: Neal Richardson <neal.p.richardson@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants