Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[C++] [R] brew + aws sdk version segault #20175

Closed
asfimport opened this issue Mar 29, 2022 · 3 comments
Closed

[C++] [R] brew + aws sdk version segault #20175

asfimport opened this issue Mar 29, 2022 · 3 comments

Comments

@asfimport
Copy link
Collaborator

asfimport commented Mar 29, 2022

homebrew-r-brew nightly test failing recently with a segfault in s3 tests: https://github.com/ursacomputing/crossbow/runs/5745568244?check_suite_focus=true#step:8:18521

Start test: write_parquet with filesystem arg

 *** caught segfault ***
address 0x0, cause 'memory not mapped'

Traceback:
 1: fs___FileSystem__CreateDir(self, clean_path_rel(path), isTRUE(recursive))
 2: fs$CreateDir(minio_path("hive_dir", "group=1", "other=xxx"))
 3: eval(code, test_env)
 4: eval(code, test_env)
 5: withCallingHandlers({    eval(code, test_env)    if (!handled && !is.null(test)) {        skip_empty()    }}, expectation = handle_expectation, skip = handle_skip, warning = handle_warning,     message = handle_message, error = handle_error)
 6: doTryCatch(return(expr), name, parentenv, handler)
 7: tryCatchOne(expr, names, parentenv, handlers[[1L]])
 8: tryCatchList(expr, names[-nh], parentenv, handlers[-nh])
 9: doTryCatch(return(expr), name, parentenv, handler)
10: tryCatchOne(tryCatchList(expr, names[-nh], parentenv, handlers[-nh]),     names[nh], parentenv, handlers[[nh]])
11: tryCatchList(expr, classes, parentenv, handlers)
12: tryCatch(withCallingHandlers({    eval(code, test_env)    if (!handled && !is.null(test)) {        skip_empty()    }}, expectation = handle_expectation, skip = handle_skip, warning = handle_warning,     message = handle_message, error = handle_error), error = handle_fatal,     skip = function(e) {    })
13: test_code(desc, code, env = parent.frame(), reporter = reporter)
14: testthat::test_that(what, {    skip_if(getOption("..skip.tests", TRUE), "arrow C++ library not available")    code})
15: test_that("write_parquet with filesystem arg", {    skip_if_not_available("parquet")    fs$CreateDir(minio_path("hive_dir", "group=1", "other=xxx"))    fs$CreateDir(minio_path("hive_dir", "group=2", "other=yyy"))    expect_length(fs$ls(minio_path("hive_dir")), 2)    write_parquet(df1, fs$path(minio_path("hive_dir", "group=1",         "other=xxx", "file1.parquet")))    write_parquet(df2, fs$path(minio_path("hive_dir", "group=2",         "other=yyy", "file2.parquet")))    expect_identical(read_parquet(fs$path(minio_path("hive_dir",         "group=1", "other=xxx", "file1.parquet"))), df1)})
16: eval(code, test_env)
17: eval(code, test_env)

Suspiciously the version of https://github.com/Homebrew/homebrew-core/blob/HEAD/Formula/aws-sdk-cpp.rb was bumped around the same time (and is a version quite a bit ahead of our pinned old version, though in practice this is usually fine).

Reporter: Jonathan Keane / @jonkeane

Related issues:

PRs and other links:

Note: This issue was originally created as ARROW-16070. Please see the migration documentation for further details.

@asfimport
Copy link
Collaborator Author

David Li / @lidavidm:
Possibly the same as ARROW-16043?

@asfimport
Copy link
Collaborator Author

Jonathan Keane / @jonkeane:
It's possible they are the same, yeah. Now that I've looked it does look like our C++ test does use brew for installing these dependencies as well (thought it's a slightly different way of doing it that I missed the first time I scanned the output!)

@asfimport
Copy link
Collaborator Author

Kouhei Sutou / @kou:
ARROW-16043 also fixes this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant