Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-14839 [R] test-fedora-r-clang-sanitizer job failing due to snappy causing a sanitizer error #11796

Closed
wants to merge 5 commits into from

Conversation

jonkeane
Copy link
Member

No description provided.

@jonkeane
Copy link
Member Author

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions
Copy link

@github-actions
Copy link

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@github-actions
Copy link

Revision: b938a2a

Submitted crossbow builds: ursacomputing/crossbow @ actions-1215

Task Status
test-fedora-r-clang-sanitizer Azure

@jonkeane
Copy link
Member Author

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions
Copy link

Revision: e40ea9e

Submitted crossbow builds: ursacomputing/crossbow @ actions-1216

Task Status
test-fedora-r-clang-sanitizer Azure

@@ -123,7 +123,7 @@ DEPENDENCIES=(
"ARROW_PROTOBUF_URL protobuf-${ARROW_PROTOBUF_BUILD_VERSION}.tar.gz https://github.com/google/protobuf/releases/download/${ARROW_PROTOBUF_BUILD_VERSION}/protobuf-all-${ARROW_PROTOBUF_BUILD_VERSION:1}.tar.gz"
"ARROW_RAPIDJSON_URL rapidjson-${ARROW_RAPIDJSON_BUILD_VERSION}.tar.gz https://github.com/miloyip/rapidjson/archive/${ARROW_RAPIDJSON_BUILD_VERSION}.tar.gz"
"ARROW_RE2_URL re2-${ARROW_RE2_BUILD_VERSION}.tar.gz https://github.com/google/re2/archive/${ARROW_RE2_BUILD_VERSION}.tar.gz"
"ARROW_SNAPPY_URL snappy-${ARROW_SNAPPY_BUILD_VERSION}.tar.gz https://github.com/google/snappy/archive/${ARROW_SNAPPY_BUILD_VERSION}.tar.gz"
"ARROW_SNAPPY_URL snappy-${ARROW_SNAPPY_BUILD_VERSION}.tar.gz https://codeload.github.com/google/snappy/tar.gz/master"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you point to a specific commit? Won't this break (the checksum) as soon as another commit is added to master?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, if I can get this to work, that is what we'll need to do (or roll our own snappy "release" that we host)

@pitrou
Copy link
Member

pitrou commented Dec 1, 2021

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions
Copy link

github-actions bot commented Dec 1, 2021

Revision: bcc4fe5

Submitted crossbow builds: ursacomputing/crossbow @ actions-1223

Task Status
test-fedora-r-clang-sanitizer Azure

@pitrou
Copy link
Member

pitrou commented Dec 1, 2021

Opened PR google/snappy#148 for Snappy so that we can update to upstream git master when merged.

@jonkeane
Copy link
Member Author

jonkeane commented Dec 1, 2021

Thank you @pitrou ! I've undone some of the stuff I did in my testing, and now we've got passing builds. I'll run a full r group run to confirm this isn't doing something else funny on any of the more exotic architectures and then merge.

@jonkeane
Copy link
Member Author

jonkeane commented Dec 1, 2021

@github-actions crossbow submit -g r

@github-actions
Copy link

github-actions bot commented Dec 1, 2021

Revision: d8845e4

Submitted crossbow builds: ursacomputing/crossbow @ actions-1224

Task Status
conda-linux-gcc-py36-cpu-r40 Azure
conda-linux-gcc-py37-cpu-r41 Azure
conda-osx-clang-py36-r40 Azure
conda-osx-clang-py37-r41 Azure
conda-win-vs2017-py36-r40 Azure
conda-win-vs2017-py37-r41 Azure
homebrew-r-autobrew Github Actions
test-fedora-r-clang-sanitizer Azure
test-r-arrow-backwards-compatibility Github Actions
test-r-depsource-auto Azure
test-r-depsource-system Github Actions
test-r-devdocs Github Actions
test-r-gcc-11 Github Actions
test-r-install-local Github Actions
test-r-linux-as-cran Github Actions
test-r-linux-rchk Github Actions
test-r-linux-valgrind Azure
test-r-minimal-build Azure
test-r-offline-maximal Github Actions
test-r-offline-minimal Azure
test-r-rhub-debian-gcc-devel-lto-latest Azure
test-r-rhub-ubuntu-gcc-release-latest Azure
test-r-rocker-r-base-latest Azure
test-r-rstudio-r-base-4.1-centos7-devtoolset-8 Azure
test-r-rstudio-r-base-4.1-centos8 Azure
test-r-rstudio-r-base-4.1-focal Azure
test-r-rstudio-r-base-4.1-opensuse15 Azure
test-r-rstudio-r-base-4.1-opensuse42 Azure
test-r-ubuntu-21.04 Github Actions
test-r-versions Github Actions
test-ubuntu-18.04-r-sanitizer Azure

@pitrou
Copy link
Member

pitrou commented Dec 1, 2021

Uh, we should wait for the Snappy change to be merged before updating this. I don't think we want to fetch Snappy from some random third-party fork.

@jonkeane
Copy link
Member Author

jonkeane commented Dec 1, 2021

Could we put it into the ursa-labs thirdparty repo where we've put some of these before? Looking through the PRs (open and closed) upstream I'm a bit worried it'll take a while for it to be merged.

@jonkeane
Copy link
Member Author

jonkeane commented Dec 1, 2021

The following failures in the group are all explained elsewhere:

homebrew-r-autobrew — failing on arrow@HEAD / in the nightlies, https://issues.apache.org/jira/browse/ARROW-14802
test-r-gcc-11 — resolved in #11795
test-r-linux-as-cran — resolved in #11795

And the conda-* builds are also failing arrow@HEAD, https://issues.apache.org/jira/browse/ARROW-14256

@jonkeane
Copy link
Member Author

jonkeane commented Dec 7, 2021

Ok, I've got an alternative that patches snappy 1.1.9 instead of using a special self-hosted version of snappy in #11875 I'm happy to do either that PR or this one (well, after we find a way to host our custom patched snappy source). But would like to merge one or the other so we have some clean clang sanitizer CI in the weeks leading up to the release burn down.

@pitrou
Copy link
Member

pitrou commented Dec 7, 2021

I'm ok with the patch solution.

jonkeane added a commit that referenced this pull request Dec 8, 2021
…ppy causing a sanitizer error

This would replace (temporarily) #11796 in a way that might be ship-able as is until Snappy accepts google/snappy#148 and is released.

Closes #11875 from jonkeane/ARROW-14839-two

Authored-by: Jonathan Keane <jkeane@gmail.com>
Signed-off-by: Jonathan Keane <jkeane@gmail.com>
@jonkeane jonkeane closed this Dec 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants