Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-14839: [R] test-fedora-r-clang-sanitizer job failing due to snappy causing a sanitizer error #11875

Closed
wants to merge 8 commits into from

Conversation

jonkeane
Copy link
Member

@jonkeane jonkeane commented Dec 6, 2021

This would replace (temporarily) #11796 in a way that might be ship-able as is until Snappy accepts google/snappy#148 and is released.

@jonkeane jonkeane changed the title ARROW-14839 [R] test-fedora-r-clang-sanitizer job failing due to snappy causing a sanitizer error ARROW-14839: [R] test-fedora-r-clang-sanitizer job failing due to snappy causing a sanitizer error Dec 6, 2021
@jonkeane
Copy link
Member Author

jonkeane commented Dec 6, 2021

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions
Copy link

github-actions bot commented Dec 6, 2021

1 similar comment
@github-actions
Copy link

github-actions bot commented Dec 6, 2021

@github-actions
Copy link

github-actions bot commented Dec 6, 2021

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@github-actions
Copy link

github-actions bot commented Dec 6, 2021

Revision: 4c426a5

Submitted crossbow builds: ursacomputing/crossbow @ actions-1251

Task Status
test-fedora-r-clang-sanitizer Azure

@jonkeane
Copy link
Member Author

jonkeane commented Dec 7, 2021

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions
Copy link

github-actions bot commented Dec 7, 2021

Revision: b141103

Submitted crossbow builds: ursacomputing/crossbow @ actions-1259

Task Status
test-fedora-r-clang-sanitizer Azure

@jonkeane
Copy link
Member Author

jonkeane commented Dec 7, 2021

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@jonkeane
Copy link
Member Author

jonkeane commented Dec 7, 2021

@github-actions autotune

@github-actions
Copy link

github-actions bot commented Dec 7, 2021

Revision: e1599d3

Submitted crossbow builds: ursacomputing/crossbow @ actions-1260

Task Status
test-fedora-r-clang-sanitizer Azure

@jonkeane
Copy link
Member Author

jonkeane commented Dec 7, 2021

@github-actions crossbow submit test-fedora-r-clang-sanitizer

@github-actions
Copy link

github-actions bot commented Dec 7, 2021

Revision: a9e77fd

Submitted crossbow builds: ursacomputing/crossbow @ actions-1266

Task Status
test-fedora-r-clang-sanitizer Azure

apt-get update
apt-get install -y patch
fi
fi
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not strictly necessary (see below where we disable snappy if we can't find patch), but it makes sure that we do have patch available so we do exercise this code in the sanitizer in our CI

if(patch)
set(SNAPPY_PATCH_COMMAND "patch" "snappy.cc"
"${CMAKE_SOURCE_DIR}/build-support/snappy-UBSAN.patch")
endif()
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Snappy works without the patch, though it has a UBSAN error, so this patches if we can and moves on if not so we don't break.

@@ -81,6 +81,7 @@ ARROW_RAPIDJSON_BUILD_VERSION=1a803826f1197b5e30703afe4b9c0e7dd48074f5
ARROW_RAPIDJSON_BUILD_SHA256_CHECKSUM=0b6b780b6c534bfb0b23d29910bfe361e486bcfeaf106db8bc8995792072905a
ARROW_RE2_BUILD_VERSION=2021-02-02
ARROW_RE2_BUILD_SHA256_CHECKSUM=1396ab50c06c1a8885fb68bf49a5ecfd989163015fd96699a180d6414937f33f
# 1.1.9 is patched to implement https://github.com/google/snappy/pull/148 if this is bumped, remove the patch
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've tried to flag this, and if we pursue this path, I'll make a Jira that points to each of these lines that need to be deleted when > 1.1.9 is released

# patch available, so disable snappy in those cases. If the snappy version is bumped, we should remove this.
if [ ! $(command -v patch) ]; then
ARROW_WITH_SNAPPY=OFF
fi
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For our CI this should not be hit, but is important incase CRAN happens to not have patch, it will disable snappy so we don't get a sanitizer error there.

@jonkeane
Copy link
Member Author

jonkeane commented Dec 8, 2021

@github-actions crossbow submit -g r

@github-actions
Copy link

github-actions bot commented Dec 8, 2021

Revision: a9e77fd

Submitted crossbow builds: ursacomputing/crossbow @ actions-1269

Task Status
conda-linux-gcc-py36-cpu-r40 Azure
conda-linux-gcc-py37-cpu-r41 Azure
conda-osx-clang-py36-r40 Azure
conda-osx-clang-py37-r41 Azure
conda-win-vs2017-py36-r40 Azure
conda-win-vs2017-py37-r41 Azure
homebrew-r-autobrew Github Actions
test-fedora-r-clang-sanitizer Azure
test-r-arrow-backwards-compatibility Github Actions
test-r-depsource-auto Azure
test-r-depsource-system Github Actions
test-r-devdocs Github Actions
test-r-gcc-11 Github Actions
test-r-install-local Github Actions
test-r-linux-as-cran Github Actions
test-r-linux-rchk Github Actions
test-r-linux-valgrind Azure
test-r-minimal-build Azure
test-r-offline-maximal Github Actions
test-r-offline-minimal Azure
test-r-rhub-debian-gcc-devel-lto-latest Azure
test-r-rhub-ubuntu-gcc-release-latest Azure
test-r-rocker-r-base-latest Azure
test-r-rstudio-r-base-4.1-centos7-devtoolset-8 Azure
test-r-rstudio-r-base-4.1-centos8 Azure
test-r-rstudio-r-base-4.1-focal Azure
test-r-rstudio-r-base-4.1-opensuse15 Azure
test-r-rstudio-r-base-4.1-opensuse42 Azure
test-r-ubuntu-21.04 Github Actions
test-r-versions Github Actions
test-ubuntu-18.04-r-sanitizer Azure

@jonkeane
Copy link
Member Author

jonkeane commented Dec 8, 2021

The conda failures are known / on master. The test-r-depsource-system failure looks transient (and at the very least unrelated!)

@jonkeane jonkeane closed this in c2a89e6 Dec 8, 2021
@ursabot
Copy link

ursabot commented Dec 8, 2021

Benchmark runs are scheduled for baseline = cba23c4 and contender = c2a89e6. c2a89e6 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.0% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.09% ⬆️0.09%] ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python. Runs only benchmarks with cloud = True
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants