Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[R] [C++] lz4 sanitizer error #30239

Closed
asfimport opened this issue Nov 12, 2021 · 1 comment
Closed

[R] [C++] lz4 sanitizer error #30239

asfimport opened this issue Nov 12, 2021 · 1 comment

Comments

@asfimport
Copy link

Now that we enable lz4 by default, we are exposed to sanitizer errors. There is one on fedora-clang (bumped into on the test-fedora-r-clang-sanitizer nightly), during tests:

lz4frame.c:907:58: runtime error: applying non-zero offset 5242880 to null pointer
    #0 0x7f8b7f287807 in LZ4F_compressUpdate (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x9d01807)
    #1 0x7f8b7f282c1b in LZ4F_compressFrame_usingCDict (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x9cfcc1b)
    #2 0x7f8b7f28939b in LZ4F_compressFrame (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x9d0339b)
    #3 0x7f8b7bd25ecd in arrow::util::(anonymous namespace)::Lz4FrameCodec::Compress(long, unsigned char const*, long, unsigned char*) (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x679fecd)
    #4 0x7f8b7ebcadcc in arrow::ipc::(anonymous namespace)::RecordBatchSerializer::CompressBodyBuffers()::'lambda'(unsigned long)::operator()(unsigned long) const (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x9644dcc)
    #5 0x7f8b7ebcbfa2 in decltype(std::__1::forward<arrow::detail::ContinueFuture&>(fp)(std::__1::forward<arrow::Future<arrow::internal::Empty>&>(fp0), std::__1::forward<arrow::ipc::(anonymous namespace)::RecordBatchSerializer::CompressBodyBuffers()::'lambda'(unsigned long)&>(fp0), std::__1::forward<int&>(fp0))) std::__1::__invoke<arrow::detail::ContinueFuture&, arrow::Future<arrow::internal::Empty>&, arrow::ipc::(anonymous namespace)::RecordBatchSerializer::CompressBodyBuffers()::'lambda'(unsigned long)&, int&>(arrow::detail::ContinueFuture&, arrow::Future<arrow::internal::Empty>&, arrow::ipc::(anonymous namespace)::RecordBatchSerializer::CompressBodyBuffers()::'lambda'(unsigned long)&, int&) (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x9645fa2)
    #6 0x7f8b7ebcbdb5 in arrow::internal::FnOnce<void ()>::FnImpl<std::__1::__bind<arrow::detail::ContinueFuture, arrow::Future<arrow::internal::Empty>&, arrow::ipc::(anonymous namespace)::RecordBatchSerializer::CompressBodyBuffers()::'lambda'(unsigned long)&, int&> >::invoke() (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x9645db5)
    #7 0x7f8b7bc2cd37 in arrow::internal::FnOnce<void ()>::operator()() && (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x66a6d37)
    #8 0x7f8b7bc2b665 in arrow::internal::WorkerLoop(std::__1::shared_ptr<arrow::internal::ThreadPool::State>, std::__1::__list_iterator<std::__1::thread, void*>) (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x66a5665)
    #9 0x7f8b7bc2b06b in decltype(std::__1::forward<arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_3>(fp)()) std::__1::__invoke<arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_3>(arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_3&&) (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x66a506b)
    #10 0x7f8b7bc2a92c in void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_3> >(void*) (/opt/R-devel/lib64/R/library/arrow/libs/arrow.so+0x66a492c)
    #11 0x7f8b8c9b83f8 in start_thread (/lib64/libpthread.so.0+0x93f8)
    #12 0x7f8b8c7fb4c2 in clone (/lib64/libc.so.6+0x1014c2)

SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior lz4frame.c:907:58 in 

https://dev.azure.com/ursacomputing/crossbow/_build/results?buildId=15256&view=logs&j=0da5d1d9-276d-5173-c4c4-9d4d4ed14fdb&t=d9b15392-e4ce-5e4c-0c8c-b69645229181&l=11776

Reporter: Jonathan Keane / @jonkeane
Assignee: Antoine Pitrou / @pitrou

PRs and other links:

Note: This issue was originally created as ARROW-14699. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Antoine Pitrou / @pitrou:
Issue resolved by pull request 11713
#11713

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants