Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-3707: [C++] Fix test regression with zstd 1.3.7 #2909

Closed
wants to merge 2 commits into from

Conversation

pitrou
Copy link
Member

@pitrou pitrou commented Nov 6, 2018

Upstream issue: facebook/zstd#1385

@pitrou pitrou force-pushed the ARROW-3707-zstd-null-pointer branch from 18be5c1 to fb3931a Compare November 6, 2018 11:57
@pitrou
Copy link
Member Author

pitrou commented Nov 6, 2018

The Windows compilation failure is in the static CRT build. The only thing that changed is bumping the zstd version.

libzstd_static.lib(threading.obj) : error LNK2019: unresolved external symbol __imp__beginthreadex referenced in function ZSTD_pthread_create

@Maxris can you advise here?

@maxhora
Copy link
Contributor

maxhora commented Nov 6, 2018

@pitrou probably, there is some zstd patching related issue (like linkage to static crt was not configured properly). Need to check more deeply

@pitrou pitrou force-pushed the ARROW-3707-zstd-null-pointer branch from fed188b to df65857 Compare November 6, 2018 14:37
@pitrou
Copy link
Member Author

pitrou commented Nov 6, 2018

I think I'm gonna add the static CRT build as allowed failure. This will allow us to have passing CI for important configurations and let interested people fix the failing builds.

@pitrou
Copy link
Member Author

pitrou commented Nov 6, 2018

@kszucs, there's a failing RAT check here. Is it expected?

$ $TRAVIS_BUILD_DIR/ci/travis_release_audit.sh
NOT APPROVED: dev/tasks/docker-tests/travis.linux.yml (apache-arrow/dev/tasks/docker-tests/travis.linux.yml): false
1 unapproved licences. Check rat report: rat.txt

@pitrou pitrou force-pushed the ARROW-3707-zstd-null-pointer branch 5 times, most recently from 178e22c to f3b4656 Compare November 6, 2018 18:53
@pitrou
Copy link
Member Author

pitrou commented Nov 6, 2018

I think I unbroke the Windows builds now.
@Maxris If you are interested in zstd, it seems it's not possible to do a debug build using the cmake files anymore: facebook/zstd#1278

@kou
Copy link
Member

kou commented Nov 7, 2018

Now, Static_Crt_Build job is green. Can we remove it from allow_failures?

@xhochy
Copy link
Member

xhochy commented Nov 7, 2018

This also needs a rebase to remove the RAT failure.

@pitrou pitrou force-pushed the ARROW-3707-zstd-null-pointer branch from f3b4656 to 9fb0676 Compare November 7, 2018 10:22
@codecov-io
Copy link

Codecov Report

Merging #2909 into master will increase coverage by 12.97%.
The diff coverage is 65%.

Impacted file tree graph

@@             Coverage Diff             @@
##           master    #2909       +/-   ##
===========================================
+ Coverage   74.37%   87.35%   +12.97%     
===========================================
  Files          68      416      +348     
  Lines        5160    64943    +59783     
===========================================
+ Hits         3838    56734    +52896     
- Misses       1228     8115     +6887     
  Partials       94       94
Impacted Files Coverage Δ
cpp/src/arrow/util/compression_zstd.cc 91.75% <65%> (ø)
python/pyarrow/ipc.pxi 68.36% <0%> (ø)
cpp/src/parquet/column_page.h 89.28% <0%> (ø)
cpp/src/parquet/bloom_filter-test.cc 99.15% <0%> (ø)
cpp/src/plasma/client.cc 84.54% <0%> (ø)
cpp/src/arrow/io/test-common.h 97.29% <0%> (ø)
cpp/src/arrow/ipc/metadata-internal.h 100% <0%> (ø)
cpp/src/arrow/python/io.cc 94.91% <0%> (ø)
python/pyarrow/hdfs.py 36.84% <0%> (ø)
cpp/src/parquet/column_scanner.cc 60.86% <0%> (ø)
... and 339 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c303cc9...9fb0676. Read the comment docs.

@pitrou pitrou closed this in 394b334 Nov 7, 2018
@pitrou pitrou deleted the ARROW-3707-zstd-null-pointer branch November 7, 2018 12:08
romainfrancois pushed a commit to romainfrancois/arrow that referenced this pull request Nov 7, 2018
Upstream issue: facebook/zstd#1385

Author: Antoine Pitrou <antoine@python.org>

Closes apache#2909 from pitrou/ARROW-3707-zstd-null-pointer and squashes the following commits:

9fb0676 <Antoine Pitrou> Use cmake to build zstd
8a2488d <Antoine Pitrou> ARROW-3707:  Fix test regression with zstd 1.3.7
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants