Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-3699: [C++] Dockerfile for testing 32-bit C++ build #10865

Closed
wants to merge 7 commits into from

Conversation

kszucs
Copy link
Member

@kszucs kszucs commented Aug 4, 2021

I'm not sure whether this is going to work on a amd64 linux host, but it actually runs on docker for mac.

@pitrou could you please try

ARCH=i386 archery docker run -e ARROW_GANDIVA=OFF -e ARROW_S3=OFF debian-cpp

locally?

@github-actions
Copy link

github-actions bot commented Aug 4, 2021

@@ -73,7 +73,9 @@ RUN apt-get update -y -q && \

COPY ci/scripts/install_minio.sh \
/arrow/ci/scripts/
RUN /arrow/ci/scripts/install_minio.sh ${arch} linux latest /usr/local
RUN if [ "${arch}" != "i386" ]; then \
/arrow/ci/scripts/install_minio.sh ${arch} linux latest /usr/local; \
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can't find a binary for i386 here: https://dl.min.io/server/minio/release/

Possibly need to set ARROW_S3=OFF as well.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably because nobody cares :-)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Instead of putting the if here, put it in the download script?

@pitrou
Copy link
Member

pitrou commented Aug 4, 2021

ARCH=i386 archery docker run -e ARROW_GANDIVA=OFF -e ARROW_S3=OFF debian-cpp

There's a test failure, but apart from that it worked.

@kszucs
Copy link
Member Author

kszucs commented Aug 4, 2021

Thanks for checking it! Going to submit the crossbow task and if it works we can create follow-up tickets and start exercising i386 builds.

@kszucs
Copy link
Member Author

kszucs commented Aug 4, 2021

@github-actions crossbow submit test-debian-10-cpp-i386

@github-actions
Copy link

github-actions bot commented Aug 4, 2021

Revision: e8a466f

Submitted crossbow builds: ursacomputing/crossbow @ actions-712

Task Status
test-debian-10-cpp-i386 Github Actions

@kszucs
Copy link
Member Author

kszucs commented Aug 5, 2021

There is a failing test case, but the overall build configuration works.

@kou shall we configure i386 builds for other distributions as well?

@kou
Copy link
Member

kou commented Aug 5, 2021

I don't think that we need more i386 builds.
We can detect general i386 related build/test failures by the added Debian task.

@kszucs
Copy link
Member Author

kszucs commented Sep 20, 2021

@github-actions crossbow submit test-debian-10-cpp-i386

Copy link
Member Author

@kszucs kszucs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, merging on green

@github-actions
Copy link

Revision: 08c7b63

Submitted crossbow builds: ursacomputing/crossbow @ actions-847

Task Status
test-debian-10-cpp-i386 Github Actions

@kszucs
Copy link
Member Author

kszucs commented Nov 29, 2021

@github-actions crossbow submit test-debian-*

@github-actions
Copy link

Revision: 0e2dcd0

Submitted crossbow builds: ursacomputing/crossbow @ actions-1211

Task Status
test-debian-10-cpp-amd64 Github Actions
test-debian-10-cpp-i386 Github Actions
test-debian-11-cpp-amd64 Github Actions
test-debian-11-cpp-i386 Github Actions
test-debian-11-go-1.15 Azure
test-debian-11-python-3 Azure
test-debian-c-glib Github Actions
test-debian-ruby Github Actions

@kszucs
Copy link
Member Author

kszucs commented Nov 29, 2021

@github-actions crossbow submit test-debian-11-cpp-*

@github-actions
Copy link

Revision: 6037613

Submitted crossbow builds: ursacomputing/crossbow @ actions-1212

Task Status
test-debian-11-cpp-amd64 Github Actions
test-debian-11-cpp-i386 Github Actions

@kszucs
Copy link
Member Author

kszucs commented Nov 29, 2021

@github-actions crossbow submit test-debian-10-cpp-*

@github-actions
Copy link

Revision: 6037613

Submitted crossbow builds: ursacomputing/crossbow @ actions-1213

Task Status
test-debian-10-cpp-amd64 Github Actions
test-debian-10-cpp-i386 Github Actions

@kszucs kszucs requested a review from pitrou November 29, 2021 16:26
@@ -73,7 +73,9 @@ RUN apt-get update -y -q && \

COPY ci/scripts/install_minio.sh \
/arrow/ci/scripts/
RUN /arrow/ci/scripts/install_minio.sh ${arch} linux latest /usr/local
RUN if [ "${arch}" != "i386" ]; then \
/arrow/ci/scripts/install_minio.sh ${arch} linux latest /usr/local; \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Instead of putting the if here, put it in the download script?

@@ -3451,7 +3451,7 @@ TEST_F(TestInt64QuantileKernel, Int64) {
#undef DOUBLE
#undef O

#ifndef __MINGW32__
#if ARROW_BITNESS != 32
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Instead of skipping this on all 32-bit platforms, can you skip only on x86?

dev/tasks/tasks.yml Outdated Show resolved Hide resolved
@kszucs
Copy link
Member Author

kszucs commented Dec 1, 2021

@github-actions crossbow submit test-debian--cpp-

@github-actions
Copy link

github-actions bot commented Dec 1, 2021

Revision: 24583f0

Submitted crossbow builds: ursacomputing/crossbow @ actions-1230

Task Status
test-debian-10-cpp-amd64 Github Actions
test-debian-10-cpp-i386 Github Actions
test-debian-11-cpp-amd64 Github Actions
test-debian-11-cpp-i386 Github Actions

@kszucs
Copy link
Member Author

kszucs commented Dec 1, 2021

@github-actions crossbow submit test-debian-10-cpp-*

@github-actions
Copy link

github-actions bot commented Dec 1, 2021

Revision: 753e38a

Submitted crossbow builds: ursacomputing/crossbow @ actions-1231

Task Status
test-debian-10-cpp-amd64 Github Actions
test-debian-10-cpp-i386 Github Actions

@kszucs
Copy link
Member Author

kszucs commented Dec 1, 2021

@github-actions crossbow submit test-debian--cpp-

@github-actions
Copy link

github-actions bot commented Dec 1, 2021

Revision: 738828d

Submitted crossbow builds: ursacomputing/crossbow @ actions-1233

Task Status
test-debian-10-cpp-amd64 Github Actions
test-debian-10-cpp-i386 Github Actions
test-debian-11-cpp-amd64 Github Actions
test-debian-11-cpp-i386 Github Actions

@kszucs kszucs requested a review from kou December 2, 2021 00:11
Copy link
Member Author

@kszucs kszucs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@kszucs kszucs closed this in 0da15b6 Dec 2, 2021
@ursabot
Copy link

ursabot commented Dec 2, 2021

Benchmark runs are scheduled for baseline = be9a22b and contender = 0da15b6. 0da15b6 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️25.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Finished ⬇️0.0% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.44% ⬆️0.09%] ursa-thinkcentre-m75q
Supported benchmarks:
ursa-i9-9960x: langs = Python, R, JavaScript
ursa-thinkcentre-m75q: langs = C++, Java
ec2-t3-xlarge-us-east-2: cloud = True

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants