Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Packaging] Installation of "libarrow-flight-dev" package fails on Debian/Ubuntu arm64 platform #33934

Closed
prmoore77 opened this issue Jan 30, 2023 · 5 comments · Fixed by #34717

Comments

@prmoore77
Copy link
Contributor

prmoore77 commented Jan 30, 2023

Describe the bug, including details regarding any error messages, version, and platform.

When attempting to install package: libarrow-flight-dev in a container running Docker image: ubuntu:latest on the linux/arm64 platform - it fails with error:

The following packages have unmet dependencies:
 libarrow-flight-dev : Depends: libarrow-dev (= 9.0.0-1) but 11.0.0-1 is to be installed
E: Unable to correct problems, you have held broken packages.

To reproduce the issue - I run these commands on my M1 (arm64) MacBook Pro from a terminal:

docker run -it --entrypoint /bin/bash --platform linux/arm64 ubuntu:latest

# Then in the container - run:
apt update && \
apt install -y -V ca-certificates sudo wget lsb-release && \
wget https://apache.jfrog.io/artifactory/arrow/$(lsb_release --id --short | tr 'A-Z' 'a-z')/apache-arrow-apt-source-latest-$(lsb_release --codename --short).deb && \
apt install -y -V ./apache-arrow-apt-source-latest-$(lsb_release --codename --short).deb && \
apt update && \
apt install -y -V libarrow-flight-dev

If I run with the linux/amd64 platform - however - the script above works just fine.

I hit this issue when attempting to build an arm64 Docker container (trying to follow instructions here: https://arrow.apache.org/install/)

Thank you!

Component(s)

Packaging

@kou kou changed the title Installation of "libarrow-flight-dev" package fails on Debian/Ubuntu arm64 platform [Packaging] Installation of "libarrow-flight-dev" package fails on Debian/Ubuntu arm64 platform Jan 31, 2023
@kou
Copy link
Member

kou commented Jan 31, 2023

libarrow-flight-dev isn't available for arm64 because we don't have enough CI resource (Travis CI) to build libarrow-flight-dev for arm64.

@kou kou closed this as not planned Won't fix, can't repro, duplicate, stale Jan 31, 2023
@raulcd
Copy link
Member

raulcd commented Jan 31, 2023

I missed the original PR where we removed that, posting for reference: #14300

@kou we have now self-hosted arm64 runners on crossbow using the same kubernetes solution as what @assignUser suggested to implement to have self-hosted arm64 runners on the main arrow repo to remove Travis. We could try and migrate those jobs to the self-hosted runners instead of Travis and re-enable libarrow-flight for arm64 in the future.
I already plan to work on the migration of the Travis jobs on the Arrow repo when I have some time.

@kou
Copy link
Member

kou commented Jan 31, 2023

Wow! OK. Let's do it!

@kou kou reopened this Jan 31, 2023
@kou
Copy link
Member

kou commented Feb 23, 2023

@raulcd @assignUser Do you know what runs-on should be used for self-hosted arm64 Ubuntu runners?

@raulcd
Copy link
Member

raulcd commented Feb 23, 2023

@raulcd @assignUser Do you know what runs-on should be used for self-hosted arm64 Ubuntu runners?

These are all the tags:
self-hosted, arm64, devops-managed, Linux, arm
I think we should use:
runs-on: ["self-hosted", "Linux", "arm64"]

kou added a commit to kou/arrow that referenced this issue Mar 24, 2023
kou added a commit to kou/arrow that referenced this issue Mar 27, 2023
kou added a commit to kou/arrow that referenced this issue Mar 28, 2023
kou added a commit to kou/arrow that referenced this issue Mar 28, 2023
@kou kou added this to the 12.0.0 milestone Mar 30, 2023
kou added a commit that referenced this issue Mar 30, 2023
### Rationale for this change

We can't enable Flight for arm64 packages because Travis CI doesn't have enough resource.

If we use self-hosted arm64 GitHub Runner, we can enable Flight.

### What changes are included in this PR?

These changes use self-hosted arm64 GitHub Runner and enable Flight.
 
### Are these changes tested?

Yes.

### Are there any user-facing changes?

Yes.
* Closes: #33934

Authored-by: Sutou Kouhei <kou@clear-code.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
ArgusLi pushed a commit to Bit-Quill/arrow that referenced this issue May 15, 2023
)

### Rationale for this change

We can't enable Flight for arm64 packages because Travis CI doesn't have enough resource.

If we use self-hosted arm64 GitHub Runner, we can enable Flight.

### What changes are included in this PR?

These changes use self-hosted arm64 GitHub Runner and enable Flight.
 
### Are these changes tested?

Yes.

### Are there any user-facing changes?

Yes.
* Closes: apache#33934

Authored-by: Sutou Kouhei <kou@clear-code.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants