New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rethinkdb 2.3.6 #81

Closed
gounthar opened this Issue Jul 9, 2018 · 19 comments

Comments

Projects
None yet
3 participants
@gounthar
Copy link
Contributor

gounthar commented Jul 9, 2018

Name, email, company, job title

Bruno Verachten, gounthar@gmail.com, Worldline by Atos, Analyst.

Project Title and description

I have tons of projects around ARM, but it's difficult to build them on *PI.
One of them is version 2.3.6 of rethinkDB https://github.com/gounthar/docker-rethinkdb .
The 2.3.5 version already exists, but I haven't managed to compile the 2.3.6 version yet.
I am also working on node, but can't compile it : nodejs/node#21190 .
I am also building ARM Docker images on DockerHub thanks to the resin.io work, but would like to build them on ARM Hardware.
My goal is to be able to run openSTF on ARM devices: openstf/stf#820
I already own OrangePi Zero, OnePlus, Raspberry Pi 3B, Nano Pi Fire3, Odroid XU4...
I already use a gitlab-runner image on one of my SBC.
I would also like to test a real ARM server as a gitlab-runner.

Which members of the community would benefit from your work?

Anyone interested in the openSTF project, or building and using Docker images on ARM machines.

Is the code that you’re going to run 100% open source? If so, what is the URL or URLs where it is located?

https://github.com/openstf/stf
https://github.com/rethinkdb/rethinkdb
https://github.com/nodejs/node
https://github.com/gounthar?tab=repositories

What infrastructure (computing resources and network access) do you need? (see: https://www.packet.net/bare-metal/)?

c1.large.arm

Let us know if you need short-term (one time) support, or if this is a request for
continuous ongoing support. If possible, please identify foundations or other
support organizations that can help with long-running projects.

Describe the continuous integration (CI) system in use or desired for this project.

gitlab-ci would be perfect...

Please state your contributions to the open source community and any other relevant initiatives

My goal is to promote the use of ARM devices in the company I work for and elsewhere. I am implicated in the continuous integration for mobile application development (gitlab-ci).
The repositories you can see in my github account are all linked to openSTF somehow. I need to be able to build Linux distros (I am trying to help Armbian) for my ARM devices, build Docker images and ARM applications too.
In my company, we are already using tons of X86 servers, and I want to experiment with ARMV8 servers too (but I have to prove first that ARM SBCs are a must-have in the company...).
I try to evangelize in my company by giving talks, and so on...

@vielmetti vielmetti added the ci/gitlab label Jul 11, 2018

@vielmetti

This comment has been minimized.

Copy link
Collaborator

vielmetti commented Jul 11, 2018

Hi @gounthar - if you can make it, please join us for Office Hours, details at #83 for the July 11 edition.

@gounthar

This comment has been minimized.

Copy link
Contributor Author

gounthar commented Jul 13, 2018

Sorry, I haven'( been able to join. I will listen to the recorded call.

@vielmetti

This comment has been minimized.

Copy link
Collaborator

vielmetti commented Jul 13, 2018

Thanks @gounthar - there's also info at

https://www.worksonarm.com/community/

on how to join various channels that are not so much real time (IRC, Slack, weekly newsletter &c).

@mmarmm

This comment has been minimized.

Copy link

mmarmm commented Jul 25, 2018

@gounthar Hi Bruno, there are public CI resources you can now use, I don't know if you're aware of them but see below for details.

As far as RethinkDB is concerned, could you help us resolve and issue to provide Docker Official Images?: rethinkdb/rethinkdb#6678

FYI - Shippable and CodeFresh have free support for one Arm64 (& 32-bit) pipelines if that helps, if not and you can help us resolve the RethinkDB issue above I can see what I can do to get you build system access. I also see your building node, is there any reason you're not using this: https://hub.docker.com/_/node/ ?

http://docs.shippable.com/platform/tutorial/workflow/run-ci-builds-on-arm/ (three free parallel builds)
https://thenewstack.io/shippable-brings-continuous-integration-and-delivery-to-arm-servers/

CodeFresh Beta signup: https://goo.gl/forms/aDhlk56jZcblYokj1

Scaleway does also offer paid Arm64 resources: https://www.scaleway.com/virtual-cloud-servers/#anchor_arm

Thank you again for supplying the Arm images and contributing to the ecosystem!

@gounthar

This comment has been minimized.

Copy link
Contributor Author

gounthar commented Jul 25, 2018

Thanks @mmarmm. I am already using Shippable for ARM, but there is one limitation : we can't build ARM Docker images with them (for now). I have sent an email asking for some help, but got no answer yet.
As for node, I am trying to update openSTF which depends on node. I could maybe import files from the node Docker image instead of rebuilding it by myself...

Thanks for the links!

@gounthar

This comment has been minimized.

Copy link
Contributor Author

gounthar commented Aug 1, 2018

It looks like shippable will allow Docker builds very soon.
Stay tuned...

@vielmetti

This comment has been minimized.

Copy link
Collaborator

vielmetti commented Aug 6, 2018

Thanks @gounthar - if you get an update for this it would be appreciated.

@gounthar

This comment has been minimized.

Copy link
Contributor Author

gounthar commented Aug 6, 2018

It was supposed to be available this week, but we're only on monday...
/root/5fbbd442-9a68-4cef-b279-b649ecf0b24f.sh: line 79: docker: command not found

@gounthar

This comment has been minimized.

Copy link
Contributor Author

gounthar commented Aug 8, 2018

I got an email today:

Docker support is now enabled for the shared Arm node pool. Please try it and let me know if it works as expected for you.

And...
` docker build .
Sending build context to Docker daemon 117.2kB

Step 1/12 : FROM arm32v7/debian:stretch as base
stretch: Pulling from arm32v7/debian
a92bc499a469: Pulling fs layer
a92bc499a469: Verifying Checksum
a92bc499a469: Download complete`

@gounthar

This comment has been minimized.

Copy link
Contributor Author

gounthar commented Aug 15, 2018

I'm working on the RethinkDB 2.3.x on Shippable's aarch64. https://github.com/rethinkdb/rethinkdb/issues/6699

@stale

This comment has been minimized.

Copy link

stale bot commented Sep 14, 2018

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the wontfix label Sep 14, 2018

@mmarmm

This comment has been minimized.

Copy link

mmarmm commented Sep 14, 2018

@gounthar Hi Bruno, any updates on progress getting rethink to build on arm64? Is Shippable working well for you? Thanks.

@stale stale bot removed the wontfix label Sep 14, 2018

@gounthar

This comment has been minimized.

Copy link
Contributor Author

gounthar commented Sep 15, 2018

For the time being, my build is always stuck at Shippable... and I don't have much logs to help.
I'm trying to find another aarch64 CI system to try.

/install.witness'.
                      Must remake target 'build/external/bluebird_2.9.32/install.witness'.
Putting child 0x2a1fe700 (build/external/bluebird_2.9.32/install.witness) PID 21327 on the chain.
Live child 0x2a1fe700 (build/external/bluebird_2.9.32/install.witness) PID 21327 
    [9/454] BUILD bluebird_2.9.32
Reaping winning child 0x2a1fe700 PID 21327 
Live child 0x2a1fe700 (build/external/bluebird_2.9.32/install.witness) PID 21652 
@stale

This comment has been minimized.

Copy link

stale bot commented Oct 15, 2018

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the wontfix label Oct 15, 2018

@gounthar

This comment has been minimized.

Copy link
Contributor Author

gounthar commented Oct 15, 2018

My issue at rethinkdb has disappeared, but it appears that the subject is still interesting for some: rethinkdb/rethinkdb#28

@stale stale bot removed the wontfix label Oct 15, 2018

@vielmetti

This comment has been minimized.

Copy link
Collaborator

vielmetti commented Oct 15, 2018

Thanks for the update, @gounthar - I'll keep this closed for now.

@gounthar

This comment has been minimized.

Copy link
Contributor Author

gounthar commented Oct 23, 2018

I tried to build the "next" branch today. I only got one error, and commented the existing issue: rethinkdb/rethinkdb#28

@gounthar

This comment has been minimized.

Copy link
Contributor Author

gounthar commented Oct 26, 2018

@stale

This comment has been minimized.

Copy link

stale bot commented Nov 25, 2018

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment