New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dockcross with circle.yml test #9

Merged
merged 7 commits into from Jun 1, 2016

Conversation

Projects
None yet
3 participants
@brainstorm
Member

brainstorm commented May 26, 2016

  • Faster base-compilers Dockerfile (no need to compile CMake and Ninja-build).
  • Cicle.yml smoke test.
  • Summarized docs a bit.
@brainstorm

This comment has been minimized.

Show comment
Hide comment
@brainstorm

brainstorm May 27, 2016

Member

$ make linux-armv6 seems to be broken (on OSX at least):

(...)
100  176M  100  176M   tools-9c3d7b6ac692498dd36fec2872e0b55f910baac1/arm-bcm2708/gcc-linaro-arm-linux-gnueabihf-raspbian/share/locale/zh_TW/LC_MESSAGES/ld.mo
tools-9c3d7b6ac692498dd36fec2872e0b55f910baac1/configs/gcc-linaro-arm-linux-gnueabihf-raspbian
 0     0  6651k      0  0:00:27  0:00:27 --:--:-- 7608k
sending incremental file list
rsync: change_dir "/usr/src/tools-9c3d7b6ac692498dd36fec2872e0b55f910baac1/arm-bcm2708/gcc-linaro-arm-linux-gnueabihf-raspbian" failed: No such file or directory (2)

sent 20 bytes  received 12 bytes  64.00 bytes/sec
total size is 0  speedup is 0.00
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.1]
The command '/bin/sh -c curl -L https://github.com/raspberrypi/tools/archive/${RASPBERRYPI_TOOLS_COMMIT}.tar.gz | tar xvz --wildcards --no-anchored "*gcc-linaro-${CROSS_TRIPLE}-raspbian*" &&     rsync -av /usr/src/tools-${RASPBERRYPI_TOOLS_COMMIT}/arm-bcm2708/gcc-linaro-${CROSS_TRIPLE}-raspbian/ /usr/ &&     rm -rf /usr/src/tools-${RASPBERRYPI_TOOLS_COMMIT}' returned a non-zero code: 23
make: *** [linux-armv6] Error 1

Because OSX does not support the --wildcards option for tar on linux-armv6/Dockerfile:

RUN curl -L https://github.com/raspberrypi/tools/archive/master.tar.gz | tar xvz --wildcards --no-anchored "*gcc-linaro-${CROSS_TRIPLE}-raspbian*" && \
    rsync -av /usr/src/tools-master/arm-bcm2708/gcc-linaro-${CROSS_TRIPLE}-raspbian/ /usr/ && \
    rm -rf /usr/src/tools-master

Perhaps worth fixing it like they do in logstash's Makefile.

Member

brainstorm commented May 27, 2016

$ make linux-armv6 seems to be broken (on OSX at least):

(...)
100  176M  100  176M   tools-9c3d7b6ac692498dd36fec2872e0b55f910baac1/arm-bcm2708/gcc-linaro-arm-linux-gnueabihf-raspbian/share/locale/zh_TW/LC_MESSAGES/ld.mo
tools-9c3d7b6ac692498dd36fec2872e0b55f910baac1/configs/gcc-linaro-arm-linux-gnueabihf-raspbian
 0     0  6651k      0  0:00:27  0:00:27 --:--:-- 7608k
sending incremental file list
rsync: change_dir "/usr/src/tools-9c3d7b6ac692498dd36fec2872e0b55f910baac1/arm-bcm2708/gcc-linaro-arm-linux-gnueabihf-raspbian" failed: No such file or directory (2)

sent 20 bytes  received 12 bytes  64.00 bytes/sec
total size is 0  speedup is 0.00
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.1]
The command '/bin/sh -c curl -L https://github.com/raspberrypi/tools/archive/${RASPBERRYPI_TOOLS_COMMIT}.tar.gz | tar xvz --wildcards --no-anchored "*gcc-linaro-${CROSS_TRIPLE}-raspbian*" &&     rsync -av /usr/src/tools-${RASPBERRYPI_TOOLS_COMMIT}/arm-bcm2708/gcc-linaro-${CROSS_TRIPLE}-raspbian/ /usr/ &&     rm -rf /usr/src/tools-${RASPBERRYPI_TOOLS_COMMIT}' returned a non-zero code: 23
make: *** [linux-armv6] Error 1

Because OSX does not support the --wildcards option for tar on linux-armv6/Dockerfile:

RUN curl -L https://github.com/raspberrypi/tools/archive/master.tar.gz | tar xvz --wildcards --no-anchored "*gcc-linaro-${CROSS_TRIPLE}-raspbian*" && \
    rsync -av /usr/src/tools-master/arm-bcm2708/gcc-linaro-${CROSS_TRIPLE}-raspbian/ /usr/ && \
    rm -rf /usr/src/tools-master

Perhaps worth fixing it like they do in logstash's Makefile.

@thewtex

This comment has been minimized.

Show comment
Hide comment
@thewtex

thewtex May 27, 2016

Collaborator

CircleCI also has issues with the raspbian image.

Collaborator

thewtex commented May 27, 2016

CircleCI also has issues with the raspbian image.

@brainstorm

This comment has been minimized.

Show comment
Hide comment
@brainstorm

brainstorm May 30, 2016

Member

@thewtex Should I push the linux-armv5 to my docker hub or do you guys want to mantain it under "thewtex" family? Introducing that container into the CircleCI test/builds should be the last thing to add to this PR if all goes smoothly, IMO.

Member

brainstorm commented May 30, 2016

@thewtex Should I push the linux-armv5 to my docker hub or do you guys want to mantain it under "thewtex" family? Introducing that container into the CircleCI test/builds should be the last thing to add to this PR if all goes smoothly, IMO.

@thewtex

This comment has been minimized.

Show comment
Hide comment
@thewtex

thewtex May 30, 2016

Collaborator

@brainstorm a linux-armv5 image would be welcome.

We want to stay on a stable Debian image base instead of sid. There are other images that rely on the stable configuration that are broken in the build. Also, since sid is always moving, images may break at any time in the future.

Collaborator

thewtex commented May 30, 2016

@brainstorm a linux-armv5 image would be welcome.

We want to stay on a stable Debian image base instead of sid. There are other images that rely on the stable configuration that are broken in the build. Also, since sid is always moving, images may break at any time in the future.

@brainstorm

This comment has been minimized.

Show comment
Hide comment
@brainstorm

brainstorm May 31, 2016

Member

@thewtex, Reverted some changes and back to jessie... CircleCI keeps failing on debian repos, not much I can do about that. Is there anything else left on this PR?

Member

brainstorm commented May 31, 2016

@thewtex, Reverted some changes and back to jessie... CircleCI keeps failing on debian repos, not much I can do about that. Is there anything else left on this PR?

@thewtex

This comment has been minimized.

Show comment
Hide comment
@thewtex

thewtex May 31, 2016

Collaborator

@brainstorm Thanks for the updates.

I will try rebuilding until I get a clean build, then merge.

Collaborator

thewtex commented May 31, 2016

@brainstorm Thanks for the updates.

I will try rebuilding until I get a clean build, then merge.

@thewtex thewtex merged commit 140621f into dockcross:master Jun 1, 2016

1 check passed

ci/circleci Your tests passed on CircleCI!
Details

@brainstorm brainstorm deleted the brainstorm:dockcross branch Jun 1, 2016

@brainstorm

This comment has been minimized.

Show comment
Hide comment
@brainstorm

brainstorm Jun 2, 2016

Member

Thanks for merging this, @thewtex! To sum this issue up for good, could you please upload the new thewtex/cross-compiler-linux-armv5 docker container image/Dockerfile to DockerHub? I already have some usecase that requires it in radare/radare2#5060.

Thanks!!

Member

brainstorm commented Jun 2, 2016

Thanks for merging this, @thewtex! To sum this issue up for good, could you please upload the new thewtex/cross-compiler-linux-armv5 docker container image/Dockerfile to DockerHub? I already have some usecase that requires it in radare/radare2#5060.

Thanks!!

@thewtex

This comment has been minimized.

Show comment
Hide comment
@thewtex

thewtex Jun 3, 2016

Collaborator

@brainstorm My pleasure, thanks for working together on it!

Sure I can push it, but it is not building locally. I get the following error:

Step 3 : RUN dpkg --add-architecture armel &&     apt-get update &&     apt-get install -y crossbuild-essential-armel
 ---> Running in d53a2649cb27
Get:1 http://security.debian.org jessie/updates InRelease [63.1 kB]
Get:2 http://security.debian.org jessie/updates/main amd64 Packages [313 kB]
Ign http://httpredir.debian.org jessie InRelease
Get:3 http://httpredir.debian.org jessie-updates InRelease [142 kB]
Get:4 http://security.debian.org jessie/updates/main armel Packages [304 kB]
Hit http://httpredir.debian.org jessie Release.gpg
Hit http://httpredir.debian.org jessie Release
Get:5 http://httpredir.debian.org jessie-updates/main amd64 Packages [9283 B]
Get:6 http://httpredir.debian.org jessie-updates/main armel Packages [9965 B]
Get:7 http://httpredir.debian.org jessie/main amd64 Packages [9034 kB]
Get:8 http://httpredir.debian.org jessie/main armel Packages [8836 kB]
Fetched 18.7 MB in 11s (1663 kB/s)
Reading package lists...
W: Size of file /var/lib/apt/lists/security.debian.org_dists_jessie_updates_main_binary-amd64_Packages.gz is not what the server reported 312671 312711
Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package crossbuild-essential-armel

Collaborator

thewtex commented Jun 3, 2016

@brainstorm My pleasure, thanks for working together on it!

Sure I can push it, but it is not building locally. I get the following error:

Step 3 : RUN dpkg --add-architecture armel &&     apt-get update &&     apt-get install -y crossbuild-essential-armel
 ---> Running in d53a2649cb27
Get:1 http://security.debian.org jessie/updates InRelease [63.1 kB]
Get:2 http://security.debian.org jessie/updates/main amd64 Packages [313 kB]
Ign http://httpredir.debian.org jessie InRelease
Get:3 http://httpredir.debian.org jessie-updates InRelease [142 kB]
Get:4 http://security.debian.org jessie/updates/main armel Packages [304 kB]
Hit http://httpredir.debian.org jessie Release.gpg
Hit http://httpredir.debian.org jessie Release
Get:5 http://httpredir.debian.org jessie-updates/main amd64 Packages [9283 B]
Get:6 http://httpredir.debian.org jessie-updates/main armel Packages [9965 B]
Get:7 http://httpredir.debian.org jessie/main amd64 Packages [9034 kB]
Get:8 http://httpredir.debian.org jessie/main armel Packages [8836 kB]
Fetched 18.7 MB in 11s (1663 kB/s)
Reading package lists...
W: Size of file /var/lib/apt/lists/security.debian.org_dists_jessie_updates_main_binary-amd64_Packages.gz is not what the server reported 312671 312711
Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package crossbuild-essential-armel

@brainstorm

This comment has been minimized.

Show comment
Hide comment
@brainstorm

brainstorm Jun 3, 2016

Member

Ouch, forgot to revert that one to jessie (works like a charm on sid)... I'll fix it ASAP.

Member

brainstorm commented Jun 3, 2016

Ouch, forgot to revert that one to jessie (works like a charm on sid)... I'll fix it ASAP.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment