Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

HADOOP-16929. Added support for AArch32 for Dev Environment #1903

Open
wants to merge 4 commits into
base: trunk
Choose a base branch
from
+18 −7
Open

HADOOP-16929. Added support for AArch32 for Dev Environment #1903

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
72c75ee
added support for aarch32
MaxiBoether Mar 20, 2020
f8f0a44
Merge branch 'trunk' of https://github.com/apache/hadoop into trunk
MaxiBoether Mar 20, 2020
7deaa36
Fixed setup files for ARM
MaxiBoether Mar 20, 2020
a151fa2
unneccsary space
MaxiBoether Mar 20, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
21 changes: 16 additions & 5 deletions dev-support/docker/Dockerfile_aarch64 → dev-support/docker/Dockerfile_arm
View file
Open in desktop
Expand Up @@ -26,6 +26,7 @@ SHELL ["/bin/bash", "-o", "pipefail", "-c"]
#####
# Disable suggests/recommends
#####

RUN echo APT::Install-Recommends "0"\; > /etc/apt/apt.conf.d/10disableextras
RUN echo APT::Install-Suggests "0"\; >> /etc/apt/apt.conf.d/10disableextras

Expand Down Expand Up @@ -56,6 +57,8 @@ RUN apt-get -q update \
libbz2-dev \
libcurl4-openssl-dev \
libfuse-dev \
libfontconfig1 \
libfreetype6 \
libprotobuf-dev \
libprotoc-dev \
libsasl2-dev \
Expand Down Expand Up @@ -108,7 +111,7 @@ RUN mkdir -p /opt/cmake/src \
&& cd cmake-3.1.0 && patch -p0 -i ../cmake-3.1.0-1.patch && mkdir .build && cd .build \
&& ../bootstrap --parallel=2 \
&& make -j2 && ./bin/cpack \
&& tar xzf cmake-3.1.0-Linux-aarch64.tar.gz --strip-components 1 -C /opt/cmake \
&& tar xzf "cmake-3.1.0-Linux-$(uname -m).tar.gz" --strip-components 1 -C /opt/cmake \
&& cd /opt/cmake && rm -rf /opt/cmake/src
ENV CMAKE_HOME /opt/cmake
ENV PATH "${PATH}:/opt/cmake/bin"
Expand Down Expand Up @@ -201,15 +204,21 @@ RUN curl -s -S https://dl.yarnpkg.com/debian/pubkey.gpg | apt-key add - \
&& rm -rf /var/lib/apt/lists/*

###
# Install phantomjs built for aarch64
# Install phantomjs
####
RUN mkdir -p /opt/phantomjs \

RUN if [ "$(echo "$MACHTYPE" | cut -d- -f1)" = "aarch64" ]; \
then mkdir -p /opt/phantomjs \
&& curl -L -s -S \
https://github.com/liusheng/phantomjs/releases/download/2.1.1/phantomjs-2.1.1-linux-aarch64.tar.bz2 \
-o /opt/phantomjs/phantomjs-2.1.1-linux-aarch64.tar.bz2 \
&& tar xvjf /opt/phantomjs/phantomjs-2.1.1-linux-aarch64.tar.bz2 --strip-components 1 -C /opt/phantomjs \
&& cp /opt/phantomjs/bin/phantomjs /usr/bin/ \
&& rm -rf /opt/phantomjs
&& rm -rf /opt/phantomjs; else \
mkdir -p /opt/phantomjs \
&& curl -L -s -S https://github.com/fg2it/phantomjs-on-raspberry/releases/download/v2.1.1-wheezy-jessie-armv6/phantomjs -o /opt/phantomjs/phantomjs \
&& cp /opt/phantomjs/phantomjs /usr/bin/ \
&& rm -rf /opt/phantomjs; fi

###
# Avoid out of memory errors in builds
Expand All @@ -223,7 +232,9 @@ ENV MAVEN_OPTS -Xms256m -Xmx1536m
###

# Hugo static website generator (for new hadoop site docs)
RUN curl -L -o hugo.deb https://github.com/gohugoio/hugo/releases/download/v0.58.3/hugo_0.58.3_Linux-ARM64.deb \
RUN if [ "$(echo "$MACHTYPE" | cut -d- -f1)" = "aarch64" ]; \
then curl -L -o hugo.deb https://github.com/gohugoio/hugo/releases/download/v0.58.3/hugo_0.58.3_Linux-ARM64.deb; else \
curl -L -o hugo.deb https://github.com/gohugoio/hugo/releases/download/v0.58.3/hugo_0.58.3_Linux-ARM.deb; fi \
&& dpkg --install hugo.deb \
&& rm hugo.deb

Expand Down
4 changes: 2 additions & 2 deletions start-build-env.sh
View file
Open in desktop
Expand Up @@ -23,8 +23,8 @@ DOCKER_DIR=dev-support/docker
DOCKER_FILE="${DOCKER_DIR}/Dockerfile"

CPU_ARCH=$(echo "$MACHTYPE" | cut -d- -f1)
if [ "$CPU_ARCH" = "aarch64" ]; then
DOCKER_FILE="${DOCKER_DIR}/Dockerfile_aarch64"
if [ "$CPU_ARCH" = "aarch64" ] || [ "$CPU_ARCH" = "arm" ]; then
DOCKER_FILE="${DOCKER_DIR}/Dockerfile_arm"
fi

docker build -t hadoop-build -f $DOCKER_FILE $DOCKER_DIR
Expand Down