Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Docs][Release] Update documentation on verification of release candidates #30008

Closed
asfimport opened this issue Oct 22, 2021 · 4 comments
Closed

Comments

@asfimport
Copy link

Documentation on verifying release candidates is dated:
https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates

  • Update Ubuntu version to at least 16 if not 18
  • Ensure LLVM is installed, for example following https://apt.llvm.org/
  • Consider using OpenJDK rather than Oracle JDK.
  • Add information for GO
  • Add information for Rust
  • Add information for R

Reporter: Benson Muite / @bkmgit
Assignee: Benson Muite / @bkmgit

PRs and other links:

Note: This issue was originally created as ARROW-14446. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Benson Muite / @bkmgit:
Example setup on Ubuntu 20.04

    apt-get update
    apt-get install -y cmake 
    apt-get install -y wget curl libboost-all-dev jq
    apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
    apt-get update -y -qq
    apt-get install -y build-essential
    apt-get install -y openjdk-8-jdk
    wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
    apt-get install -y unzip
    unzip apache-maven-3.8.3-bin.zip 
    mkdir -p $HOME/java
    mv apache-maven-3.8.3 $HOME/java
   export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
   curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.0/install.sh | bash
   source $HOME/.bashrc
   nvm install 14
   apt-get update
   apt-get install -y curl g++ gcc autoconf automake bison libc6-dev         libffi-dev libgdbm-dev libncurses5-dev libsqlite3-dev libtool         libyaml-dev make pkg-config sqlite3 zlib1g-dev libgmp-dev         libreadline-dev libssl-dev
   wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
   tar -xvf ruby-3.0.2.tar.gz 
   cd ruby-3.0.2/
   CC=gcc ./configure --prefix=$HOME/ruby
   CC=gcc make -j4
   make install
   cd ..
   export PATH=$HOME/ruby/bin:$PATH
   wget https://apt.llvm.org/llvm.sh
   chmod +x llvm.sh 
   ./llvm.sh 10
   apt-get install -y clang-format clang-tidy clang-tools clang clangd libc++-dev libc++1 libc++abi-dev libc++abi1 libclang-dev libclang1 liblldb-dev libllvm-ocaml-dev libomp-dev libomp5 lld lldb llvm-dev llvm-runtime llvm python-clang 
   apt-get install -y ninja-build
   apt-get install -y python3-pip
   wget https://golang.org/dl/go1.17.2.linux-amd64.tar.gz
   tar -C /usr/local -xf go1.17.2.linux-amd64.tar.gz
   export PATH=$PATH:/usr/local/go/bin
   curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /usr/share/keyrings/docker-archive-keyring.gpg
   echo   "deb [arch=$(dpkg --print-architecture) signed-by=/usr/share/keyrings/docker-archive-keyring.gpg] https://download.docker.com/linux/ubuntu \
  $(lsb_release -cs) stable" | sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
   apt-get update
   apt-get install -y docker-ce docker-ce-cli containerd.io
   curl -L "https://github.com/docker/compose/releases/download/1.29.2/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
   chmod +x /usr/local/bin/docker-compose
   apt-get install -y python3-pip
   git clone https://github.com/apache/arrow
   cd arrow/
   pip3 install -e dev/archery[all]
   bash dev/release/verify-release-candidate.sh source 6.0.0 3

@asfimport
Copy link
Author

Benson Muite / @bkmgit:
Example setup for Ubuntu 18.04

apt-get update
    apt-get install -y cmake 
    apt-get install -y wget curl libboost-all-dev jq
    apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
    apt-get update -y -qq
    apt-get install -y build-essential
    apt-get install -y openjdk-8-jdk
    wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
    apt-get install -y unzip
    unzip apache-maven-3.8.3-bin.zip 
    mkdir -p $HOME/java
    mv apache-maven-3.8.3 $HOME/java
   export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
   curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.0/install.sh | bash
   source $HOME/.bashrc
   nvm install 14
   apt-get update
   apt-get install -y curl g++ gcc autoconf automake bison libc6-dev         libffi-dev libgdbm-dev libncurses5-dev libsqlite3-dev libtool         libyaml-dev make pkg-config sqlite3 zlib1g-dev libgmp-dev         libreadline-dev libssl-dev
   wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
   tar -xvf ruby-3.0.2.tar.gz 
   cd ruby-3.0.2/
   CC=gcc ./configure --prefix=$HOME/ruby
   CC=gcc make -j4
   make install
   cd ..
   export PATH=$HOME/ruby/bin:$PATH
   wget https://apt.llvm.org/llvm.sh
   chmod +x llvm.sh 
   ./llvm.sh 10
   apt-get install -y clang-format clang-tidy clang-tools clang clangd libc++-dev libc++1 libc++abi-dev libc++abi1 libclang-dev libclang1 liblldb-dev libllvm-ocaml-dev libomp-dev libomp5 lld lldb llvm-dev llvm-runtime llvm python-clang 
   apt-get install -y ninja-build
   apt-get install -y python3-pip
   wget https://golang.org/dl/go1.17.2.linux-amd64.tar.gz
   tar -C /usr/local -xf go1.17.2.linux-amd64.tar.gz
   export PATH=$PATH:/usr/local/go/bin
   curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /usr/share/keyrings/docker-archive-keyring.gpg
   echo   "deb [arch=$(dpkg --print-architecture) signed-by=/usr/share/keyrings/docker-archive-keyring.gpg] https://download.docker.com/linux/ubuntu \
  $(lsb_release -cs) stable" | sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
   apt-get update
   apt-get install -y docker-ce docker-ce-cli containerd.io
   curl -L "https://github.com/docker/compose/releases/download/1.29.2/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
   chmod +x /usr/local/bin/docker-compose
   apt-get install -y libglib2.0-dev
   apt-get install -y python3-pip
   pip3 install --upgrade pip
   wget https://github.com/libgit2/libgit2/archive/refs/tags/v1.3.0.tar.gz
   tar -xf v1.3.0.tar.gz 
   cd libgit2-1.3.0/
   mkdir build
   cd build
   cmake ..
   make
   make install
   cd ..
   git clone https://github.com/apache/arrow
   cd arrow/
   pip3 install -e dev/archery[all]
   bash dev/release/verify-release-candidate.sh source 6.0.0 3

@asfimport
Copy link
Author

Benson Muite / @bkmgit:
CentOS 8 / Alma Linux 8 / Rocky Linux 8

dnf update
dnf -y install dnf-plugins-core
dnf upgrade
dnf config-manager --set-enabled powertools
dnf update
dnf -y install https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
dnf -y install ninja-build libcurl-devel python3-pip cmake git libffi-devel ncurses-devel
dnf -y groupinstall "Development Tools"
dnf -y module enable llvm-toolset
dnf -y module install llvm-toolset
dnf -y install openssl-devel maven java-1.8.0-openjdk-devel llvm-devel gobject-introspection-devel
dnf install -y yum-utils readline-devel gdbm-devel
yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo
dnf -y install docker-ce docker-ce-cli containerd.io
systemctl start docker
systemctl enable docker
wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
tar -xvf ruby-3.0.2.tar.gz 
cd ruby-3.0.2/
./configure
make -j4
make install
cd ..
git clone https://github.com/apache/arrow
cd arrow/
pip3 install -e dev/archery
bash dev/release/verify-release-candidate.sh source 6.0.0 3

@asfimport
Copy link
Author

Kouhei Sutou / @kou:
Issue resolved by pull request 11562
#11562

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant