Skip to content

BIGTOP-3563. Building Hadoop for CentOS 8 fails due to cmake error.#792

Merged
sekikn merged 1 commit into
apache:masterfrom
iwasakims:BIGTOP-3563
Jun 28, 2021
Merged

BIGTOP-3563. Building Hadoop for CentOS 8 fails due to cmake error.#792
sekikn merged 1 commit into
apache:masterfrom
iwasakims:BIGTOP-3563

Conversation

@iwasakims
Copy link
Copy Markdown
Member

@iwasakims iwasakims commented Jun 28, 2021

https://issues.apache.org/jira/browse/BIGTOP-3563

The latest cmake does not work without latest libarchive.

$ rpm -q cmake
cmake-3.18.2-9.el8.x86_64

$ cmake --version
cmake: symbol lookup error: cmake: undefined symbol: archive_write_add_filter_zstd

Updating libarhcive fixed the issue.

$ rpm -q libarchive
libarchive-3.3.2-8.el8_1.x86_64

$ sudo dnf update -y libarchive

$ rpm -q libarchive
libarchive-3.3.3-1.el8.x86_64

$ cmake --version
cmake version 3.18.2

CMake suite maintained and supported by Kitware (kitware.com/cmake).

@iwasakims
Copy link
Copy Markdown
Member Author

I manually tested that old libarchive is updated by ./gradlew toolchain on CentOS 8 x86_64.

$ sudo yum install https://vault.centos.org/8.3.2011/BaseOS/x86_64/os/Packages/libarchive-3.3.2-9.el8.x86_64.rpm

$ rpm -q libarchive
libarchive-3.3.2-9.el8.x86_64

$ cmake --version
cmake: symbol lookup error: cmake: undefined symbol: archive_write_add_filter_zstd

$ ./gradlew toolchain

$ rpm -q libarchive
libarchive-3.3.3-1.el8.x86_64

$ cmake --version
cmake version 3.18.2

CMake suite maintained and supported by Kitware (kitware.com/cmake).

@sekikn
Copy link
Copy Markdown
Contributor

sekikn commented Jun 28, 2021

+1, also tested on aarch64 (AWS Graviton2). Thanks @iwasakims!

$ curl -sL https://github.com/apache/bigtop/pull/792.patch | git apply 
$ cd docker/bigtop-slaves
$ ./build.sh trunk-centos-8

...

Notice: /Stage[main]/Bigtop_toolchain::Packages/Package[libarchive]/ensure: ensure changed '3.3.2-9.el8' to '0:3.3.3-1.el8'

...

$ cd -
$ docker run -v $PWD:/bigtop -it bigtop/slaves:trunk-centos-8-aarch64 bash
[root@983968f99d02 /]# cd bigtop
[root@983968f99d02 bigtop]# ./gradlew hadoop-pkg

...

> Task :hadoop-pkg

BUILD SUCCESSFUL in 54m 10s
6 actionable tasks: 6 executed

@sekikn sekikn merged commit 262739e into apache:master Jun 28, 2021
@iwasakims
Copy link
Copy Markdown
Member Author

Thanks, @sekikn.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants