HDFS-16304. Locate OpenSSL libs for libhdfspp

[GauthamBanasandra]

Description of PR

The Docker build using start-build-env.sh is failing since commit 1032724. It can be reproduced with a minimal Ubuntu image and by running mvn clean install -Pnative -DskipTests -DskipShade -Dmaven.javadoc.skip=true inside the Docker container via start-build-env.sh.

How was this patch tested?

By building locally and validation through CI.

For code changes:

• Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
• Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
• If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
• If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

[hadoop-yetus]

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	35m 14s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 1s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	33m 21s		trunk passed
+1 💚	compile	2m 50s		trunk passed
+1 💚	mvnsite	0m 32s		trunk passed
+1 💚	shadedclient	55m 10s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 19s		the patch passed
+1 💚	compile	2m 46s		the patch passed
+1 💚	cc	2m 46s		the patch passed
+1 💚	golang	2m 46s		the patch passed
+1 💚	javac	2m 46s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	0m 17s		the patch passed
+1 💚	shadedclient	18m 1s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	31m 47s		hadoop-hdfs-native-client in the patch passed.
+1 💚	asflicense	0m 36s		The patch does not generate ASF License warnings.
		146m 24s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3625/1/artifact/out/Dockerfile
GITHUB PR	#3625
Optional Tests	dupname asflicense compile cc mvnsite javac unit codespell golang
uname	Linux 4586d777ec49 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / 611b01f
Default Java	Red Hat, Inc.-1.8.0_312-b07
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3625/1/testReport/
Max. process+thread count	542 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3625/1/console
versions	git=2.9.5 maven=3.6.3
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

[hadoop-yetus]

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	20m 21s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	21m 40s		trunk passed
+1 💚	compile	3m 14s		trunk passed
+1 💚	mvnsite	0m 55s		trunk passed
+1 💚	shadedclient	45m 2s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 25s		the patch passed
+1 💚	compile	2m 54s		the patch passed
+1 💚	cc	2m 54s		the patch passed
+1 💚	golang	2m 54s		the patch passed
+1 💚	javac	2m 54s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	0m 27s		the patch passed
+1 💚	shadedclient	18m 43s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	32m 12s		hadoop-hdfs-native-client in the patch passed.
+1 💚	asflicense	0m 49s		The patch does not generate ASF License warnings.
		123m 8s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3625/1/artifact/out/Dockerfile
GITHUB PR	#3625
Optional Tests	dupname asflicense compile cc mvnsite javac unit codespell golang
uname	Linux 3bb0ffa9d0ca 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / 611b01f
Default Java	Red Hat, Inc.-1.8.0_312-b07
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3625/1/testReport/
Max. process+thread count	549 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3625/1/console
versions	git=2.27.0 maven=3.6.3
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

[hadoop-yetus]

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	11m 12s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	25m 47s		trunk passed
-1 ❌	compile	0m 26s	/branch-compile-hadoop-hdfs-project_hadoop-hdfs-native-client.txt	hadoop-hdfs-native-client in trunk failed.
+1 💚	mvnsite	0m 25s		trunk passed
+1 💚	shadedclient	51m 58s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 16s		the patch passed
+1 💚	compile	2m 36s		the patch passed
-1 ❌	cc	2m 36s	/results-compile-cc-hadoop-hdfs-project_hadoop-hdfs-native-client.txt	hadoop-hdfs-project_hadoop-hdfs-native-client generated 11 new + 0 unchanged - 0 fixed = 11 total (was 0)
+1 💚	golang	2m 36s		the patch passed
+1 💚	javac	2m 36s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	0m 21s		the patch passed
+1 💚	shadedclient	25m 29s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	31m 36s		hadoop-hdfs-native-client in the patch passed.
+1 💚	asflicense	0m 35s		The patch does not generate ASF License warnings.
		126m 27s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3625/1/artifact/out/Dockerfile
GITHUB PR	#3625
Optional Tests	dupname asflicense compile cc mvnsite javac unit codespell golang
uname	Linux 3ebca42e44c5 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / 611b01f
Default Java	Debian-11.0.12+7-post-Debian-2deb10u1
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3625/1/testReport/
Max. process+thread count	719 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3625/1/console
versions	git=2.20.1 maven=3.6.0
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

[sjlee]

+1. Thanks for providing the fix, @GauthamBanasandra. @goiri, would you be able to help merge this PR?

[symious]

+1. The fix works fine.

[sodonnel]

Is the build currently breaking for all PRs without this change? We are getting native compile issues on #3579 too. Seems this fix may be related.

The last CI run is giving errors like below on the step hadoop-hdfs-native-client:

[WARNING] Cannot find a usable OpenSSL library. OPENSSL_LIBRARY=OPENSSL_LIBRARY-NOTFOUND, OPENSSL_INCLUDE_DIR=/usr/include, CUSTOM_OPENSSL_LIB=, CUSTOM_OPENSSL_PREFIX=, CUSTOM_OPENSSL_INCLUDE=
[WARNING] CMake Error at CMakeLists.txt:146 (message):
[WARNING]   Terminating build because require.openssl was specified.

[GauthamBanasandra]

Is the build currently breaking for all PRs without this change?

@sodonnel yes, please see the JIRA of this PR for more details.

We are getting native compile issues on #3579 too. Seems this fix may be related.

Yes, this PR fixes it.