RANGER-4309: Add prerequisites with minimal plugin versions for the regular build … #271
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
To start simplifying the work of people who want to build the project using the standard build process, we would like to propose an update of the README.md with the minimum versions necessary for the building of Apache ranger with the plugins and dependencies on them.
For the moment, 4 prerequisites are indicated:
(Please fill in changes proposed in this fix. Create an issue in ASF JIRA before opening a pull request and
set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. RANGER-XXXX: Fix a typo in YYY))
Hadoop 3.3.0+
The method CheckPermissionWithContext was not implemented before hadoop 3.3.0.
Here is the file in which this method is implemented since 3.3.0 and it's possible to see that it wasn't at the release 3.2.4 : https://github.com/apache/hadoop/blob/release-3.2.4-RC0/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeAttributeProvider.java
It is necessary to build the latest version, if we try to build with the hadoop.version flag pointing to 3.2.4 version we get the following error:
Hive 3.0.0+
At the beginning, we wanted to build Apache Ranger with hive.version=2.3.3.
The approach we have tried to fix this was to add the following to both
ranger-hive-plugin-shim/pom.xml
andhive-agent/pom.xml
for both hive-exec and hive-service artifacts inside :We got the following error (for example with hive.version=2.8.1):
We had the same errors for all versions < 3.0.0
How was this patch tested?
Tested on CentOS 7.9 with JDK-8 and JDK-11, Apache Maven 3.9.3
Tested by clement.lucas@cern.ch and emil.kleszcz@cern.ch.