Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expand the list of supported Hadoop versions #14

Closed
apennebaker opened this issue Aug 27, 2013 · 3 comments
Closed

Expand the list of supported Hadoop versions #14

apennebaker opened this issue Aug 27, 2013 · 3 comments

Comments

@apennebaker
Copy link

Could we adjust the build to be more flexible with respect to Hadoop versions? I'm not sure how users are expected to get Hadoop setup for the book:

  • On Mac, Homebrew installs Hadoop v1.2.1.
  • In Ubuntu, the online tutorials tend to specify Hadoop v1.0.3.
  • In Windows, tutorials tend to use v1.0.0.

None of these match the book code's demand of Hadoop v1.1.1.

/not_sure_if_book_code_is_general_enough_to_work_with_different_minor_versions

https://maven.apache.org/enforcer/enforcer-rules/versionRanges.html

tomwhite added a commit that referenced this issue Jan 9, 2014
@tomwhite
Copy link
Owner

tomwhite commented Jan 9, 2014

I just pushed a change to fix this. E.g.

mvn package -Dhadoop.version=1.2.1
or
mvn package -Dhadoop.version=1.0.3

Sorry it took me so long - I didn't see the github issues until today.

@apennebaker
Copy link
Author

@tomwhite No worries! Thanks for addressing this. :)

@tomwhite
Copy link
Owner

I made another modification so you can specify both the distro and the precise version (or neither). See 9ffc052

I also ran the unit and integration tests against a bunch of different versions as follows:

HADOOP_HOME=/dev/hadoop-1.2.1 mvn clean verify -Dhadoop.version=1.2.1
HADOOP_HOME=
/dev/hadoop-0.23.10 mvn clean verify -Dhadoop.distro=apache-23 -Dhadoop.version=0.23.10
HADOOP_HOME=/dev/hadoop-2.2.0 mvn clean verify -Dhadoop.distro=apache-2 -Dhadoop.version=2.2.0
HADOOP_HOME=
/dev/hadoop-0.20.2-cdh3u5 mvn clean verify -Dhadoop.distro=cdh3 -Dhadoop.version=0.20.2-cdh3u5
HADOOP_HOME=~/dev/hadoop-2.0.0-cdh4.5.0 mvn clean verify -Dhadoop.distro=cdh4 -Dhadoop.version=2.0.0-cdh4.5.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants