Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[docs] updated HDFS guide #1890

Merged
merged 19 commits into from Apr 11, 2019
Merged

[docs] updated HDFS guide #1890

merged 19 commits into from Apr 11, 2019

Conversation

StrikerRUS
Copy link
Collaborator

Refer to #1555 (comment).

@@ -569,6 +569,8 @@ On Linux HDFS version of LightGBM can be built using **CMake** and **gcc** or **
git clone --recursive https://github.com/Microsoft/LightGBM ; cd LightGBM
mkdir build ; cd build
cmake -DUSE_HDFS=ON ..
# if you have installed HDFS to a customized location, you should specify paths to HDFS headers (hdfs.h) and library (libhdfs.so) like the following:
# cmake -DUSE_HDFS=ON -DHDFS_LIB_DIR=/usr/lib/hadoop-hdfs/lib -DHDFS_INCLUDE_DIR=/usr/lib/hadoop-hdfs/include/ ..
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe ask users to provide HDFS_LIB directly instead of HDFS_LIB_DIR?
https://github.com/Microsoft/LightGBM/blob/f55e37d02670374085d523357f0032ac544b6ed2/CMakeLists.txt#L109

@@ -553,7 +553,7 @@ Refer to `GPU Docker folder <https://github.com/Microsoft/LightGBM/tree/master/d
Build HDFS Version
~~~~~~~~~~~~~~~~~~

**Note**: Installation process of HDFS version is untested.
HDFS version of LightGBM was tested on CDH cluster.
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ebernhardson Can you please provide more details (i.e., version) to help users setup environment in which LightGBM will work fine?

@StrikerRUS
Copy link
Collaborator Author

@ebernhardson Please review.

@StrikerRUS
Copy link
Collaborator Author

gently ping @ebernhardson

@StrikerRUS
Copy link
Collaborator Author

StrikerRUS commented Mar 22, 2019

Updated based on the comments from #2046.

Not sure whether it's needed to put the path into quotes in general example as it was stated in #2046 (comment).

I suppose that after merging this, #1555 can be closed. WDYT?

@StrikerRUS
Copy link
Collaborator Author

ping @guolinke @chivee for the review

@StrikerRUS
Copy link
Collaborator Author

StrikerRUS commented Apr 11, 2019

@guolinke Can we close this issue #1555 after merging?
Seems that no one can contribute more about HDFS...

@guolinke
Copy link
Collaborator

Sure

@StrikerRUS
Copy link
Collaborator Author

Closed #1555.

@StrikerRUS StrikerRUS merged commit c56412a into master Apr 11, 2019
@StrikerRUS StrikerRUS deleted the hdfs branch April 11, 2019 21:20
@lock lock bot locked as resolved and limited conversation to collaborators Mar 11, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants