Skip to content
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
C++ Python R C Shell CMake Other
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.ci [ci] indicate support only for the last 3 macOS versions in wheel name ( Jan 16, 2020
.github Avoid the issue is labeled to bug by default. Nov 21, 2019
.nuget [docs] updated Microsoft GitHub URL (#2152) May 8, 2019
R-package [R-package] fixed sorting issues in lgb.cv() when using a model with … Jan 16, 2020
compute @ 36c8913 [ci] update CI stuff (#2079) Apr 9, 2019
docker specify the last supported version of scikit-learn (#2637) Dec 19, 2019
docs removed OpenMP ugly fix for Mojave (#2674) Jan 12, 2020
examples specify the last supported version of scikit-learn (#2637) Dec 19, 2019
helpers [ci] fixed whitespace cpplint issue in auto-config (#2488) Oct 2, 2019
include/LightGBM check _mm_prefetch in cmake (#2694) Jan 15, 2020
pmml [docs][python] made OS detection more reliable and little docs improv… Jun 3, 2018
python-package [ci] indicate support only for the last 3 macOS versions in wheel name ( Jan 16, 2020
src check _mm_prefetch in cmake (#2694) Jan 15, 2020
swig [Java] MMLSPARK-ISSUE-720 - Create SWIG version of BoosterDumpModel t… Nov 13, 2019
tests [python] fix trees_to_dataframe and enhance test (#2690) Jan 14, 2020
windows code refactoring: cost effective gradient boosting (#2407) Sep 26, 2019
.appveyor.yml specify the last supported version of scikit-learn (#2637) Dec 19, 2019
.editorconfig added editorconfig (#2403) Sep 16, 2019
.gitignore [R-package] Added instructions for generating R test coverage (#2664) Jan 12, 2020
.gitmodules Initial GPU acceleration support for LightGBM (#368) Apr 9, 2017
.readthedocs.yml [docs][R] added R-package docs generation routines (#2176) Sep 1, 2019
.travis.yml [ci] bump XCode version for Travis (#2646) Dec 24, 2019
.vsts-ci.yml specify the last supported version of scikit-learn (#2637) Dec 19, 2019
CMakeLists.txt check _mm_prefetch in cmake (#2694) Jan 15, 2020
CODE_OF_CONDUCT.md Create CODE_OF_CONDUCT.md (#803) Aug 18, 2017
LICENSE added editorconfig (#2403) Sep 16, 2019
README.md [docs] added link to cuML in external repos section of README (#2634) Dec 17, 2019
VERSION.txt bump version for development (#2599) Nov 29, 2019
build_r.R [R-package][ci] added CI stage for R package (fixes #2335, fixes #2569)… Dec 15, 2019
build_r_site.R [R-package][ci] Added more R linters (fixes #2477) (#2533) Nov 16, 2019

README.md

LightGBM, Light Gradient Boosting Machine

Azure Pipelines Build Status Appveyor Build Status Travis Build Status Documentation Status License Python Versions PyPI Version Join Gitter at https://gitter.im/Microsoft/LightGBM Slack

LightGBM is a gradient boosting framework that uses tree based learning algorithms. It is designed to be distributed and efficient with the following advantages:

  • Faster training speed and higher efficiency.
  • Lower memory usage.
  • Better accuracy.
  • Support of parallel and GPU learning.
  • Capable of handling large-scale data.

For further details, please refer to Features.

Benefitting from these advantages, LightGBM is being widely-used in many winning solutions of machine learning competitions.

Comparison experiments on public datasets show that LightGBM can outperform existing boosting frameworks on both efficiency and accuracy, with significantly lower memory consumption. What's more, parallel experiments show that LightGBM can achieve a linear speed-up by using multiple machines for training in specific settings.

Get Started and Documentation

Our primary documentation is at https://lightgbm.readthedocs.io/ and is generated from this repository. If you are new to LightGBM, follow the installation instructions on that site.

Next you may want to read:

Documentation for contributors:

News

Please refer to changelogs at GitHub releases page.

Some old update logs are available at Key Events page.

External (Unofficial) Repositories

Julia-package: https://github.com/Allardvm/LightGBM.jl

JPMML (Java PMML converter): https://github.com/jpmml/jpmml-lightgbm

Treelite (model compiler for efficient deployment): https://github.com/dmlc/treelite

cuML Forest Inference Library (GPU-accelerated inference): https://github.com/rapidsai/cuml

m2cgen (model appliers for various languages): https://github.com/BayesWitnesses/m2cgen

leaves (Go model applier): https://github.com/dmitryikh/leaves

ONNXMLTools (ONNX converter): https://github.com/onnx/onnxmltools

SHAP (model output explainer): https://github.com/slundberg/shap

MMLSpark (LightGBM on Spark): https://github.com/Azure/mmlspark

Kubeflow Fairing (LightGBM on Kubernetes): https://github.com/kubeflow/fairing

ML.NET (.NET/C#-package): https://github.com/dotnet/machinelearning

LightGBM.NET (.NET/C#-package): https://github.com/rca22/LightGBM.Net

Dask-LightGBM (distributed and parallel Python-package): https://github.com/dask/dask-lightgbm

Ruby gem: https://github.com/ankane/lightgbm

Support

How to Contribute

LightGBM has been developed and used by many active community members. Your help is very valuable to make it better for everyone.

  • Contribute to the tests to make it more reliable.
  • Contribute to the documentation to make it clearer for everyone.
  • Contribute to the examples to share your experience with other users.
  • Look for issues with tag "help wanted" and submit pull requests to address them.
  • Add your stories and experience to Awesome LightGBM. If LightGBM helped you in a machine learning competition or some research application, we want to hear about it!
  • Open an issue to report problems or recommend new features.

Microsoft Open Source Code of Conduct

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Reference Papers

Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, Tie-Yan Liu. "LightGBM: A Highly Efficient Gradient Boosting Decision Tree". Advances in Neural Information Processing Systems 30 (NIPS 2017), pp. 3149-3157.

Qi Meng, Guolin Ke, Taifeng Wang, Wei Chen, Qiwei Ye, Zhi-Ming Ma, Tie-Yan Liu. "A Communication-Efficient Parallel Algorithm for Decision Tree". Advances in Neural Information Processing Systems 29 (NIPS 2016), pp. 1279-1287.

Huan Zhang, Si Si and Cho-Jui Hsieh. "GPU Acceleration for Large-scale Tree Boosting". SysML Conference, 2018.

Note: If you use LightGBM in your GitHub projects, please add lightgbm in the requirements.txt.

License

This project is licensed under the terms of the MIT license. See LICENSE for additional details.

You can’t perform that action at this time.