Skip to content
pytorch implementation of "Distilling a Neural Network Into a Soft Decision Tree"
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.
img first commit Dec 7, 2017
LICENSE first commit Dec 7, 2017 first commit Dec 7, 2017 save result fixed Dec 23, 2018 update for pytorch 0.4.0 Dec 12, 2018


Soft-Decision-Tree is the pytorch implementation of Distilling a Neural Network Into a Soft Decision Tree, paper recently published on Arxiv about adopting decision tree algorithm into neural network. "If we could take the knowledge acquired by the neural net and express the same knowledge in a model that relies on hierarchical decisions instead, explaining a particular decision would be much easier."



I achieved 92.95% of test dataset accuracy on MNISTafter 40 epoches, without exploring enough of hyper-parameters (The paper achieved 94.45%). Higher accuracy might be achievable with searching hyper-parameters, or training longer epoches (if you can, please let me know :) )


$ python

You can’t perform that action at this time.