Skip to content
pytorch implementation of "Distilling a Neural Network Into a Soft Decision Tree"
Python
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
img first commit Dec 7, 2017
LICENSE first commit Dec 7, 2017
README.md first commit Dec 7, 2017
main.py save result fixed Dec 23, 2018
model.py update for pytorch 0.4.0 Dec 12, 2018

README.md

Soft-Decision-Tree

Soft-Decision-Tree is the pytorch implementation of Distilling a Neural Network Into a Soft Decision Tree, paper recently published on Arxiv about adopting decision tree algorithm into neural network. "If we could take the knowledge acquired by the neural net and express the same knowledge in a model that relies on hierarchical decisions instead, explaining a particular decision would be much easier."

Requirements

Result

I achieved 92.95% of test dataset accuracy on MNISTafter 40 epoches, without exploring enough of hyper-parameters (The paper achieved 94.45%). Higher accuracy might be achievable with searching hyper-parameters, or training longer epoches (if you can, please let me know :) )

Usage

$ python main.py

You can’t perform that action at this time.