Skip to content

Latest commit

 

History

History
82 lines (51 loc) · 2.66 KB

README.rst

File metadata and controls

82 lines (51 loc) · 2.66 KB

LibSPN

LibSPN is a library for learning and inference with Sum-Product Networks. LibSPN is integrated with TensorFlow.

What are SPNs?

Here we should add a few words about what SPNs are.

Why LibSPN?

Several reasons:

  • LibSPN is a general-purpose library with a generic interface and tools for generating SPN structure, making it easy to apply SPNs to any domain/problem
  • LibSPN offers a simple Python interface for building or generating networks, learning, and inference, facilitating prototyping (e.g. in Jupyter) and enabling simple integration of SPNs with other software
  • LibSPN is integrated with TensorFlow, making it possible to combine SPNs with other deep learning methods
  • LibSPN uses concepts that should sound familiar to TensorFlow users (e.g. tensors, variables, feeding, queues, batching, TensorBoard etc.)
  • LibSPN leverages the power of TensorFlow to efficiently perform parallel computations on (multiple) GPU devices
  • LibSPN is extendable, making it easy to add custom operations and graph nodes

Features of LibSPN

  • Simple interface for manual creation of custom network architectures
    • Automatic SPN validity checking and scope calculation
    • Adding explicit latent variables to sums/mixtures
    • Weight sharing
  • Integration with TensorFlow
    • SPN graph is converted to TensorFlow graph realizing specific algorithms/computations
    • Inputs to the network come from TensorFlow feeds or any TensorFlow tensors
  • Dynamic SPN graph data structure enabling easy modifications and learning of an existing SPN graph at run-time
  • SPN structure generation and learning
    • Dense random SPN generator
    • Simple naive Bayes mixture model generator
    • Learning algorithms are not yet implemented, but infrastructure for them exists
  • Loading and saving of structure and weights of learned models
  • Simple interface for random data generation, data loading and batching
    • Random data sampling from Gaussian Mixtures
    • Using TensorFlow queues for data loading, shuffling and batching
  • Built-in visualizations
    • SPN graph structure visualization
    • Data/distribution visualizations
  • SPN Inference
    • SPN/MPN value calculation
    • Gradient calculation
    • Inferring MPE state
  • SPN Learning
    • Expectation Maximization
    • Gradient Descent (bits still missing, but infrastructure exists)
  • Other
    • SPN-specific TensorFlow operations implemented using C++ and CUDA
    • Generating random sub-sets of all partitions of a set using repeated sampling or enumeration

Documentation

Installation instructions and complete documentation can be found at http://www.libspn.org