README.md

Lava-dl-netx

lava.lib.dl.netx automates deep learning network model exchange to/from LAVA from/to other frameworks. At the moment, we support a simple platform independent hdf5 network description protocol. In furture we will extend network exchange support to other neural network exchange formats.

Loading a model to Lava is as simple as:

from lava.lib.dl.netx import hdf5
# Import the model as a Lava Process
net = hdf5.Network(net_config='network.net')

The hdf5 network description protocol is described below:

HDF5 description protocol

• The computational graph is represented layer-wise in the layer field of the hdf5 file.
• The layer id is assigned serially from 0 to n-1 starting from input to output.
  • By default, a sequential connection is assumed.
  • Skip/recurrent connections are preceded by a concatenate layer that connects to pervious layer plus a list of non-sequential layers identified by their id.
  • Each layer entry consts a minimum of shape and type field. Other relevant fileds can be addes as necessary.
    • shape entry is a tuple/list in (x, y, z) format.
    • type entry is a string that describes the layer type. See below for a list of supported types.
    • neuron field describes the compartment model and it's parameter.
      • default neuron type is CUBA-LIF.

|
|->layer # description of network layer blocks such as input, dense, conv, pool, flatten, average
|   |->0
|   |  |->{shape, type, ...} # each layer description has at least shape and type attribute
|   |->1
|   |  |->{shape, type, ...}
|   :
|   |->n-1
|      |->{shape, type, ...}
| 
| # other fields (not used for network exchange)
|->simulation # simulation description
|   |->Ts # sampling time. Usually 1
|   |->tSample # length of the sample to run

Supported layer types

input  : {shape, type}
flatten: {shape, type}
average: {shape, type}
concat : {shape, type, layers}
dense  : {shape, type, neuron, inFeatures, outFeatures, weight, delay(if available)}
pool   : {shape, type, neuron, kernelSize, stride, padding, dilation, weight}
conv   : {shape, type, neuron, inChannels, outChannels, kernelSize, stride,
                        |      padding, dilation, groups, weight, delay(if available)}
                        |
                        |-> this is the description of the compartment parameters
                        |-> {iDecay, vDecay, vThMant, refDelay, ... (other additional params)}

Tutorials

NetX inference tutorials

• Oxford Inference
• PilotNet LIF Inference
• PilotNet LIF Benchmarking
• PilotNet SDNN Inference
• PilotNet SDNN Benchmarking