Allow two-way connection (needed for Caffe)

[TimZaman]

Technically I guess that makes that part of the graph cyclical, but the graph probably couldn't care less.
In a Caffe networks this looks like:

(...)
layer {
  name: "relu1"
  type: "ReLU"
  bottom: "ip1"
  top: "ip1"
}
(...)

[TimZaman]

And then after I need to find some way to clean this mess up.

Caution, the above network can kick in singularity.