The biologically inspired activation function. Read our (toilet) paper.
Install with pip:
pip install sigmoidcolon
Class version
from torch import nn
from sigmoidcolon import SigmoidColon
model = nn.Sequential(
nn.Linear(784, 64),
SigmoidColon(),
nn.Linear(64, 10),
)
Functional version
from torch import nn
from sigmoidcolon.functional import sigmoidcolon
x = torch.randn(100)
y = sigmoidcolon(x)
Not satisfied with the function? Redo it with:
# install dev requirements
pip install Pillow numpy matplotlib
# run code generation tool
python scripts/codegen.py docs/sigmoidcolon.png