v1.4.0-rc2
Pre-release
Pre-release
# What's new?
- (Added) Documentation is finally here!
# What's changed?
- (Changes) Several small fixes & improvements
- Fixes incorrectness to
dump&loadState to optimizer & trainer. - Corrected
Softmaxbackward pass to use the efficient Jacobian-vector product. - Added strict assertion to shapes for
Mathoperations. SoftmaxandActivationsnow reuse internal buffers to reduce memory allocation during training loops.- Fused Kernels:
NN.Linearnow combines matrix multiplication and bias addition into a single parallel block, reducing thread synchronization overhead significantly.
- Fixes incorrectness to