Repository navigation
BetaML v0.14.0
New GPU support and NN module refactoring
- vendor-independent (Cuda, Metal, ...) GPU support for neural networks, via a new
deviceoption (:auto,:cpu,:gpuor an MLDataDevices device) inNeuralNetworkEstimator,AutoEncoderand the MLJ models (NeuralNetworkRegressor,MultitargetNeuralNetworkRegressor,NeuralNetworkClassifier,AutoEncoder): with the default:auto, the network trains wherever the data is and predictions come back on the same device as the input. - efficiency improvement of all neural network models (cpu included) thanks to batch processing at the inner level (so each layer op is a matrix multiplication rather than a vector by matrix)
- added ForwardDiff for AD in the GPU in some cases
Breaking changes
ScalarFunctionLayerwith learnable weights: there is now one weight per node, or a single weight shared by all nodes, and the layer computesyᵢ = f(xᵢ,wᵢ). The user-provideddfx(x,w)anddfw(x,w)are now scalar functions; when omitted, they are computed with ForwardDiff.crossentropy: the defaultweightis now the scalar1. The function works on matrices and keeps the element type of ŷ.PerceptronClassifier_lpandPegasosClassifier_lp: the fieldweigthsis renamed toweights.
Issue solved:
- #68
GeneralImputer: fixed for single-record inputs.
Documentation and infrastructure
- Proofread docs and docstrings, aligned with the code.
- Updated the tutorials for the current Flux API.
- New static Benchmarks page, generated by
docs/benchmarks/run_benchmarks.jl. It includes CPU vs CUDA comparisons with Flux. - The default branch is now
main, and the CI actions are updated.
Closed issues: