v0.9.0

AbstractNeuralNetworks v0.9.0

Diff since v0.8.0

Methods that GeometricMachineLearning (GML) defined on this package's types move here, so GML no longer pirates them. The full notes are in the 0.9.0 section of CHANGELOG.md.

Breaking Changes

• A GML that still defines the 3-tensor methods on Dense and Linear fails to precompile against this release ("Method overwriting is not permitted during Module precompilation"). GML deletes them in the same change that raises its AbstractNeuralNetworks bound.
• The backend keyword of load(NeuralNetwork, …) is removed. The network loads on the CPU; changebackend(backend, nn) moves it to a device.

New Features

• Dense, Linear and Affine accept inputs of rank 3 or more, through reshape and one matrix product, on any array type.
• A weak extension HDF5Ext provides save and load for NeuralNetwork.

Bug Fixes

• A top-level Zygote.pullback(applychain, layers, x, ps) gives the storage gradient of each leaf and keeps the leaf's type; a parameter cotangent of nothing no longer raises a MethodError.
• parameterlength(::Dense) reads the bias flag as a Bool.

Dependencies

• Requires NeuralNetworkParameters 0.4.2 (and so GeometricBase 0.15) and Julia 1.11.

Merged pull requests:

• Take in Dense/Linear/Affine 3-tensor and NeuralNetwork HDF5 methods from GML (#40) (@michakraus)
• Require NeuralNetworkParameters 0.4 (#41) (@michakraus)
• Give the storage gradient from applychain's pullback (#42) (@michakraus)
• Move the test suite to the common layout (#44) (@michakraus)
• Update DocumenterCitations requirement to 1.5.0 in /docs (#46) (@dependabot[bot])
• Update Documenter requirement to 1.19.0 in /docs (#47) (@dependabot[bot])
• Update SafeTestsets requirement to 0.1.0 in /test (#49) (@dependabot[bot])
• Update Documenter requirement to 1.19.0 in /test (#50) (@dependabot[bot])
• Read the Dense bias flag as a Bool (#51) (@michakraus)
• Remove the shared compat entries from test/Project.toml (#52) (@michakraus)
• Raise the NeuralNetworkParameters floor to 0.4.2 (#53) (@michakraus)