The repository contains a set of artificial intelligence/ machine learning algorithms in Fortran.
| File | Description |
|---|---|
| linear_3.f90 | 3-neuron linear network employing the Adam gradient descent optimisation algorithm |
| linear_8_att.f90 | 8-neuron linear network employing the Adam gradient descent optimisation algorithm and element-wise dot-product attention |
| linear_8_mh_att.f90 | 8-neuron linear network employing the Adam gradient descent optimisation algorithm and multi-head attention |
| sompr_5.f90 | Second order multivariate polynomial regression employing the Adam gradient descent optimisation algorithm |
| gelu_att.f90 | GELU activation function, Adam gradient descent optimisation algorithm, element-wise dot-product attention |
| mish_att.f90 | Mish activation function, Adam gradient descent optimisation algorithm, element-wise dot-product attention |
| smish_att.f90 | Smish activation function, Adam gradient descent optimisation algorithm, element-wise dot-product attention |
| gms_att.f90 | GELU + Mish + Smish activation functions, Adam gradient descent optimisation algorithm, element-wise dot-product attention |