Releases: jysru/matlab_toy_optimizations
Releases · jysru/matlab_toy_optimizations
Release list
Added more Matlab examples from toolboxes and CMA-ES
Improved history handling, added noise simulation
Changelog:
- Added quality of life handling of the optimization history
- Added options for variables noise, and example code for cost function noise
- Added example for noisy simulation
Initial release
Initial release, functions/methods docstrings might not be 100% accurate
Implemented Gradient Descent methods:
- Gradient Descent
- Momentum
- Nesterov Accelerated Gradient
- Adam
- NAdam
- RAdam
- Adamax
- Adadelta
- Adagrad
- RMSProp
- ADMM
Implemented Gradient Evaluation methods using finite differences:
- Central finite differences
- Forward finite differences
- Backward finite differences
- Random signs finite differences
- Random signs central finite differences
- Parallel random signs finite differences
- Parallel random signs central finite differences