Adaptive Linesearch Algorithm (ALA)

ALA python code (see [1]). The implementation uses python+pytorch

3 versions of ALA have been tested:

• Nonmonotone-Monotone
• Monotone-Monotone
• Nonmonotone-Nonmonotone

Machine Learning applications

ALA has been tested on the following Machine Learning applications:

• Adult
• Ailerons
• Appliances Energy Prediction
• Arcene
• BlogFeedback
• Boston House Prices
• Breast Cancer Wisconsin (Diagnostic)
• CIFAR 10
• Gisette
• Iris
• MNIST Handwritten Digit
• Mv
• QSAR Oral Toxicity

Authors

A. De Santis¹, G. Liuzzi¹, S. Lucidi¹, E.M. Tronci¹

¹ Department of Computer, Control and Management Engineering, "Sapienza" University of Rome

• desantis@diag.uniroma1.it,
• liuzzi@diag.uniroma1.it,
• lucidi@diag.uniroma1.it,
• tronci@diag.uniroma1.it

Copyright 2022

References

[1] Fasano, G., & Lucidi, S. (2009). A nonmonotone truncated Newton–Krylov method exploiting negative curvature directions, for large scale unconstrained optimization. Optimization Letters, 3(4), 521-535.