This is a collection of optimization algorithms I designed for tuning machine learning models. Details of the Square Neighborhood Algorithm can be found here: https://capybasilisk.com/posts/2020/06/square-neighborhood-algorithm-balancing-exploration-and-exploitation-in-optimization/ Details of the Interleaved Neighborhood Algorithm can be found here: https://capybasilisk.com/posts/2020/06/interleaved-neighborhood-algorithm-fully-exploratory-optimization/