Awesome list for Neural Network Optimization methods.

Stochastic gradient descent with model building

[Neurips 2022] "Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis" by Wuyang Chen*, Wei Huang*, Xinyu Gong, Boris Hanin, Zhangyang Wang

Implementation and comparison of zero order vs first order method on the AdaMM (aka AMSGrad) optimizer: analysis of convergence rates and minima shape

Toy models for Cauchy-Characteristic Extraction (CCE) and Matching (CCM)

Some VASP processing and convergence-testing shell scripts.

Worth-reading papers and related awesome resources on deep learning optimization algorithms. 值得一读的深度学习优化器论文与相关资源。

Official implementation of "Unraveling the Hessian: A Key to Smooth Convergence in Loss Function Landscapes"

This project investigates convergence for solving linear systems. It implements Jacobi and SOR methods, explores convergence, optimizes performance via ω, and analyzes spectral radius/determinant. It aims to enhance iterative method efficiency for linear systems.

Collection of methods for numerical analysis and scientific computing, including numerical root-finders, numerical integration, linear algebra, and data visualization. Created for APPM4600 at CU Boulder.

[EE580: Network System - Modelling & Analysis] This repo contains all the assignment of EE580 offered at IIT Mandi by Dr.Sreelakshmi Manjunath during Fall Session 2023.

Implementation and evaluation of the Ant Colony Optimization algorithm on the bin-packing problem

Alpha Belief Propagation

This repository contains code for analyzing the convergence, inference, and regret of Stream SGD, as presented in our paper. It includes implementations for queueing systems and inventory control.

Numerical convergence studies for spacetime metric calculations. Analysis of discretization errors, mesh refinement, and computational stability in relativity simulations.

Code Repo for "Penalized MLE of multi-layer Gaussian Graphical Models", JMLR, 2016

Special Project - CA classification (2019 Fall)

Record of Gachon Convergence Research Assistant

This repository contains notes and solutions from Kenneth A. Ross: Elementary Analysis. It focuses on building a strong foundation in Real Analysis for Probability, Statistical Inference, and Machine Learning. Some problems are skipped or deferred for later.

Evaluating several new approaches to improve convergence of Randomized Kaczmarz (RK) for consistent ill-conditioned systems. This project explores the availability of convergence information among pairwise row differences and analyzes sampling techniques that involve clustering and spectral analysis.