Awesome list for Neural Network Optimization methods.

Stochastic gradient descent with model building

[Neurips 2022] "Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis" by Wuyang Chen*, Wei Huang*, Xinyu Gong, Boris Hanin, Zhangyang Wang

Implementation and comparison of zero order vs first order method on the AdaMM (aka AMSGrad) optimizer: analysis of convergence rates and minima shape

Toy models for Cauchy-Characteristic Extraction (CCE) and Matching (CCM)

Some VASP processing and convergence-testing shell scripts.

Worth-reading papers and related awesome resources on deep learning optimization algorithms. 值得一读的深度学习优化器论文与相关资源。

Official implementation of "Unraveling the Hessian: A Key to Smooth Convergence in Loss Function Landscapes"

Collection of methods for numerical analysis and scientific computing, including numerical root-finders, numerical integration, linear algebra, and data visualization. Created for APPM4600 at CU Boulder.

This project investigates convergence for solving linear systems. It implements Jacobi and SOR methods, explores convergence, optimizes performance via ω, and analyzes spectral radius/determinant. It aims to enhance iterative method efficiency for linear systems.

[EE580: Network System - Modelling & Analysis] This repo contains all the assignment of EE580 offered at IIT Mandi by Dr.Sreelakshmi Manjunath during Fall Session 2023.

This repository contains code for analyzing the convergence, inference, and regret of Stream SGD, as presented in our paper. It includes implementations for queueing systems and inventory control.

Alpha Belief Propagation

Code Repo for "Penalized MLE of multi-layer Gaussian Graphical Models", JMLR, 2016

Numerical convergence studies for spacetime metric calculations. Analysis of discretization errors, mesh refinement, and computational stability in relativity simulations.

Implementation and evaluation of the Ant Colony Optimization algorithm on the bin-packing problem

Special Project - CA classification (2019 Fall)

Record of Gachon Convergence Research Assistant

This repository contains notes and solutions from Kenneth A. Ross: Elementary Analysis. It focuses on building a strong foundation in Real Analysis for Probability, Statistical Inference, and Machine Learning. Some problems are skipped or deferred for later.

Analysis of simulation data obtained with the ParMooN finite element package.