Skip to content

Experiments for ZOS-SEG algorithm for paper E. Statkevich et. al "Gradient-free algorithm for saddle point problems under overparametrization"

Notifications You must be signed in to change notification settings

Sone4ka1567/Gradient_free_algorithm_for_spp

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 

Repository files navigation

Gradient_free_algorithm_for_spp

Experiments for ZOS-SEG algorithm for paper E. Statkevich et. al "Gradient-free algorithm for saddle point problems under overparametrization".

For stochastic noise we use standard normal distribution, multiplied by Delta. For deterministic noise we use function, depending on argument norm.

Notebook "Parameters_Fitting" contains algorithm implementation and fitting of the following parameters: batch_size B, step_size and smoothing parameter tau.

Notebook "Comparison" contains calculations of convergence rates for three different algorithms for solving Saddle point problem. Here you can see comparison results for stochastic and deterministic noise respecctively.

Screenshot 2024-04-29 at 11 59 14 Screenshot 2024-04-29 at 11 59 25

About

Experiments for ZOS-SEG algorithm for paper E. Statkevich et. al "Gradient-free algorithm for saddle point problems under overparametrization"

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published