OptimizationReactant-v0.1.0

OptimizationReactant OptimizationReactant-v0.1.0

Merged pull requests:

• Update README.md (#1) (@ChrisRackauckas)
• [WIP] Add OptimizationProblem, OptimizationFunction and solve (#6) (@abhigupta768)
• [WIP]Add KrylovTrustRegion and constrained optimizers from Optim (#9) (@abhigupta768)
• [WIP]Add solve dispatch for all supported optimization libraries (#10) (@abhigupta768)
• NLopt objective needs 2 arguments in the non OptimizationFunction branch as well (#12) (@abhigupta768)
• Add solve dispatch for Evolutionary.jl (#14) (@abhigupta768)
• Add Zygote AD support (#17) (@abhigupta768)
• CompatHelper: add new compat entry for "Optim" at version "0.22" (#19) (@github-actions[bot])
• CompatHelper: add new compat entry for "DiffResults" at version "1.0" (#20) (@github-actions[bot])
• CompatHelper: add new compat entry for "ForwardDiff" at version "0.10" (#21) (@github-actions[bot])
• CompatHelper: add new compat entry for "DiffEqBase" at version "6.41" (#22) (@github-actions[bot])
• CompatHelper: add new compat entry for "Requires" at version "1.0" (#23) (@github-actions[bot])
• CompatHelper: add new compat entry for "Zygote" at version "0.5" (#24) (@github-actions[bot])
• Update Readme (#27) (@abhigupta768)
• Update Project.toml (#29) (@abhigupta768)
• Add AutoReverseDiff dispatch for OptimizationFunction (#30) (@abhigupta768)
• CompatHelper: add new compat entry for "ReverseDiff" at version "1.4" (#31) (@github-actions[bot])
• Finish adding AD backends (#33) (@abhigupta768)
• CompatHelper: add new compat entry for "FiniteDiff" at version "2.5" (#34) (@github-actions[bot])
• CompatHelper: add new compat entry for "Tracker" at version "0.2" (#35) (@github-actions[bot])
• Add Flux optimiser suppport (#38) (@abhigupta768)
• CompatHelper: add new compat entry for "ProgressLogging" at version "0.1" (#39) (@github-actions[bot])
• CompatHelper: add new compat entry for "Flux" at version "0.11" (#40) (@github-actions[bot])
• Add CMAEvolutionStrategy support (#41) (@abhigupta768)
• Update logging for Flux (#43) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for "ConsoleProgressMonitor" at version "0.1" (#44) (@github-actions[bot])
• CompatHelper: add new compat entry for "LoggingExtras" at version "0.4" (#45) (@github-actions[bot])
• CompatHelper: add new compat entry for "TerminalLoggers" at version "0.1" (#46) (@github-actions[bot])
• Add constraints with ForwardDiff support and support IPNewton (#47) (@abhigupta768)
• update to optim 1 (#50) (@ChrisRackauckas)
• use DiffEqBase problem definition (#52) (@ChrisRackauckas)
• CompatHelper: add new compat entry for "ArrayInterface" at version "2.13" (#55) (@github-actions[bot])
• CompatHelper: add new compat entry for "Reexport" at version "0.2" (#56) (@github-actions[bot])
• Correcting argument in documentation (#57) (@dev10110)
• Update README.md (#60) (@mkg33)
• Fixing jacobian and hessians of constraints (#61) (@ArnoStrouwen)
• Remove num_cons from OptimizationFunction (#62) (@Vaibhavdixit02)
• Consistent maxiters argument behaviour across all optimiser (#64) (@jonasmac16)
• Add data argument to solve (#65) (@Vaibhavdixit02)
• Update README.md (#66) (@mkg33)
• Don't use DiffResults in Flux optimiser dispatch with FiniteDiff (#68) (@Vaibhavdixit02)
• Update README.md (#69) (@mkg33)
• Clean up data arg checking (#71) (@Vaibhavdixit02)
• MassInstallAction: Install the TagBot workflow on this repository (#73) (@christopher-dG)
• Add downstream tests and fix GPU (#74) (@ChrisRackauckas)
• Add docs (#76) (@mkg33)
• MassInstallAction: Install the GitHubActionsCI workflow on this repository (#79) (@christopher-dG)
• Update solve.jl (#81) (@mkg33)
• Update solve.jl (#82) (@mkg33)
• Make default progress=false to prevent errors (#83) (@ChrisRackauckas)
• Add optimizers.md (#84) (@mkg33)
• Update index.md (#85) (@Vaibhavdixit02)
• Update optimizers.md (#87) (@mkg33)
• Remove default maxiters assignment (#88) (@Vaibhavdixit02)
• CompatHelper: bump compat for "Zygote" to "0.6" (#89) (@github-actions[bot])
• update nlopt in solve.jl (#90) (@rgreminger)
• Remove plotting from the tests (#91) (@ChrisRackauckas)
• big docs overhaul (#92) (@ChrisRackauckas)
• CompatHelper: bump compat for "Reexport" to "1.0" (#99) (@github-actions[bot])
• Add output struct (#101) (@mkg33)
• Add seed for SAMIN test (#102) (@Vaibhavdixit02)
• CompatHelper: bump compat for "ArrayInterface" to "3.0" (#103) (@github-actions[bot])
• Reorganized documentation (#105) (@mkg33)
• Rename introduction to basic usage for clarity (#107) (@Vaibhavdixit02)
• Adding basic implementation for BBO BorgMOEA multiobjective opt (#108) (@jonasmac16)
• Further integrate and document ModelingToolkit (#110) (@ChrisRackauckas)
• Standardized solution type in SciMLBase (#114) (@ChrisRackauckas)
• Deleted warning (#115) (@mkg33)
• readme docstring and compat bound (#118) (@anandijain)
• fix integration test ci (#119) (@anandijain)
• CompatHelper: bump compat for "Flux" to "0.12" (#122) (@github-actions[bot])
• Removed/commented out BBO multiobjective code chunks (#127) (@jonasmac16)
• Update DataLoader syntax (#128) (@Vaibhavdixit02)
• Enable BBO test and remove EnsembleOptimize commented test (#129) (@Vaibhavdixit02)
• Interface simpl (#131) (@lungd)
• Fix train_loader inside minibatching tutorial. 2 args -> tuple (#132) (@lungd)
• Pass args to gradient function in Fminbox/SAMIN dispatch (#134) (@Vaibhavdixit02)
• CompatHelper: bump compat for "Documenter" to "0.27" for package docs (#137) (@github-actions[bot])
• Use maxfuncevals in BBO solve dispatch instead of maxsteps (#138) (@Vaibhavdixit02)
• Generalize Flux to allow use of other AD systems (#139) (@ChrisRackauckas)
• Prune imports (#140) (@ChrisRackauckas)
• Add MOI interface with MOIOptimizationProblem (#142) (@blegat)
• Make MOIOptimizationProblem fields concrete-typed (#144) (@blegat)
• Add sense kwarg to MOI __solve dispatch (#150) (@Vaibhavdixit02)
• Make MOI interface conforming and add a ton of documentation (#153) (@ChrisRackauckas)
• Made NLopt.jl interface properly handle options & minor changes to MOI (#160) (@jonasmac16)
• Harmonised interfaces and added common arguments (#163) (@jonasmac16)
• Fixed MOI warning (#164) (@jonasmac16)
• First implementation of Metaheuristic.jl interface (#165) (@jonasmac16)
• First implementation of Nonconvex.jl (#166) (@jonasmac16)
• Fix typo in mathoptinterface (#168) (@nandoconde)
• Add NLopt maxsense support (#169) (@Vaibhavdixit02)
• Add Optim maxsense and organise rosenbrock.jl (#170) (@Vaibhavdixit02)
• Fixes requires issue (#173) (@jonasmac16)
• New interface to GCMAES.jl (#174) (@jonasmac16)
• New interface to SpeedMapping.jl (#175) (@jonasmac16)
• New basic interface to NOMAD.jl (#176) (@jonasmac16)
• Remove "higher level docs" and put a higher level table (#177) (@ChrisRackauckas)
• Use the minimum with save_best in flux optimiser (#180) (@Vaibhavdixit02)
• Fixing and amending the documentation (#181) (@jonasmac16)
• Change MultiStartOptimization interface to generic API (#182) (@jonasmac16)
• Replaced incompatible emojis in docs (#183) (@jonasmac16)
• Automatically wrap Optim solver in Fminbox (#184) (@jonasmac16)
• Update nlopt.md (#186) (@Vaibhavdixit02)
• fix update of theta so minimizer is returned when maxiters is hit (#187) (@m-bossart)
• Clarify return value from a callback in docs (#190) (@Vaibhavdixit02)
• Make use of Flux.Optimise.AbstractOptimiser (#192) (@lungd)
• CI for LTS (#197) (@ChrisRackauckas)
• Better error message for constrained optimizers (#198) (@ChrisRackauckas)
• Fix nlopt's compatibility with callbacks (#200) (@ChrisRackauckas)
• add using Zygote to tutorial (#202) (@ArnoStrouwen)
• CompatHelper: bump compat for ArrayInterface to 4, (keep existing compat) (#203) (@github-actions[bot])
• fix Evolutionary wrapper (fixes #204) (#205) (@wildart)
• NOMAD (#208) (@ValentinKaisermayer)
• CompatHelper: bump compat for ArrayInterface to 5, (keep existing compat) (#212) (@github-actions[bot])
• Fix typo (#215) (@jbrea)
• Fix ForwardDiff error in intro tutorial (#217) (@odow)
• Update to MathOptInterface v1.0 (#218) (@odow)
• Update global optimization status of MOI (#219) (@ccoffrin)
• Create sub packages for each optimiser (#220) (@Vaibhavdixit02)
• Correct type of time_limit in Evolutionary.Options (#222) (@lcontento)
• clean up core tests (#225) (@ChrisRackauckas)
• Further testing clean up to get CI green (#226) (@Vaibhavdixit02)
• update docs for subpackages (#227) (@ChrisRackauckas)
• Specify loading of Galactic* sub package for local method in GalacticMultistartOptimization (#228) (@Vaibhavdixit02)
• Add compat bounds to all subpackages (#229) (@Vaibhavdixit02)
• Move licenses to lib/Galactic* (#231) (@Vaibhavdixit02)
• fixes copy paste mistake (#232) (@ValentinKaisermayer)
• another copy paste mistake (#233) (@ValentinKaisermayer)
• Missing compats in subpackages (#234) (@Vaibhavdixit02)
• Add end of iteration check in callback of Optim (#236) (@prbzrg)
• Add mtk.jl for AutoModelingToolkit as AD backend support (#237) (@Vaibhavdixit02)
• Use NonlinearSystem (via mtk-ize on NonlinearProblem) for constraint (#240) (@Vaibhavdixit02)
• Add obj_sparse and cons_sparse fields to AutoModelingToolkit and pass to derivative functions (#241) (@Vaibhavdixit02)
• Use the docstring for the OptimizationProblem page (#243) (@ChrisRackauckas)
• Change to ArrayInterfaceCore (#247) (@ChrisRackauckas)
• Update Project.toml (#248) (@jonasmac16)
• Check against NelderMead type not object for callback branching (#249) (@Vaibhavdixit02)
• Finish up AutoModelingToolkit sparsity handling (#250) (@Vaibhavdixit02)
• changes all OptimizationFunction constructors to outer one (#253) (@ValentinKaisermayer)
• Change GalacticFlux to use Optimisers.jl (#255) (@ChrisRackauckas)
• CompatHelper: bump compat for DocStringExtensions to 0.9, (keep existing compat) (#256) (@github-actions[bot])
• Use new SciMLBase docstring for the solve documentation (#257) (@ChrisRackauckas)
• CompatHelper: bump compat for LoggingExtras to 0.5, (keep existing compat) (#260) (@github-actions[bot])
• Change OptimizationFunction documentation to use docstrings (#261) (@ChrisRackauckas)
• Fix AD docstring builds (#262) (@ChrisRackauckas)
• Create GalacticPolyalgorithms.jl (#263) (@ChrisRackauckas)
• Rename to Optimization.jl (#264) (@ChrisRackauckas)
• Finish up AutoModelingToolkit sparsity handling 2 (#265) (@ChrisRackauckas)
• Update README.md (#266) (@thomvet)
• Update docs for MathOptInterface wrapper (#270) (@odow)
• Complete handling of sparse case in MOI (#274) (@Vaibhavdixit02)
• Update docs for OptimizationMOI (#277) (@odow)
• Add expression graphs to MOI when using MTK (#278) (@ChrisRackauckas)
• Fix minibatch example (#280) (@ChrisRackauckas)
• [OptimizationMOI] fix handling of sparse derivatives and add tests (#284) (@odow)
• Small fix of missed change from galactic misspelling (#288) (@albheim)
• Rebase with better tests for ExprGraph (#290) (@odow)
• flesh out some of the tutorials and make them doc examples (#292) (@ChrisRackauckas)
• Update Downstream.yml (#293) (@MartinuzziFrancesco)
• CompatHelper: add new compat entry for OptimizationEvolutionary at version 0.1 for package docs, (keep existing compat) (#294) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationOptimisers at version 0.1 for package docs, (keep existing compat) (#295) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationNLopt at version 0.1 for package docs, (keep existing compat) (#296) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationOptimJL at version 0.1 for package docs, (keep existing compat) (#297) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationCMAEvolutionStrategy at version 0.1 for package docs, (keep existing compat) (#298) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationBBO at version 0.1 for package docs, (keep existing compat) (#299) (@github-actions[bot])
• Doctest the minibatch tutorial and add Optimisers.jl docs (#300) (@ChrisRackauckas)
• Add id for optimisers (#302) (@ChrisRackauckas)
• CompatHelper: add new compat entry for IterTools at version 1 for package docs, (keep existing compat) (#303) (@github-actions[bot])
• Handle prototype typing and expression clean up in NoAD (#304) (@Vaibhavdixit02)
• format SciML Style (#306) (@ChrisRackauckas)
• Cleanup Rosenbrock tutorial (#315) (@DanielVandH)
• Fix MultistartOptimization documentation (#317) (@DanielVandH)
• Constraints for AutoFiniteDiff (#318) (@DanielVandH)
• Fix hessian calculation with FiniteDiff (#319) (@Vaibhavdixit02)
• Fix package name references in Evolutionary.jl docs (#323) (@DanielVandH)
• Avoid recreation of derivative caches inside derivative computation and change constraint function to be in-place (#324) (@Vaibhavdixit02)
• Specify installation instructions for OptimizationQuadDIRECT (#327) (@Vaibhavdixit02)
• typo in rosenbrock function in docs (#329) (@mdmaas)
• Add constraints tutorial (#330) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for Optimization at version 3 for package docs, (keep existing compat) (#331) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationMOI at version 0.1 for package docs, (keep existing compat) (#332) (@github-actions[bot])
• CompatHelper: add new compat entry for Ipopt at version 1 for package docs, (keep existing compat) (#333) (@github-actions[bot])
• CompatHelper: add new compat entry for AmplNLWriter at version 1 for package docs, (keep existing compat) (#334) (@github-actions[bot])
• Add progress info for OptimizationBBO (#336) (@SebastianM-C)
• Pass cons_hess_prototype and cons_jac_prototype from user's OptimizationFunction in the created OF in AutoForwardDiff (#340) (@Vaibhavdixit02)
• Incorrect convert call for cons_hess_prototype since it's a vector of matrices and make manually passed derivatives take 3 arguments (#342) (@Vaibhavdixit02)
• unify docs (#345) (@ArnoStrouwen)
• Update OptimizationMOI README (#351) (@odow)
• Tutorial typo (#353) (@vavrines)
• badges (#355) (@ArnoStrouwen)
• doc cov (#356) (@ArnoStrouwen)
• start fixing tutorials for strict docs (#358) (@ArnoStrouwen)
• CompatHelper: add new compat entry for OrdinaryDiffEq at version 6 for package docs, (keep existing compat) (#359) (@github-actions[bot])
• CompatHelper: add new compat entry for SciMLSensitivity at version 7 for package docs, (keep existing compat) (#360) (@github-actions[bot])
• CompatHelper: add new compat entry for Flux at version 0.13 for package docs, (keep existing compat) (#361) (@github-actions[bot])
• Concretely typed fields in MOIOptimizationProblem (#363) (@baggepinnen)
• Add Invalidations.yml [ci skip] [skip tests] (#365) (@ranocha)
• MassInstallAction: Install the Invalidations workflow on this repository (#367) (@devmotion)
• error with complex number u0 in OptimizationOptimisers (#368) (@KirillZubov)
• Add QuadDIRECT to Project.toml and install it on CI (#371) (@Vaibhavdixit02)
• Be more informative about supported functionality of a backend and correctness of kwargs (#376) (@Vaibhavdixit02)
• example and strict docs (#380) (@ArnoStrouwen)
• Adds support for MOI.AbstractOptimizer that do not support MOI.NLPBlock (#381) (@ValentinKaisermayer)
• CompatHelper: add new compat entry for OptimizationGCMAES at version 0.1 for package docs, (keep existing compat) (#382) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationNOMAD at version 0.1 for package docs, (keep existing compat) (#383) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationMetaheuristics at version 0.1 for package docs, (keep existing compat) (#384) (@github-actions[bot])
• CompatHelper: add new compat entry for NLopt at version 0.6 for package docs, (keep existing compat) (#385) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationMultistartOptimization at version 0.1 for package docs, (keep existing compat) (#386) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationSpeedMapping at version 0.1 for package docs, (keep existing compat) (#387) (@github-actions[bot])
• CompatHelper: add new compat entry for Juniper at version 0.9 for package docs, (keep existing compat) (#388) (@github-actions[bot])
• remove DiffResult (#389) (@ArnoStrouwen)
• CMAEvolutionStrategy.jl doesn't require bounds, allows it (#390) (@Vaibhavdixit02)
• Update optim.md (#393) (@Vaibhavdixit02)
• canonify docs (#396) (@ArnoStrouwen)
• Revert removed kwargs splatting in BBO (#399) (@Vaibhavdixit02)
• Uses cache in solution (#402) (@ValentinKaisermayer)
• Implements cache interface (#406) (@ValentinKaisermayer)
• reproducible docs (#409) (@ArnoStrouwen)
• CompatHelper: bump compat for LoggingExtras to 1, (keep existing compat) (#410) (@github-actions[bot])
• [skip ci] doc and lib compat (#411) (@ArnoStrouwen)
• Bound Optimization to 3.9 in subpackages and create new patch releases (#420) (@Vaibhavdixit02)
• Use updated ordering from toexpr in constraint expression (#424) (@Vaibhavdixit02)
• Disallow callback in MOI subpackage and empty solver if prepopulated (#426) (@Vaibhavdixit02)
• lib cov (#427) (@ArnoStrouwen)
• track only src (#428) (@ArnoStrouwen)
• Use empty! instead of instantiate to support reuse of MOI optimizers (#429) (@Vaibhavdixit02)
• Downstream test MTK (#431) (@ChrisRackauckas)
• Switch to using modelingtoolkitize inside AutoModelingToolkit (#432) (@Vaibhavdixit02)
• Update Project.toml (#434) (@ValentinKaisermayer)
• Add OptimizationSolution page (#435) (@ChrisRackauckas)
• Small update on batching docs (#436) (@JordiBolibar)
• Move ObjSense into SciMLBase (#438) (@DanielVandH)
• Report solve time (#442) (@ValentinKaisermayer)
• Convert MOI status to SciMLBase retcode (#443) (@ValentinKaisermayer)
• Format (#445) (@Vaibhavdixit02)
• Renames sol.minum to sol.objective (#446) (@ValentinKaisermayer)
• [skip ci] LanguageTool (#450) (@ArnoStrouwen)
• Add an FAQ page (#451) (@ChrisRackauckas)
• Link to NaNMath & fixed some typos (#453) (@DanielVandH)
• Change NLopt to OptimizationNLopt (#454) (@DanielVandH)
• format markdown (#459) (@ArnoStrouwen)
• Fix failing docs on CI (#460) (@Vaibhavdixit02)
• Bump MultistartOptimization compat entry (#461) (@Vaibhavdixit02)
• Bump version to get stable docs build (#462) (@Vaibhavdixit02)
• Add box constraints column to table (#465) (@DanielVandH)
• Describe details of the objective function (#466) (@baggepinnen)
• Allow data args in NoAD's derivatives (#469) (@Vaibhavdixit02)
• Update OptimizationEvolutionary to support constraints and pass additional kwargs (#471) (@Vaibhavdixit02)
• Add integer support for MOI (#472) (@AlCap23)
• Adds nlopt retcode handling (#474) (@ValentinKaisermayer)
• Put the documentation into the standard form (#476) (@ChrisRackauckas)
• Real Integer Constraints (#477) (@AlCap23)
• update to ArrayInterface v7 (#478) (@ChrisRackauckas)
• Use Optimisers.AbstractRule (#480) (@prbzrg)
• [WIP] Add AutoEnzyme for using Enzyme as the AD backend (#483) (@Vaibhavdixit02)
• enable dependabot for GitHub actions (#485) (@ranocha)
• Bump actions/cache from 1 to 3 (#486) (@dependabot[bot])
• Bump codecov/codecov-action from 1 to 3 (#487) (@dependabot[bot])
• Bump actions/checkout from 1 to 3 (#488) (@dependabot[bot])
• [WIP] Fix incorrect tests and add constraints support in OptimizationNLopt (#493) (@Vaibhavdixit02)
• Fix Ipopt_jll bound (#496) (@ChrisRackauckas)
• Add link to SpeedMapping.jl page from the page index (#499) (@sheevy)
• Update Project.tomls for init release (#503) (@Vaibhavdixit02)
• Correct some typos (#505) (@goggle)
• CompatHelper: add new compat entry for Symbolics at version 5 for package OptimizationMOI, (keep existing compat) (#506) (@github-actions[bot])
• CompatHelper: add new compat entry for ModelingToolkit at version 8 for package OptimizationMOI, (keep existing compat) (#507) (@github-actions[bot])
• Bump DiffEqFlux in tests (#509) (@ChrisRackauckas)
• Add all optimizer types from Optim to __init (#510) (@Vaibhavdixit02)
• Fix typo in documentation (#512) (@Liozou)
• [WIP] Misc docs updates (#513) (@Vaibhavdixit02)
• Bound Enzyme to 0.11.0 (#514) (@Vaibhavdixit02)
• Remove Nonconvex from docs for now (#517) (@baggepinnen)
• prefer use of lagragian hessian if available (#518) (@baggepinnen)
• Performance Improvements for OptimizationBBO (#519) (@Zentrik)
• Update OptimizationGCMAES.jl to set allowscallbacks to false (#527) (@Vaibhavdixit02)
• generate lag_h function for FiniteDiff (#529) (@baggepinnen)
• Move AD files to extension packages (#530) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for ADTypes at version 0.1, (keep existing compat) (#532) (@github-actions[bot])
• [Experimental] Add Sophia method implementation (#534) (@Vaibhavdixit02)
• Add cache dispatch to Enzyme instantiate_function (#535) (@Vaibhavdixit02)
• Add cache interface to all wrapper packages (#536) (@Vaibhavdixit02)
• Remove buggy structural_simplify usage (#539) (@YingboMa)
• Do not ignore the initial guess in OptimizationBBO (#540) (@SebastianM-C)
• map maxiters to outer_iterations (#544) (@SebastianM-C)
• Try running CI on 1.8 (#545) (@Vaibhavdixit02)
• Try getting BBO tests passing (#547) (@Vaibhavdixit02)
• Format master (#549) (@Vaibhavdixit02)
• Bump versions (#550) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for HiGHS at version 1 for package docs, (keep existing compat) (#551) (@github-actions[bot])
• Bring back AbstractRule in OptimizationOptimisers (#552) (@Vaibhavdixit02)
• Handle sparse hessians, jacobians and hessvec product better (#553) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for Symbolics at version 5, (keep existing compat) (#557) (@github-actions[bot])
• Try Enzyme 0.11.2 (#561) (@Vaibhavdixit02)
• Some NLopt and MOI updates (#562) (@Vaibhavdixit02)
• Update Project.toml to try Enzyme 0.11.4 and then 0.11.3 (#563) (@Vaibhavdixit02)
• Update hessian implementation and avoid closure in gradient (#565) (@Vaibhavdixit02)
• CompatHelper: bump compat for Flux to 0.14 for package docs, (keep existing compat) (#566) (@github-actions[bot])
• remove second copy of __moi_status_to_ReturnCode (#568) (@visr)
• Refactor: correct a typo (#569) (@tapyu)
• Throw error from callback true in NLopt to halt optimization (#570) (@Vaibhavdixit02)
• CompatHelper: bump compat for ADTypes to 0.2, (keep existing compat) (#574) (@github-actions[bot])
• CompatHelper: bump compat for NLopt to 1 for package docs, (keep existing compat) (#575) (@github-actions[bot])
• CompatHelper: bump compat for NLopt to 1 for package OptimizationNLopt, (keep existing compat) (#576) (@github-actions[bot])
• Add constraints support to ReverseDiff and Zygote (#577) (@Vaibhavdixit02)
• Fix mtk empty contraints creation and update rosenbrock example (#578) (@Vaibhavdixit02)
• CompatHelper: bump compat for Optimisers to 0.3 for package OptimizationOptimisers, (keep existing compat) (#580) (@github-actions[bot])
• Fix typos in the extension names (#582) (@ChrisRackauckas)
• Update extensions to not load packages directly only through Optimization (#583) (@Vaibhavdixit02)
• [WIP] Enzyme and sparse updates (#585) (@Vaibhavdixit02)
• Fix type instability in Enzyme extension (#586) (@wsmoses)
• Bump actions/checkout from 3 to 4 (#588) (@dependabot[bot])
• Support both float and array return extensions [Enzyme] (#589) (@wsmoses)
• Setup tape compilation for ReverseDiff (#590) (@ChrisRackauckas)
• CompatHelper: bump compat for Documenter to 1 for package docs, (keep existing compat) (#594) (@github-actions[bot])
• Fix chunksize issue (#595) (@Vaibhavdixit02)
• Eliminate some runtime dispatch and other things (#597) (@Vaibhavdixit02)
• Documenter 1.0 upgrade (#598) (@ArnoStrouwen)
• Improve Performance for OptimizationBBO (#600) (@Zentrik)
• Add callback to MOI (#601) (@Vaibhavdixit02)
• Mark tests broken on v1.6 as broken on v1.6 (#603) (@ChrisRackauckas)
• Bound Optim.jl to the range where it is generic (#604) (@ChrisRackauckas)
• Require v1.9 for AD tests (#605) (@ChrisRackauckas)
• build: lift Optim bound (#607) (@sathvikbhagavan)
• build(OptimizationOptimJL): bump patch version (#608) (@sathvikbhagavan)
• Make AutoZygote robust to zero gradients (#609) (@ChrisRackauckas)
• fix typos (#611) (@spaette)
• [WIP] Add PRIMA wrapper (#612) (@Vaibhavdixit02)
• Fix zygote constraint bug and update rosenbrock doc (#615) (@Vaibhavdixit02)
• Add OptimizationPRIMA to the docs (#616) (@ChrisRackauckas)
• CompatHelper: add new compat entry for OptimizationPRIMA at version 0.0.1 for package docs, (keep existing compat) (#618) (@github-actions[bot])
• Change typeof(x) <: y to x isa y (#623) (@pepijndevos)
• Fix optim maxsense (#624) (@Vaibhavdixit02)
• fix: use SII instead of explicitly accessing SciMLFunction.syms (#626) (@AayushSabharwal)
• Create polyopt.md (#627) (@Vaibhavdixit02)
• Update OptimizationOptimJL.jl (#630) (@Vaibhavdixit02)
• [WIP] Keep symbolic expressions from mtk, make it moi compatible later (#636) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for SciMLBase at version 2 for package docs, (keep existing compat) (#637) (@github-actions[bot])
• Aqua + typos CI (#639) (@ArnoStrouwen)
• Bump actions/checkout from 3 to 4 (#640) (@dependabot[bot])
• Update Flux compat (#642) (@vavrines)
• [skip ci] dependabot ignore typos patches (#643) (@ArnoStrouwen)
• Delete lib/OptimizationNonconvex directory to avoid unnecessary compa… (#646) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for SymbolicIndexingInterface at version 0.3 for package OptimizationMOI, (keep existing compat) (#647) (@github-actions[bot])
• Pass state to OptimizationOptimisers callback (#649) (@Vaibhavdixit02)
• downgrade CI (#650) (@ArnoStrouwen)
• CompatHelper: bump compat for LoggingExtras to 1, (keep existing compat) (#651) (@github-actions[bot])
• [WIP]Stats and State (#652) (@Vaibhavdixit02)
• Format and sparsearrays only 1.10 (#656) (@Vaibhavdixit02)
• Add docstrings to state and stats (#657) (@Vaibhavdixit02)
• CompatHelper: bump compat for OptimizationCMAEvolutionStrategy to 0.2 for package docs, (keep existing compat) (#658) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationOptimisers to 0.2 for package docs, (keep existing compat) (#659) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationMOI to 0.3 for package docs, (keep existing compat) (#660) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationNLopt to 0.2 for package docs, (keep existing compat) (#661) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationNOMAD to 0.2 for package docs, (keep existing compat) (#662) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationEvolutionary to 0.2 for package docs, (keep existing compat) (#663) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationMetaheuristics to 0.2 for package docs, (keep existing compat) (#664) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationOptimJL to 0.2 for package docs, (keep existing compat) (#665) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationMultistartOptimization to 0.2 for package docs, (keep existing compat) (#666) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationGCMAES to 0.2 for package docs, (keep existing compat) (#667) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationBBO to 0.2 for package docs, (keep existing compat) (#668) (@github-actions[bot])
• Update minibatch.md (#671) (@Vaibhavdixit02)
• Bump crate-ci/typos from 1.16.23 to 1.17.0 (#672) (@dependabot[bot])
• mtkize behind if and try blocks (#676) (@Vaibhavdixit02)
• Add mtkize to docs (#677) (@Vaibhavdixit02)
• remove extra @shows (#678) (@SebastianM-C)
• Update OptimizationZygoteExt.jl (#679) (@Vaibhavdixit02)
• [OptimizationMOI] improve performance of Jacobian and Hessian accesses (#680) (@odow)
• Moved optstats to SciMLBase (#681) (@Vaibhavdixit02)
• Bump actions/cache from 3 to 4 (#682) (@dependabot[bot])
• refactor: update for MTKv9 (#685) (@AayushSabharwal)
• remove extraneous println in OptimizationOptimJL.jl (#687) (@orens77)
• refactor: remove type-pirated functions (#689) (@AayushSabharwal)
• fix: call complete on systems generated in MTKExt (#690) (@AayushSabharwal)
• Fixed issue #683: error when store_trace=true in OptimizationEvolutionary.jl (#691) (@jonathanfischer97)
• Update Project.toml (#693) (@Vaibhavdixit02)
• Fix docs build (#696) (@ChrisRackauckas)
• Remove linesearch references in IPNewton documentation (#698) (@ederag)
• Bump codecov/codecov-action from 3 to 4 (#699) (@dependabot[bot])
• Bump crate-ci/typos from 1.17.0 to 1.18.0 (#700) (@dependabot[bot])
• [skip ci] Update dependabot.yml (#701) (@ArnoStrouwen)
• fixed user trace! overload compat. Both x and user records now saved (#702) (@jonathanfischer97)
• CompatHelper: bump compat for OptimizationPolyalgorithms to 0.2 for package docs, (keep existing compat) (#703) (@github-actions[bot])
• [skip ci] update downgrade CI repo (#704) (@ArnoStrouwen)
• [OptimizationMOI] fix compat bounds in Project.toml (#705) (@odow)
• CompatHelper: bump compat for OptimizationMOI to 0.4 for package docs, (keep existing compat) (#706) (@github-actions[bot])
• reapply formatter (#708) (@ArnoStrouwen)
• [WIP] Update to using OptimizationBase (#709) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for SciMLStructures at version 1 for package OptimizationMOI, (keep existing compat) (#710) (@github-actions[bot])
• Add Manopt.jl wrapper (#712) (@Vaibhavdixit02)
• Update #711 checking if OptimizationFunction is used for derivative based optimizers #711 (#715) (@ParasPuneetSingh)
• Store grad/hess in state for Optim.jl (#716) (@sethaxen)
• CompatHelper: add new compat entry for OptimizationBase at version 0.0.5 for package docs, (keep existing compat) (#717) (@github-actions[bot])
• Delete duplicate ReInitCache (#721) (@Vaibhavdixit02)
• Remove LD_LBFGS_NOCEDAL update nlopt.md (#725) (@Vaibhavdixit02)
• Use lbfgsb as the default solver (#726) (@Vaibhavdixit02)
• Try augmented-lagrangian with lbfgsb (#727) (@Vaibhavdixit02)
• deepcopy to save population in default trace, instead of reference (#730) (@jonathanfischer97)
• check identity instead of equality (#732) (@jonathanfischer97)
• Reversion: stop deep copying population, just save curr_u for OptimizationState construction (#734) (@jonathanfischer97)
• Bump julia-actions/setup-julia from 1 to 2 (#735) (@dependabot[bot])
• CompatHelper: bump compat for OptimizationEvolutionary to 0.3 for package docs, (keep existing compat) (#737) (@github-actions[bot])
• CompatHelper: bump compat for ADTypes to 1, (keep existing compat) (#738) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationBase to 0.0.6 for package docs, (keep existing compat) (#739) (@github-actions[bot])
• Explicit warning when AD backend not specified correctly for automatic box-constraint handling with Optim (#741) (@Vaibhavdixit02)
• CompatHelper: bump compat for OptimizationBase to 0.0.7 for package docs, (keep existing compat) (#742) (@github-actions[bot])
• Update OptimizationOptimJL compats used here (#746) (@Vaibhavdixit02)
• CompatHelper: bump compat for OptimizationBase to 1, (keep existing compat) (#748) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationBase to 1 for package docs, (keep existing compat) (#750) (@github-actions[bot])
• OptimizationOptimJL NoAD fix (#753) (@Vaibhavdixit02)
• Add an iteration count to PRIMA (#756) (@ChrisRackauckas)
• Typo fix (#757) (@ChrisRackauckas)
• Update OptimizationOptimJL.jl (#759) (@Vaibhavdixit02)
• Add tests for Optim.BFGS() with user-supplied grad and bounds (#761) (@sjdaines)
• fix duplicated methods (#762) (@daviehh)
• Get OptimizationManopt ready for registration (#763) (@Vaibhavdixit02)
• Update to nlopt's new error throwing (#764) (@Vaibhavdixit02)
• Proposed solution to bug#745 (#766) (@ParasPuneetSingh)
• Update PRIMA compat (#769) (@Vaibhavdixit02)
• Final dev things for registration of OptimizationManopt (#770) (@Vaibhavdixit02)
• Add license to OptimizationManopt subdir and fix all others (#771) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for Manifolds at version 0.9 for package docs, (keep existing compat) (#772) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationManopt at version 0.0.1 for package docs, (keep existing compat) (#773) (@github-actions[bot])
• Update broken test for OptimizationManopt (#775) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for Manopt at version 0.4 for package docs, (keep existing compat) (#777) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationManopt at version 0.0.2 for package docs, (keep existing compat) (#778) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationBBO to 0.3 for package docs, (keep existing compat) (#779) (@github-actions[bot])
• Remove lb and ub from kwargs before passing to solver function in lbfgsb (#780) (@Vaibhavdixit02)
• Add another lbfgsb stopping criteria for retcode handling (#781) (@Vaibhavdixit02)
• Add more retcode testing and fix space in lbfgsb return (#782) (@Vaibhavdixit02)
• Bump OptimizationBase to 1.3.3 (#785) (@Vaibhavdixit02)
• CompatHelper: bump compat for OptimizationPRIMA to 0.2 for package docs, (keep existing compat) (#786) (@github-actions[bot])
• Updating solver __solve function for MOO (#787) (@ParasPuneetSingh)
• New tutorials and docs (#788) (@Vaibhavdixit02)
• [WIP] Updates for OptimizationBase v2 (#789) (@Vaibhavdixit02)
• Add a conversion mechanism between NLPModel to OptimizationProblem (#792) (@alonsoC1s)
• CompatHelper: add new compat entry for SymbolicAnalysis at version 0.2 for package docs, (keep existing compat) (#794) (@github-actions[bot])
• CompatHelper: add new compat entry for Symbolics at version 6 for package docs, (keep existing compat) (#796) (@github-actions[bot])
• CompatHelper: bump compat for Symbolics to 6 for package OptimizationMOI, (keep existing compat) (#797) (@github-actions[bot])
• Add constraints support for NLopt (#799) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for SymbolicAnalysis at version 0.3 for package docs, (keep existing compat) (#800) (@github-actions[bot])
• Add remake docs (#801) (@Vaibhavdixit02)
• CompatHelper: add new compat entry for NLPModelsTest at version 0.10 for package docs, (keep existing compat) (#803) (@github-actions[bot])
• CompatHelper: add new compat entry for NLPModels at version 0.21 for package docs, (keep existing compat) (#804) (@github-actions[bot])
• Update __loss function for MOO using OptimizationMetaheuristics.jl (#805) (@ParasPuneetSingh)
• refactor: remove dependency on Pkg (#807) (@SebastianM-C)
• Added precompilation for nonnegative least squares (#809) (@aris-mav)
• call cons_vjp if available (#811) (@baggepinnen)
• Add constraints support for NOMAD (#817) (@Vaibhavdixit02)
• Bump versions (#818) (@Vaibhavdixit02)
• docs updates (#819) (@Vaibhavdixit02)
• feat: make MLUtils into a weakdep & suppport MLDataDevices (#827) (@avik-pal)
• fix: no printing "dkjht" (#828) (@avik-pal)
• Optimisers iteration count should be calculated with epochs and data both (#830) (@Vaibhavdixit02)
• NLopt: Reuse constraint evaluations (#832) (@Vaibhavdixit02)
• Make auglag generic and reusable with all solvers (#833) (@Vaibhavdixit02)
• Update index.md (#836) (@Vaibhavdixit02)
• Update optimisers extensions and tests (#838) (@Vaibhavdixit02)
• fix: match iterations count in Sophia (#841) (@avik-pal)
• MOI Constraint jacobian-vector fixes (#845) (@aml5600)
• Update links to algorithms in optim.md (#846) (@AbdAlazezAhmed)
• MOI vector lambda and iteration fixes in Optimisers (#847) (@Vaibhavdixit02)
• Update _check_and_convert_maxiters to ensure rounding (#849) (@Vaibhavdixit02)
• Bump codecov/codecov-action from 4 to 5 (#856) (@dependabot[bot])
• More conditionals for not calculating hessian in NLopt (#857) (@Vaibhavdixit02)
• chore: bump Optimisers (#861) (@avik-pal)
• Update OptimizationOptimisers.jl (#869) (@lsmohan)
• fix #870 (#871) (@baggepinnen)
• Update runtests.jl in OptimizationOptimisers (#872) (@Vaibhavdixit02)
• Fix typo (#878) (@dreivmeister)
• Check more retcodes from NLopt (#879) (@sumiya11)
• Bump version (#880) (@sumiya11)
• Fix nested bullet list in optimization.md (#881) (@abhro)
• Make DiffEqFlux test more robust (#887) (@ChrisRackauckas)
• Test if Metaheuristics tests simply need a higher iteration count for robustness (#888) (@ChrisRackauckas)
• Update OptimizationOptimJL.jl (#895) (@Vaibhavdixit02)
• bump MultistartOptimization compatibility (#896) (@Moelf)
• define maxiters similar to epochs (#897) (@prbzrg)
• Cleanup BBO and MOI (#899) (@SebastianM-C)
• Update ensemble.md to use standard API (#903) (@ChrisRackauckas)
• forwardDiff@1 (#905) (@oscardssmith)
• Simplify calls to Optim.jl (#910) (@ChrisRackauckas)
• Update termination reason dictionary (#911) (@ChrisRackauckas)
• Extend getting_started.md (#913) (@ChrisRackauckas)
• Add initial version of OptimizationIpopt (#915) (@SebastianM-C)
• OptimizationODE package for ODE solvers (#916) (@ParasPuneetSingh)
• build: bump compats for mtkv10 (#919) (@AayushSabharwal)
• Improve code conciseness in file OptimizationNLopt.jl (#920) (@thimotedupuch)
• Scipywrapper (#927) (@AdityaPandeyCN)
• Add Documentation for Scipywrapper (#928) (@AdityaPandeyCN)
• Fix up a few things (#929) (@ChrisRackauckas)
• Fix tests (#930) (@ChrisRackauckas)
• Added fix for COBYLA example in docs (#931) (@AdityaPandeyCN)
• DAE optimizers added to OptimizationODE (#932) (@ParasPuneetSingh)
• PyCMA Wrapper (#933) (@mxpoch)
• added pycma docs and python kwargs (#934) (@mxpoch)
• added callbacks to pycma wrapper (#935) (@mxpoch)
• Adding Mooncake to the AD list. (#936) (@yebai)
• Relax type in MOI NLP evaluator (#938) (@ErikQQY)
• Add optimization parameters to OptimizationState (#945) (@ChrisRackauckas)
• Add verbose parameter support to CMAEvolutionStrategyOpt (#946) (@ChrisRackauckas)
• Fix integer bounds error in OptimizationMOI (#947) (@ChrisRackauckas)
• Fix LBFGS iteration counter always showing 0 (#948) (@ChrisRackauckas)
• Add support for dual_ftol_rel parameter in NLopt (#949) (@ChrisRackauckas)
• Add documentation for reinit! function (#950) (@ChrisRackauckas)
• Improve test coverage for src/utils.jl (#952) (@ChrisRackauckas)
• Fix Sophia neural network training documentation example (#953) (@ChrisRackauckas)
• Remove Julia v1.9 version checks and associated AD tests (#956) (@ChrisRackauckas)
• Add spell checking configuration (#962) (@ChrisRackauckas)
• Fix spelling errors and add typos configuration (#963) (@ChrisRackauckas)
• Add downgrade CI workflow with Core test group (#964) (@ChrisRackauckas)
• Add downgrade CI for all sublibraries (#965) (@ChrisRackauckas)
• Update CI to test on Julia 1, lts, and pre versions (#966) (@ChrisRackauckas)
• Fix downgrade CI compatibility issues with version bumps (#983) (@ChrisRackauckas)
• Added a new Subpackage for Augmented Lagrangian (#984) (@ParamThakkar123)
• Update code formatting with JuliaFormatter (#985) (@ChrisRackauckas)
• New Subpackage for LBFGS (#986) (@ParamThakkar123)
• Initialize line split fixes following Catalyst.jl PR #1306 (#987) (@ChrisRackauckas)
• Added new subpackage for Sophia.jl (#988) (@ParamThakkar123)
• Migrate OptimizationBase.jl as sublibrary (pure migration) (#993) (@ChrisRackauckas-Claude)
• Fix error when store_trace=true with OptimizationOptimJL (#994) (@ChrisRackauckas-Claude)
• Add comprehensive docstring for Sophia optimizer (#998) (@ChrisRackauckas-Claude)
• Fix Sophia optimizer shadow generation for ComponentArrays (#1000) (@ChrisRackauckas-Claude)
• Add docs for OptimizationIpopt (#1001) (@SebastianM-C)
• Clarify Rosenbrock examples documentation (#1002) (@mikeingold)
• [WIP] fix: fix tests (#1003) (@AayushSabharwal)
• Fix Sophia optimizer: add Random import to resolve randn! error (#1006) (@ChrisRackauckas-Claude)
• Fix CMAEvolutionStrategy solution u (#1008) (@gabrevaya)
• Improve the OptimizationManopt.jl interface (#1009) (@kellertuer)
• Add missing solve interface to OptimizationBase from SciMLBase.jl (#1012) (@ChrisRackauckas-Claude)
• Create solver_missing_error_messages.jl (#1013) (@ChrisRackauckas)
• Add compatibility support for supports_opt_cache_interface (#1014) (@ChrisRackauckas-Claude)
• Fix OptimizationOptimisers.jl progress bar (#1019) (@ChrisRackauckas)
• IpoptOptimizer now stores solver specific options and the callbacks are faster (#1021) (@SebastianM-C)
• bump OptimizationIpopt compat in docs (#1022) (@SebastianM-C)
• Relax Matrix type in IpoptCache (#1025) (@ErikQQY)
• Add error message when NLopt AUGLAG algorithms are used without local_method (#1026) (@ChrisRackauckas-Claude)
• General test fixes (#1028) (@ChrisRackauckas)
• Fix MOI Symbolic writing and docs (#1029) (@ChrisRackauckas)
• Omit known broken Enzyme Hessian-free AD test (#1031) (@ChrisRackauckas)
• CompatHelper: add new compat entry for ADTypes at version 1 for package docs, (keep existing compat) (#1032) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationManopt to 1 for package docs, (keep existing compat) (#1033) (@github-actions[bot])
• Fix dependency structure of solvers to OptimizationBase (#1037) (@ChrisRackauckas)
• Bump OptimizationBase requirement to v3 and increment sublibrary versions (#1040) (@ChrisRackauckas-Claude)
• CompatHelper: bump compat for OptimizationBase to 3 for package docs, (keep existing compat) (#1042) (@github-actions[bot])
• Fix dependency structure of OptimizationAuglag (#1046) (@ChrisRackauckas)
• Update OptimizationMultistartOptimization.jl to OptimizationBase backend (#1047) (@ChrisRackauckas)
• Add solve, solve!, init (#1049) (@jClugstor)
• Revert "Add solve, solve!, init" (#1050) (@ChrisRackauckas)
• Complete solve interface migration from SciMLBase to OptimizationBase (#1053) (@ChrisRackauckas-Claude)
• Rewrite the progressbar part of OptimizationOptimisers (#1060) (@prbzrg)
• Add OptimizationMadNLP (#1061) (@SebastianM-C)
• CompatHelper: bump compat for OptimizationNLPModels to 1 for package docs, (keep existing compat) (#1063) (@github-actions[bot])
• CompatHelper: bump compat for Optimization to 5 for package docs, (keep existing compat) (#1064) (@github-actions[bot])
• Better handling of Base method movement (#1066) (@ChrisRackauckas)
• Clean up and update to OptimizationBase@v4 (#1067) (@SebastianM-C)
• Fix NLopt crash with gradient-based algorithms when no AD backend specified (#1068) (@ChrisRackauckas-Claude)
• Bugfix (#1069) (@SebastianM-C)
• Cleanup for OptimizationBase (#1071) (@SebastianM-C)
• Fix deprecated field names in MultistartOptimization result handling (#1072) (@ChrisRackauckas-Claude)
• Fix LBFGS/BFGS callback receiving Dual numbers instead of scalar loss values (#1075) (@ChrisRackauckas-Claude)
• Use the current OptimizationBase instead of the release (#1080) (@SebastianM-C)
• Skip gradient updates when gradients contain NaN or Inf (#1081) (@ChrisRackauckas-Claude)
• shorten the OptimizationMadNLP tests (#1082) (@SebastianM-C)
• Continue fixing CI (#1083) (@SebastianM-C)
• Fix OptimizationMadNLP version (#1084) (@SebastianM-C)
• add missing bumps (#1086) (@SebastianM-C)
• Fix OptimizationIpopt & OptimizationMOI with OptimizationBase@v3 (#1087) (@SebastianM-C)
• Implement solve_up for SciMLSensitivity hooks (#1088) (@jClugstor)
• fix Downgrade CI (#1089) (@SebastianM-C)
• Add explicit allowscallback everywhere (#1090) (@SebastianM-C)
• bump versions (#1091) (@SebastianM-C)
• Bump actions/checkout from 4 to 6 (#1096) (@dependabot[bot])
• Fix docs (#1097) (@SebastianM-C)
• CompatHelper: add new compat entry for DifferentiationInterface at version 0.7 for package docs, (keep existing compat) (#1099) (@github-actions[bot])
• CompatHelper: add new compat entry for OptimizationPyCMA at version 1 for package docs, (keep existing compat) (#1100) (@github-actions[bot])
• Fix false convergence when LBFGSB encounters Inf/NaN at bounds (issue #1094) (#1102) (@ChrisRackauckas-Claude)
• Bump actions/cache from 4 to 5 (#1106) (@dependabot[bot])
• refactor: update to MTKv11 (#1107) (@AayushSabharwal)
• build: bump minor versions for packages changed in MTKv11 update (#1108) (@ChrisRackauckas-Claude)
• build: bump OptimizationIpopt, OptimizationMOI, OptimizationMadNLP to v1.0 (#1109) (@ChrisRackauckas-Claude)
• CompatHelper: bump compat for OptimizationIpopt to 1 for package docs, (keep existing compat) (#1113) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationMadNLP to 1 for package docs, (keep existing compat) (#1114) (@github-actions[bot])
• CompatHelper: bump compat for ModelingToolkit to 11 for package docs, (keep existing compat) (#1115) (@github-actions[bot])
• CompatHelper: bump compat for Symbolics to 7 for package docs, (keep existing compat) (#1116) (@github-actions[bot])
• CompatHelper: bump compat for OptimizationMOI to 1 for package docs, (keep existing compat) (#1117) (@github-actions[bot])
• Bump minimum SciMLBase compat to 2.130.0 to fix Downgrade CI (#1118) (@ChrisRackauckas-Claude)
• Documentation improvements: fix typos and add missing package pages (#1120) (@ChrisRackauckas-Claude)
• CompatHelper: bump compat for NLPModels to 0.22 for package docs, (keep existing compat) (#1121) (@github-actions[bot])
• Add precompilation workload to OptimizationBase (#1122) (@ChrisRackauckas-Claude)
• Fix type genericity in constraint Jacobian allocations for BigFloat support (#1123) (@ChrisRackauckas-Claude)
• CompatHelper: add new compat entry for OptimizationLBFGSB at version 1 for package docs, (keep existing compat) (#1124) (@github-actions[bot])
• Add SimpleOptimization.jl to solver pages (#1126) (@ChrisRackauckas-Claude)
• Add OptimizationSimpleOptimization sublibrary (#1127) (@ChrisRackauckas-Claude)
• Switch from JuliaFormatter to Runic.jl for code formatting (#1128) (@ChrisRackauckas-Claude)

Closed issues:

• Setup BlackBoxOptim.jl and Evolutionary.jl with sciml_train (#4)
• Hook sciml_train into MOI (#3)
• Roadmap (#2)
• Add CMAEvolutionStrategy (#7)
• Add objective sense into the front-end (#8)
• NLopt optimiser does not call objective function (#11)
• kwargs only used for Optim.AbstractOptimizer (#13)
• Iterations, f(x) calls, ∇f(x) calls incorrect (#15)
• Register (#16)
• Multi objective optimization (#18)
• Improve show methods for OptimizationFunction and OptimizationProblem (#25)
• Add OptimizationProblem constructor for f::OptimizationFunction (#26)
• Support IPNewton from Optim (#28)
• Add MTK hook (#32)
• add Flux optimisers (#36)
• Fix withprogress (#42)
• Expand docstrings (#51)
• Add a thread-safe version of AutoForwardDiff (#53)
• cons_j should be using the jvp form (#54)
• Stochastic results (#58)
• Rosenbrock with non-linear constraints (#59)
• Maxiter does not except scientific e notation (#63)
• Add support for save_best keyword with ADAM optimizer with sciml_train (#67)
• Can't get NLopt to work (#70)
• New return struct (#72)
• TagBot trigger issue (#75)
• Add an abstraction for chaining optimizers (#78)
• Add NLopt optimizers to documentation (#86)
• NLopt algorithms missing from the documentation (#93)
• MultistartOptimization.jl missing from the documentation (#94)
• Tutorial on some advanced MTK things (#96)
• Optimizer documentation style (#97)
• Could not find cudnn (#100)
• Tutorials in docs (#104)
• Uniform solution type (#106)
• AutoModelingToolkit not working (#109)
• Re-enable BlackBoxOptim test (#111)
• Feature request: Differentiable optimizers (#112)
• Documenting call signatures for passed grad, hes, etc. (#116)
• Optimization summary is gone? (#120)
• Linking Nonconvex.jl (#123)
• Pre-compile issues (#125)
• ReverseDiff over Zygote to differentiate neural network using GalacticOptim - Dimension mismatch (#126)
• Add support for constraints for the other AD backends (#130)
• minibatch tutorial not working with Fminbox (#133)
• Speed up precompilation (#136)
• Error requiring Flux from GalacticOptim (#141)
• Document MOI Optimizers (#143)
• Specialize MOI Optimizers on symbolic information of AutoModelingToolkit (#145)
• Support MAX_SENSE in the MOI wrapper (#148)
• Wrap SpeedMapping.jl (#152)
• Max-sense for NLopt and Optim (#155)
• Interface NOMAD.jl (#157)
• UndefVarError: AutoZygote not defined (#158)
• No arguments are passed to Nlopt.jl optimisers (#159)
• Common return code (#161)
• Common interface design (#162)
• MOI throws error with EAGO.jl (#167)
• Cannot set lower and upper bound for SimulatedAnnealing OptimizationProblem (#171)
• Automatically use Fminbox wrapping if OptimizationProblem has bounds with Optim optimisers (#172)
• Returning minimizing parameters for Flux optimizers when maxiters is reached (#178)
• Handling of box constraints for Optim.ParticleSwarm (#179)
• Arbitrary constraints (#185)
• Allow callback to stop the optimization (#188)
• Support for different AD for constraints and objective (#191)
• UndefVarError: AutoForwardDiff not defined (#193)
• GalacticOptim with AmplNLWriter optimizer (#194)
• Constraints being ignored (#195)
• LBFGS Stopping criteria (#196)
• solve callback parameter ignored by NLopt solvers (#199)
• Example with evolution algorithm fails (#204)
• NOMAD: Undefined f (#206)
• Help with no method matching length (#209)
• Add checks for required arguments in the optimiser specific __map_optimizer_args and throw informative error messages (#210)
• Local optimisation explodes in memory requirements (#211)
• Compatibility with MOI v1 (#214)
• Basic ForwardDiff example in docs not working (#216)
• Error with Ipopt and specification of lb, ub (#221)
• Error with Ipopt through Nonconvex (#223)
• ERROR: LoadError: MethodError: no method matching iterate(::Nothing) (#224)
• Remove AutoModelingToolkit constraint building hacks (#238)
• Removing some heavier dependencies (#239)
• callback ignored for GalacticCMAEvolutionStrategy (#242)
• Finishing sparsity support (#244)
• compiled tape ReverseDiff (#245)
• instantiate_function: MethodError no method matching OptimizationFunction (#251)
• Change from Flux to Optimisers (#254)
• Fix type hierarchy (#258)
• Documentation not working (#267)
• Rename every use of old names to new names (#268)
• Hessian coloring (#269)
• OptimizationSpeedMapping isn't registered (#271)
• Pass expression graph to MOI (#272)
• Update derivative matrices' structure functions in MOI for sparse case (#273)
• OptimizationMOI fails tests on Julia 1.6 (#275)
• Minibatch example throws error (#279)
• Updates from GalaticOptim (#281)
• Do some sanity checks for OptimizationProblem's fields (#282)
• Sparse handling in MOI is broken and untested (#283)
• Error when running Code in documentation (#286)
• Clarification on lcons/ucons/sense in OptimizationProblem documentation (#291)
• Broken reference to Optimisers.jl in docs (#301)
• How does Optimization.jl relate to JuMP.jl (#308)
• Move all of the AD overloads to subpackages instead of Requires (#309)
• Algorithm traits and high level error throwing (#310)
• Adjustments to the OptimizationMultistartOptimization.jl documentation (#313)
• Support mixing manually defined functions with AD backends (#314)
• OptimizationFunctions are instantiated as out-of-place without constraints (#316)
• Precache the ForwardDiff, ReverseDiff, and FiniteDiff caches (#320)
• NOMADOpt: libnomadInterface not defined in doc example (#322)
• QuadDIRECT installation fails (#326)
• Maxiters not respected (#335)
• Manually defined constraint jacobian does not get parameters passed (#338)
• Ipopt gets dense jacobians even if sparse jacobian functions are provided (#339)
• instantiate_function converts sparse matrix to Float (#341)
• Manual Hessian of Lagrangian function (#343)
• Segfault with NLopt (#344)
• Reuse of Ipopt.Optimizer() errors (#347)
• Inconsistent result different julia versions (#348)
• Optimization crashes Julia 1.8. (#349)
• NonConvex package manager (#350)
• init interface for reduced overhead in repeated solves (#352)
• Rosenbrock interior point newton tutorial fails (#357)
• error with complex number u0 in OptimizationOptimisers (#364)
• Support for MathOptInterface.AbstractOptimizer that do not support MathOptInterface.NLPBlock (#369)
• Ignore this please (#370)
• What is PolyOpt()? (#375)
• Parallelize local optimizations with MultistartOptimization (#377)
• DiffResult (#378)
• Method error in Rosetta-OPF on latest releases (#379)
• Getting incorrect error msgs (#392)
• BBO Unsupported keyword argument "NThreads" (#398)
• AutoModelingToolkit should be done via a ModelingToolkit.modelingtoolkitize only (#401)
• No compat bounds leading to incompatible versions (#418)
• Error when using callback function and Ipopt (#421)
• Make sure that all values are Float64 else AmplWriter fails (#422)
• Unclear usage of batches (#433)
• [Question] OptimizationFunction of univariate f(u) (#440)
• Report solve_time in solution (#441)
• Export SciMLBase.ReturnCode instead of symbol (#444)
• Wrap LsqFit.jl and LeastSquaresOptim.jl to replace DiffEqParamEstim implementation (#447)
• OptimizationProblem docstring (#449)
• ReturnCodes from NLopt are not properly converted (#455)
• UndefVarError: DefaultOptimizationCache not defined (#456)
• Objective passed to NelderMead callback does not match computed objective (#458)
• Nonlinear constraints for NlOpt solvers are not supported (#463)
• Pass options to Evolutionary Solvers (#464)
• Evolutionary.ES() broken? (#467)
• Optmization.ji Optimization.solve is not working (#470)
• MOI integer variable handling is incorrect (#475)
• Lion isn't in OptimisersOptimizers (#479)
• Maximizer or Minimizer (#484)
• EnsembleProblem support (#491)
• Documentation callbacks. (#498)
• Provide new initial point without redefining the optimization problem (#500)
• ERROR: MethodError: no method matching Float64(::ForwardDiff.Dual{ForwardDiff.Tag{ when attempting to use AD whil recording values (#501)
• Add description and usage example of reinit (#502)
• OptimizationOptimJL@v0.1.6 need a compat bound for Optimization@v.3.13 (#504)
• Bounds + maxiters breaks BFGS (#508)
• Document EnzymeAD (#522)
• Add more polyalgorithms such as mixture of global (BBO/CMAES/...) and first order and second order optimizers (#523)
• Document problems of more types than non-linear optimization problems only (#525)
• Error messages with integer constraint vectors (#528)
• Vector based modeling not supported. (#531)
• InvalidSystemException error in Rosetta-OPF on latest releases (#537)
• very easy to get bit by callbacks when there is a mismatch in the args of the callback function and the return of the loss (#538)
• OptimizationZygoteExt and OptimizationReversediffExt broken w/ Julia <1.9 (#542)
• AutoForwardDiff is not recognized as AbstractADType (#546)
• Have to specify derivatives for Optim.ZerothOrderOptimizer with bounds (#548)
• Error in an example in documentation (#555)
• Default wrapping of Optim algorithms in Fminbox incase of box constraints necessitates gradient (#558)
• Missing parameters in call to instantiate_function (#559)
• Bump compat for Enzyme.jl to 0.11.2 or higher (#564)
• Error with AutoZygote in OptimizationFunction after Julia version upgrade to 1.9.2 (#571)
• Prevent printing when using CMAEvolutionStrategyOpt solver (#572)
• Is it possible to set the parameter "min_mesh_size" of the the NOMAD algorithm when calling from Optimization.jl ? (#573)
• Precompilation Warnings (#579)
• The help to solve does not explain the result. (#587)
• Enzyme hessian throws a big error (#592)
• Inclusion of PRIMA solvers in Optimization.jl (#593)
• Finding a suitable algorithm to solve my problem (#610)
• Clarify Callback function arguments (#613)
• Docs job erroring (#614)
• Accessing optimization iteration in callback function (#617)
• a bug in Optimization.jls enzyme extension (#621)
• Provide a way to create OptimizationProblem from NonlinearLeastSquaresProblem (#622)
• No sol.stats for NLopt (#625)
• Optim.jl's IPNewton should not require constraints (#629)
• Enormous unnecessary memory allocation (#638)
• Learning rate decay in callback function (#648)
• Optimisers basic usecase (#653)
• OptimizationMOI 0.2.0, cannot assign Symbolics.Num to MArray (#655)
• Downstream Compat bumps (#669)
• Error when store_trace=true with OptimizationEvolutionary.jl (#683)
• Issue in running OptimizationFunction (#686)
• Latest SciMLBase + Optimization breaks precompile (#692)
• TypeError: in keyword argument linesearch, expected Function (#695)
• Optimiztion.jl does not precompile (#697)
• Add trait for checking if OptimizationFunction is used for derivative based optimizers (#711)
• MethodError: objects of type Nothing are not callable when lb and ub are used with NelderMead (#713)
• PolyesterForwardDiff not loading (#714)
• No documentation for latest release (#718)
• PRIMA lib errors with AutoForwardDiff (#719)
• Support LBFGSB.jl (#722)
• PolyOpt only accept functions without any extra inputs (#728)
• US spelling preferred? (#729)
• Augmented Lagrangian (#731)
• Callback signature doesn't match with the docs for PRIMA (#743)
• BBO always returns retcode Failure (#745)
• ERROR: UndefVarError: NoAD not defined (#747)
• callback-generated stopping criteria no longer work in OptimizationNLopt (#752)
• BFGS fails with user-supplied derivative and bounds (regression in v3.25.0, v3.25.1) (#754)
• OptimizationOptimJL.Optim.BFGS() missing tests for user-supplied derivatives (grad), upper/lower bounds, and the combination (#755)
• Reopen issue 755 : OptimizationOptimJL.Optim.BFGS() missing tests for user-supplied derivatives (grad), upper/lower bounds, and the combination (#760)
• Update OptimizationPRIMA [compat] for PRIMA to 0.2.0 (#768)
• OptimizationOptimJL fails to precompile (#774)
• Disassociate batching from the data arg to solve and remove data (#776)
• Move Sophia from OptimizationOptimisers to src/ (#783)
• Adding a thin wrapper to NLPModels (#790)
• maxtime documentation doesn't mention units (seconds) (#795)
• Optimization.LBFGS fails with MethodError: no method matching take(::Base.Iterators.Cycle{Tuple{OptimizationBase.NullData}}, ::Nothing) (#798)
• Support for MOI.eval_constraint_jacobian_transpose_product (#808)
• docs: index.md: broken html after v3.26 (#834)
• OptimizationFunction cannot return multiple values (#839)
• Should maxiters and epochs be disambiguated? (#842)
• iterating through a DataLoader is still broken (#843)
• epochs calculation should have a floor or ceil to avoid this (#848)
• lbfgsb issue (#855)
• Optimization over 3d Array throws (#859)
• Error in trying to use Optimization.jl for LSTM training based on Lux.jl (#860)
• Incorrect return value classification of FTOL_REACHED from NLopt (#862)
• Nelder Mead asks for gradients (#863)
• Better error message when gradient is required but not available (#865)
• test: test coverage needs improvement for the ./src/utils.jl file (#868)
• maxtime errors for Evolutionary.jl (#870)
• Expose step size parameters for AutoFiniteDiff (#874)
• Running optimizations with maps as input (#875)
• Optimization algorithm (Adam) not found (#882)
• Error with e.g. Any[] starting condition (#885)
• Solving Ensemble problem requires ensemble algorithm (not the case for other ensemble solves) (#889)
• For ensemble simulations, how do I set different parameter values for each run of the ensemble? (#890)
• Add optimization parameters to OptimiationStsate (#891)
• UndefVarError: maxiters not defined in OptimizationOptimisers (#892)
• OutOfMemory error as Optim.jl interface allocates a hessian for first order methods' (#893)
• Setting Absolute Tolerance for BFGS with Box Constraints (#894)
• Make a release for Optim.jl f_tol deprecation? (#898)
• Type AbstractOptimizationAlgorithm not exported (#900)
• Unhandled stopping condition (#904)
• LBFGS iteration index is always 0? (#907)
• [Docs] Unclear return type from solve, and how to use it (#912)
• Add OptimizationSciPy wrapper package (#917)
• Add OptimizationPyCMA Wrapper Package (#918)
• Adding dual_ftol_rel keyword for NLopt (#922)
• OptimizationMultistartOptimization@0.3 is not registered (#939)
• no method matching keys(::Nothing) when I forget to pass lcons and ucons to a constrained problem (#959)
• Error when store_trace = true with OptimizationOptimJL (#990)
• Optimization algorithms should be SciMLBase.AbstractSciMLAlgorithm? (#992)
• OptimizationOptimisers doesn't store parameters p into OptimizationState (#995)
• Sophia: undefined reference to rand! (#1004)
• The progress bar gets reset at each epoch for OptimizationOptimisers (#1018)
• Inconsistent Behavior Related to NLopt (#1020)
• Deploy stable and dev online documentation (#1027)
• Improve return codes from OptimizationManopt (#1034)
• Optimization.LBFGS errors with Float32 (#1039)
• OptimizationMOI fails to init problems (#1054)
• OptimizationOptimJL fails to precompile (#1055)
• OptimizationBase (v2) fails to precompile (#1056)
• [ERROR] @logprogress must be used inside @withprogress or with _id keyword argument (#1059)
• OptimizationPRIMA v0.3.2 fails to precompile (#1062)
• 1 dependency had output during precompilation (#1065)
• Did Optimization v5 break Optimization v4 somehow? (#1070)
• (L-)BFGS with bounds reports negatives loss to callback (#1073)
• OptimizationLBFGSB.LBFGSB() produces wrong results with retcode: Success (#1094)
• OptimizationOptimJL fails to precompile in Julia 1.10- 1.12 (tested) (#1098)