Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ERROR: UndefVarError: NoAD not defined #747

Closed
dtxl opened this issue May 17, 2024 · 5 comments · Fixed by #753
Closed

ERROR: UndefVarError: NoAD not defined #747

dtxl opened this issue May 17, 2024 · 5 comments · Fixed by #753
Labels
bug Something isn't working

Comments

@dtxl
Copy link

dtxl commented May 17, 2024 •
edited
Loading

Describe the bug 🐞

Since yesterday the error "LoadError: UndefVarError: NoAD not defined" appears after updating packages.

Expected behavior

Previously, the code did not give this error, it is unclear why it no longer works or what a proper way to code.

Minimal Reproducible Example 👇

The code is extensive, so I can only provide a code fragment here for now

LVC is a Lotka-Volterra competition model

theode_problem = DifferentialEquations.ODEProblem(LVC, u0, tspan, params_guess)

thecost_function  = DiffEqParamEstim.build_loss_objective(theode_problem, 
                                                                DifferentialEquations.AutoTsit5(DifferentialEquations.Rodas5()),
                                                                DiffEqParamEstim.L2Loss(t, noiseDataT),
                                                                Optimization.AutoForwardDiff(), abstol = CAbsTol, reltol = CRelTol,
                                                                maxiters = DMaxIter, verbose = false)

theOptProb  = Optimization.OptimizationProblem(thecost_function, params_guess,
                                                   lb = [OptimLowers1, OptimLowers2], ub = [OptimUppers1, OptimUppers2],
                                                   reltol = ORelTol,
                                                   x_abstol = _x_abstol, x_reltol = _x_reltol, f_abstol = _f_abstol, f_reltol = _f_reltol, g_tol = _g_tol)

params_fit_ = CommonSolve.solve(theOptProb,
                                    Optim.LBFGS(scaleinvH0 = true, alphaguess = LineSearches.InitialHagerZhang(α0 = NaN), linesearch = 
                                    LineSearches.HagerZhang()), allow_f_increases = true,
                                    callback = optimsolve_callback, reltol = SRelTol, maxiters = SMaxIters)

Error & Stacktrace ⚠️

show(err)
1-element ExceptionStack:
LoadError: UndefVarError: `NoAD` not defined
Stacktrace:
  [1] #__init#2
    @ ~/.julia/packages/OptimizationOptimJL/heecd/src/OptimizationOptimJL.jl:93 [inlined]
  [2] __init (repeats 2 times)
    @ ~/.julia/packages/OptimizationOptimJL/heecd/src/OptimizationOptimJL.jl:75 [inlined]
  [3] #init#628
    @ ~/.julia/packages/SciMLBase/SDjaO/src/solve.jl:174 [inlined]
  [4] init
    @ ~/.julia/packages/SciMLBase/SDjaO/src/solve.jl:172 [inlined]
  [5] solve(::OptimizationProblem{true, OptimizationFunction{true, AutoForwardDiff{nothing, Nothing}, DiffEqParamEstim.var"#29#30"{Nothing, typeof(DiffEqParamEstim.STANDARD_PROB_GENERATOR), @Kwargs{abstol::Float64, reltol::Float64, maxiters::Int64, verbose::Bool}, ODEProblem{Vector{Float64}, Tuple{Float64, Float64}, true, Vector{Float64}, ODEFunction{true, SciMLBase.AutoSpecialize, var"#188#236"{Float64, Float64, Int64}, UniformScaling{Bool}, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, typeof(SciMLBase.DEFAULT_OBSERVED), Nothing, Nothing, Nothing, Nothing}, @Kwargs{}, SciMLBase.StandardODEProblem}, CompositeAlgorithm{Tuple{Tsit5{typeof(OrdinaryDiffEq.trivial_limiter!), typeof(OrdinaryDiffEq.trivial_limiter!), Static.False}, Rodas5{0, true, Nothing, typeof(OrdinaryDiffEq.DEFAULT_PRECS), Val{:forward}, true, nothing, typeof(OrdinaryDiffEq.trivial_limiter!)}}, AutoSwitch{Tsit5{typeof(OrdinaryDiffEq.trivial_limiter!), typeof(OrdinaryDiffEq.trivial_limiter!), Static.False}, Rodas5{0, true, Nothing, typeof(OrdinaryDiffEq.DEFAULT_PRECS), Val{:forward}, true, nothing, typeof(OrdinaryDiffEq.trivial_limiter!)}, Rational{Int64}, Int64}}, L2Loss{Vector{Float64}, Transpose{Float64, Matrix{Float64}}, Nothing, Nothing, Nothing}, Nothing, Tuple{}}, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, typeof(SciMLBase.DEFAULT_OBSERVED_NO_TIME), Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing, Nothing}, Vector{Float64}, SciMLBase.NullParameters, Vector{Float64}, Vector{Float64}, Nothing, Nothing, Nothing, Nothing, @Kwargs{allow_f_increases::Bool, reltol::Float64, x_abstol::Float64, x_reltol::Float64, f_abstol::Float64, f_reltol::Float64, g_tol::Float64}}, ::LBFGS{Nothing, InitialHagerZhang{Float64}, LineSearches.HagerZhang{Float64, Base.RefValue{Bool}}, Optim.var"#20#22"}; kwargs::@Kwargs{allow_f_increases::Bool, callback::var"#189#237"{Vector{Float64}, Vector{Float64}}, reltol::Float64, maxiters::Int64})
    @ SciMLBase ~/.julia/packages/SciMLBase/SDjaO/src/solve.jl:96
  [6] FitCommunity(_ispecvector::Int64, _Noisydatadf::DataFrame, _u0::Vector{Float64}, _OptimUppers1::Float64, _OptimUppers2::Float64, _params_guess::Vector{Float64}, _RVector_fitted::Float64, _KVector_fitted::Float64, _tspan::Tuple{Float64, Float64}, _t::Vector{Float64}, _DEAbsTol::Float64, _DERelTol::Float64, _CostAbsTol::Float64, _CostRelTol::Float64, _OptAbsTol::Float64, _OptRelTol::Float64, _SolveAbsTol::Float64, _SolveRelTol::Float64, _SolveMaxIters::Int64, _DEMaxIter::Int64, _Linearize::Bool, _CollectFitIterations::Bool, _DoFitCommunityHeatPlot::Bool, _PlotSize::Int64, _HeatCells::Int64, _CostAbsTolPlot::Float64, _CostRelTolPlot::Float64, _x_abstol::Float64, _x_reltol::Float64, _f_abstol::Float64, _f_reltol::Float64, _g_tol::Float64, _RunOnCluster::Bool)
    @ Main ~/Desktop/workcopy/FitLVCToTreeMig/LVCPE_v0189.jl:4571
  [7] PMain!(Scenario::Int64, runParallel::Bool, RunOnCluster::Bool, OutDatapath::String, InDatapath::String, OutDataFileName::String, InDataFileName::String, InResultpath::String, ResultDatapath::String, theRunID::String, Linearize::Bool, dimi_species::Int64, DEAbsTol::Float64, DERelTol::Float64, CostAbsTol::Float64, CostRelTol::Float64, CostAbsTolPlot::Float64, CostRelTolPlot::Float64, OptAbsTol::Float64, OptRelTol::Float64, _x_abstol::Float64, _x_reltol::Float64, _f_abstol::Float64, _f_reltol::Float64, _g_tol::Float64, _f_tol::Float64, _x_tol::Float64, _g_abstol::Float64, _g_reltol::Float64, SolveAbsTol::Float64, SolveRelTol::Float64, SolveMaxIters::Int64, DEMaxIter::Int64, SteadyStateFactor::Float64, AbsDerivTol::Float64, UnequalZeroTol::Float64, PartOfSteadyState::Float64, SteadyStateEnd::Float64, TestData::Bool, NoOfScenarios::Int64, PlotSize::Int64, acceptableCost::Float64, acceptableParameterRes::Float64, HeatCells::Int64, DoPlot::Bool, DoFitCommunityHeatPlot::Bool, DoHeatmap::Bool, CollectFitIterations::Bool, DoPlotAdaptiveT::Bool, DoPlotTForSpecies::Bool, DoPlotSpecies::Bool, DoRHeatPlot::Bool, DoPlotDerivatives::Bool, DoWriteCommunityDynamics::Bool, DoWriteFittedParams::Bool, DoWriteTestingScenarios::Bool, ShowAttention::Bool, DoPlotParameters::Bool, DoScenarioFit::Bool, AllCorrectK::SharedMatrix{Float64}, AllCorrectR::SharedMatrix{Float64}, AllCorrectSmat::SharedArray{Float64, 3}, AllGuessedK::SharedMatrix{Float64}, AllGuessedR::SharedMatrix{Float64}, AllGuessedSmat::SharedArray{Float64, 3}, AllFittedK::SharedMatrix{Float64}, AllFittedR::SharedMatrix{Float64}, AllFittedSmat::SharedArray{Float64, 3}, AllCollectRKCost_p::SharedMatrix{Float64}, AllCollectSCost_p::SharedMatrix{Float64}, KWellness::SharedMatrix{Float64}, RWellness::SharedMatrix{Float64}, SmatWellness::SharedArray{Float64, 3}, RMSEOneWellness::SharedVector{Float64}, RMSETwoWellness::SharedVector{Float64}, RVSEOneWellness::SharedVector{Float64}, RVSETwoWellness::SharedVector{Float64}, MaxOneWellness::SharedVector{Float64}, MaxTwoWellness::SharedVector{Float64}, MinOneWellness::SharedVector{Float64}, MinTwoWellness::SharedVector{Float64}, FitCostKRWellness::SharedVector{Float64}, FitCostSWellness::SharedVector{Float64}, theNoiseStrength::Float64, experiment::String, theNoise::String)
    @ Main ~/Desktop/workcopy/FitLVCToTreeMig/LVCPE_v0189.jl:5678
  [8] top-level scope
    @ ~/Desktop/workcopy/FitLVCToTreeMig/LVCPE_v0189.jl:6523
  [9] eval
    @ ./boot.jl:385 [inlined]
 [10] include_string(mapexpr::typeof(REPL.softscope), mod::Module, code::String, filename::String)
    @ Base ./loading.jl:2076
 [11] invokelatest(::Any, ::Any, ::Vararg{Any}; kwargs::@Kwargs{})
    @ Base ./essentials.jl:892
 [12] invokelatest(::Any, ::Any, ::Vararg{Any})
    @ Base ./essentials.jl:889
 [13] inlineeval(m::Module, code::String, code_line::Int64, code_column::Int64, file::String; softscope::Bool)
    @ VSCodeServer ~/.vscode/extensions/julialang.language-julia-1.79.2/scripts/packages/VSCodeServer/src/eval.jl:271
 [14] (::VSCodeServer.var"#69#74"{Bool, Bool, Bool, Module, String, Int64, Int64, String, VSCodeServer.ReplRunCodeRequestParams})()
    @ VSCodeServer ~/.vscode/extensions/julialang.language-julia-1.79.2/scripts/packages/VSCodeServer/src/eval.jl:181
 [15] withpath(f::VSCodeServer.var"#69#74"{Bool, Bool, Bool, Module, String, Int64, Int64, String, VSCodeServer.ReplRunCodeRequestParams}, path::String)
    @ VSCodeServer ~/.vscode/extensions/julialang.language-julia-1.79.2/scripts/packages/VSCodeServer/src/repl.jl:276
 [16] (::VSCodeServer.var"#68#73"{Bool, Bool, Bool, Module, String, Int64, Int64, String, VSCodeServer.ReplRunCodeRequestParams})()
    @ VSCodeServer ~/.vscode/extensions/julialang.language-julia-1.79.2/scripts/packages/VSCodeServer/src/eval.jl:179
 [17] hideprompt(f::VSCodeServer.var"#68#73"{Bool, Bool, Bool, Module, String, Int64, Int64, String, VSCodeServer.ReplRunCodeRequestParams})
    @ VSCodeServer ~/.vscode/extensions/julialang.language-julia-1.79.2/scripts/packages/VSCodeServer/src/repl.jl:38
 [18] (::VSCodeServer.var"#67#72"{Bool, Bool, Bool, Module, String, Int64, Int64, String, VSCodeServer.ReplRunCodeRequestParams})()
    @ VSCodeServer ~/.vscode/extensions/julialang.language-julia-1.79.2/scripts/packages/VSCodeServer/src/eval.jl:150
 [19] with_logstate(f::Function, logstate::Any)
    @ Base.CoreLogging ./logging.jl:515
 [20] with_logger
    @ ./logging.jl:627 [inlined]
 [21] (::VSCodeServer.var"#66#71"{VSCodeServer.ReplRunCodeRequestParams})()
    @ VSCodeServer ~/.vscode/extensions/julialang.language-julia-1.79.2/scripts/packages/VSCodeServer/src/eval.jl:263
 [22] #invokelatest#2
    @ ./essentials.jl:892 [inlined]
 [23] invokelatest(::Any)
    @ Base ./essentials.jl:889
 [24] (::VSCodeServer.var"#64#65")()
    @ VSCodeServer ~/.vscode/extensions/julialang.language-julia-1.79.2/scripts/packages/VSCodeServer/src/eval.jl:34
in expression starting at /Users/admin/Desktop/workcopy/FitLVCToTreeMig/LVCPE_v0189.jl:6329

Environment (please complete the following information):

  • Output of using Pkg; Pkg.status()
  [093aae92] BSplineKit v0.17.2
  [336ed68f] CSV v0.10.14
  [5ae59095] Colors v0.12.11
  [861a8166] Combinatorics v1.0.2
  [38540f10] CommonSolve v0.2.4
  [a8cc5b0e] Crayons v4.1.1
  [a93c6f00] DataFrames v1.6.1
  [1130ab10] DiffEqParamEstim v2.2.0
  [0c46a032] DifferentialEquations v7.13.0
  [f6369f11] ForwardDiff v0.10.36
  [38e38edf] GLM v1.9.0
  [50e95529] GeoStatsSolvers v0.7.16
  [a98d9a8b] Interpolations v0.15.1
  [98e50ef6] JuliaFormatter v1.0.56
  [d3d80556] LineSearches v7.2.0
  [4345ca2d] Loess v0.6.3
  [429524aa] Optim v1.9.4
  [7f7a1694] Optimization v3.25.0
  [36348300] OptimizationOptimJL v0.3.0
  [a03496cd] PlotlyBase v0.8.19
  [f0f68f2c] PlotlyJS v0.18.13
  [f2990250] PlotlyKaleido v2.2.4
  [91a5bcdd] Plots v1.40.4
  [2913bbd2] StatsBase v0.34.3
  [f3b207a7] StatsPlots v0.15.7
  [bd369af6] Tables v1.11.1
  [d2c73de3] GR_jll v0.73.5+0
  [8ba89e20] Distributed
  [37e2e46d] LinearAlgebra
  [9a3f8284] Random
  [1a1011a3] SharedArrays
  [10745b16] Statistics v1.10.0
  • Output of using Pkg; Pkg.status(; mode = PKGMODE_MANIFEST)
Status `~/.julia/environments/v1.10/Manifest.toml`
⌅ [47edcb42] ADTypes v0.2.7
  [621f4979] AbstractFFTs v1.5.0
  [1520ce14] AbstractTrees v0.4.5
  [7d9f7c33] Accessors v0.1.36
  [79e6a3ab] Adapt v4.0.4
  [66dad0bd] AliasTables v1.1.3
  [dce04be8] ArgCheck v2.3.0
  [ec485272] ArnoldiMethod v0.4.0
  [7d9fca2a] Arpack v0.5.4
  [4fba245c] ArrayInterface v7.10.0
  [4c555306] ArrayLayouts v1.9.2
  [bf4720bc] AssetRegistry v0.1.0
  [13072b0f] AxisAlgorithms v1.1.0
  [39de3d68] AxisArrays v0.4.7
  [093aae92] BSplineKit v0.17.2
  [aae01518] BandedMatrices v1.7.0
  [198e06fe] BangBang v0.4.2
  [9718e550] Baselet v0.1.1
  [0e736298] Bessels v0.2.8
  [d1d4a3ce] BitFlags v0.1.8
  [62783981] BitTwiddlingConvenienceFunctions v0.1.5
  [ad839575] Blink v0.12.9
  [764a87c0] BoundaryValueDiffEq v5.7.1
  [fa961155] CEnum v0.5.0
  [2a0fbf3d] CPUSummary v0.2.5
  [00ebfdb7] CSTParser v3.4.3
  [336ed68f] CSV v0.10.14
  [49dc2e85] Calculus v0.5.1
  [324d7699] CategoricalArrays v0.10.8
  [d360d2e6] ChainRulesCore v1.23.0
  [7a955b69] CircularArrays v1.4.0
  [fb6a15b2] CloseOpenIntervals v0.1.12
  [aaaa29a8] Clustering v0.15.7
  [5900dafe] CoDa v1.4.0
  [944b1d66] CodecZlib v0.7.4
  [35d6a980] ColorSchemes v3.25.0
  [3da002f7] ColorTypes v0.11.5
  [c3611d14] ColorVectorSpace v0.10.0
  [5ae59095] Colors v0.12.11
  [9cc86067] ColumnSelectors v0.1.1
  [861a8166] Combinatorics v1.0.2
  [a80b9123] CommonMark v0.8.12
  [38540f10] CommonSolve v0.2.4
  [bbf7d656] CommonSubexpressions v0.3.0
  [34da2185] Compat v4.15.0
  [a33af91c] CompositionsBase v0.1.2
  [2569d6c7] ConcreteStructs v0.2.3
  [f0e56b4a] ConcurrentUtilities v2.4.1
  [88cd18e8] ConsoleProgressMonitor v0.1.2
  [187b0558] ConstructionBase v1.5.5
  [d38c429a] Contour v0.6.3
  [adafc99b] CpuId v0.3.1
  [a8cc5b0e] Crayons v4.1.1
  [9a962f9c] DataAPI v1.16.0
  [a93c6f00] DataFrames v1.6.1
⌃ [6cb2f572] DataScienceTraits v0.2.1
  [864edb3b] DataStructures v0.18.20
  [e2d170a0] DataValueInterfaces v1.0.0
  [7806a523] DecisionTree v0.12.4
  [244e2a9f] DefineSingletons v0.1.2
  [bcd4f6db] DelayDiffEq v5.47.3
  [8bb1440f] DelimitedFiles v1.9.1
  [ab46fb84] DensityRatioEstimation v1.2.2
  [85a47980] Dictionaries v0.4.2
  [39dd38d3] Dierckx v0.5.3
  [2b5f629d] DiffEqBase v6.150.0
  [459566f4] DiffEqCallbacks v3.6.2
  [77a26b50] DiffEqNoiseProcess v5.21.0
  [1130ab10] DiffEqParamEstim v2.2.0
  [163ba53b] DiffResults v1.1.0
  [b552c78f] DiffRules v1.15.1
  [0c46a032] DifferentialEquations v7.13.0
  [b4f34e82] Distances v0.10.11
  [31c24e10] Distributions v0.25.108
  [ffbed154] DocStringExtensions v0.9.3
  [fa6b7ba4] DualNumbers v0.6.8
  [4e289a0a] EnumX v1.0.4
  [f151be2c] EnzymeCore v0.7.2
  [460bff9d] ExceptionUnwrapping v0.1.10
  [d4d017d3] ExponentialUtilities v1.26.1
  [e2ba6199] ExprTools v0.1.10
  [c87230d0] FFMPEG v0.4.1
  [7a1cc6ca] FFTW v1.8.0
  [9d29842c] FastAlmostBandedMatrices v0.1.1
  [7034ab61] FastBroadcast v0.2.8
  [9aa1b823] FastClosures v0.3.2
  [442a2c76] FastGaussQuadrature v1.0.2
  [29a986be] FastLapackInterface v2.0.3
  [48062228] FilePathsBase v0.9.21
  [1a297f60] FillArrays v1.11.0
  [6a86dc24] FiniteDiff v2.23.1
  [53c48c17] FixedPointNumbers v0.8.5
  [1fa38f19] Format v1.3.7
  [f6369f11] ForwardDiff v0.10.36
  [069b7b12] FunctionWrappers v1.1.3
  [77dc65aa] FunctionWrappersWrappers v0.1.3
  [de31a74c] FunctionalCollections v0.5.0
  [d9f16b24] Functors v0.4.10
  [38e38edf] GLM v1.9.0
  [46192b85] GPUArraysCore v0.1.6
  [28b8d3ca] GR v0.73.5
  [c145ed77] GenericSchur v0.5.4
⌅ [323cb8eb] GeoStatsBase v0.42.1
⌅ [ad987403] GeoStatsModels v0.2.8
  [50e95529] GeoStatsSolvers v0.7.16
⌃ [e502b557] GeoTables v1.14.1
  [c27321d9] Glob v1.3.1
  [86223c79] Graphs v1.11.0
  [42e2da0e] Grisu v1.0.2
  [cd3eb016] HTTP v1.10.8
  [9fb69e20] Hiccup v0.2.2
  [3e5b6fbb] HostCPUFeatures v0.1.16
  [34004b35] HypergeometricFunctions v0.3.23
  [615f187c] IfElse v0.1.1
  [313cdc1a] Indexing v1.1.1
  [d25df0c9] Inflate v0.1.4
  [22cec73e] InitialValues v0.3.1
  [842dd82b] InlineStrings v1.4.0
  [a98d9a8b] Interpolations v0.15.1
  [8197267c] IntervalSets v0.7.10
  [3587e190] InverseFunctions v0.1.14
  [41ab1584] InvertedIndices v1.3.0
  [92d709cd] IrrationalConstants v0.2.2
  [c8e1da08] IterTools v1.10.0
  [82899510] IteratorInterfaceExtensions v1.0.0
  [1019f520] JLFzf v0.1.7
  [692b3bcd] JLLWrappers v1.5.0
  [97c1335a] JSExpr v0.5.4
  [682c06a0] JSON v0.21.4
  [98e50ef6] JuliaFormatter v1.0.56
  [ccbc3e58] JumpProcesses v9.11.1
  [ef3ab10e] KLU v0.6.0
  [5ab0869b] KernelDensity v0.6.9
  [ba0b0d4f] Krylov v0.9.6
  [5be7bae1] LBFGSB v0.4.1
  [b964fa9f] LaTeXStrings v1.3.1
  [23fbe1c1] Latexify v0.16.3
  [10f19ff3] LayoutPointers v0.1.15
  [50d2b5c4] Lazy v0.15.1
  [5078a376] LazyArrays v1.10.0
  [1d6d02ad] LeftChildRightSiblingTrees v0.2.0
  [2d8b4e74] LevyArea v1.0.0
  [d3d80556] LineSearches v7.2.0
  [7ed4a6bd] LinearSolve v2.30.0
  [4345ca2d] Loess v0.6.3
  [2ab3a3ac] LogExpFunctions v0.3.27
  [e6f89c97] LoggingExtras v1.0.3
  [bdcacae8] LoopVectorization v0.12.170
  [30fc2ffe] LossFunctions v0.11.1
  [1914dd2f] MacroTools v0.5.13
  [d125e4d3] ManualMemory v0.1.8
  [a3b82374] MatrixFactorizations v2.2.0
  [bb5d69b7] MaybeInplace v0.1.2
  [739be429] MbedTLS v1.1.9
  [442fdcdd] Measures v0.3.2
⌅ [eacbb407] Meshes v0.37.5
  [128add7d] MicroCollections v0.2.0
  [e1d29d7a] Missings v1.2.0
  [46d2c3a1] MuladdMacro v0.2.4
  [6f286f6a] MultivariateStats v0.10.2
  [ffc61752] Mustache v1.0.19
  [a975b10e] Mux v1.0.2
  [d41bc354] NLSolversBase v7.8.3
  [2774e3e8] NLsolve v4.5.1
  [77ba4419] NaNMath v1.0.2
  [b8a86587] NearestNeighbors v0.4.16
  [2f6b4ddb] NelderMead v0.4.0
  [8913a72c] NonlinearSolve v3.11.0
  [510215fc] Observables v0.5.5
  [6fe1bfb0] OffsetArrays v1.14.0
  [4d8831e6] OpenSSL v1.4.3
  [429524aa] Optim v1.9.4
  [7f7a1694] Optimization v3.25.0
  [bca83a33] OptimizationBase v0.0.7
  [36348300] OptimizationOptimJL v0.3.0
  [bac558e1] OrderedCollections v1.6.3
  [1dea7af3] OrdinaryDiffEq v6.76.0
  [90014a1f] PDMats v0.11.31
  [65ce6f38] PackageExtensionCompat v1.0.2
  [d96e819e] Parameters v0.12.3
  [69de0a69] Parsers v2.8.1
  [06bb1623] PenaltyFunctions v0.3.0
  [fa939f87] Pidfile v1.3.0
  [b98c9c47] Pipe v1.3.0
  [ccf2f8ad] PlotThemes v3.1.0
  [995b91a9] PlotUtils v1.4.1
  [a03496cd] PlotlyBase v0.8.19
  [f0f68f2c] PlotlyJS v0.18.13
  [f2990250] PlotlyKaleido v2.2.4
  [91a5bcdd] Plots v1.40.4
  [e409e4f3] PoissonRandom v0.4.4
  [f517fe37] Polyester v0.7.14
  [1d0040c9] PolyesterWeave v0.2.1
  [2dfb63ee] PooledArrays v1.4.3
  [85a6dd25] PositiveFactorizations v0.2.4
  [d236fae5] PreallocationTools v0.4.21
  [aea7be01] PrecompileTools v1.2.1
  [21216c6a] Preferences v1.4.3
  [08abe8d2] PrettyTables v2.3.1
  [33c8b6b6] ProgressLogging v0.1.4
  [92933f4c] ProgressMeter v1.10.0
  [43287f4e] PtrArrays v1.1.0
  [1fd47b50] QuadGK v2.9.4
  [94ee1d12] Quaternions v0.7.6
  [74087812] Random123 v1.7.0
  [e6cf234a] RandomNumbers v1.5.3
  [b3c3ace0] RangeArrays v0.3.2
  [c84ed2f1] Ratios v0.4.5
  [c1ae055f] RealDot v0.1.0
  [3cdcf5f2] RecipesBase v1.3.4
  [01d81517] RecipesPipeline v0.6.12
  [731186ca] RecursiveArrayTools v3.19.0
  [f2c3362d] RecursiveFactorization v0.2.23
  [189a3867] Reexport v1.2.2
  [05181044] RelocatableFolders v1.0.1
  [ae029012] Requires v1.3.0
  [ae5879a3] ResettableStacks v1.1.1
  [79098fc4] Rmath v0.7.1
  [6038ab10] Rotations v1.7.0
  [7e49a35a] RuntimeGeneratedFunctions v0.5.13
  [94e857df] SIMDTypes v0.1.0
  [476501e8] SLEEFPirates v0.6.42
  [0bca4576] SciMLBase v2.38.0
  [c0aeaf25] SciMLOperators v0.3.8
  [53ae85a6] SciMLStructures v1.2.0
  [6e75b9c4] ScikitLearnBase v0.5.0
  [6c6a2e73] Scratch v1.2.1
  [91c51154] SentinelArrays v1.4.2
  [efcf1570] Setfield v1.1.1
  [1277b4bf] ShiftedArrays v2.0.0
  [992d4aef] Showoff v1.0.3
  [777ac1f9] SimpleBufferStream v1.1.0
  [727e6d20] SimpleNonlinearSolve v1.8.0
  [699a6c99] SimpleTraits v0.9.4
  [ce78b400] SimpleUnPack v1.1.0
  [a2af1166] SortingAlgorithms v1.2.1
⌃ [47a9eef4] SparseDiffTools v2.18.0
  [e56a9233] Sparspak v0.3.9
  [276daf66] SpecialFunctions v2.4.0
  [03a91e81] SplitApplyCombine v1.2.3
  [171d559e] SplittablesBase v0.1.15
  [aedffcd0] Static v0.8.10
  [0d7ed370] StaticArrayInterface v1.5.0
  [90137ffa] StaticArrays v1.9.4
  [1e83bf80] StaticArraysCore v1.4.2
  [82ae8749] StatsAPI v1.7.0
  [2913bbd2] StatsBase v0.34.3
  [4c63d2b9] StatsFuns v1.3.1
⌅ [c146b59d] StatsLearnModels v0.2.4
  [3eaba693] StatsModels v0.7.3
  [f3b207a7] StatsPlots v0.15.7
  [9672c7b4] SteadyStateDiffEq v2.2.0
  [789caeaf] StochasticDiffEq v6.65.1
  [7792a7ef] StrideArraysCore v0.5.6
  [892a3eda] StringManipulation v0.3.4
  [c3572dad] Sundials v4.24.0
  [2efcf032] SymbolicIndexingInterface v0.3.21
  [ab02a1b2] TableOperations v1.2.0
  [3783bdb8] TableTraits v1.0.1
  [0d432bfd] TableTransforms v1.31.0
  [bd369af6] Tables v1.11.1
  [62fd8b95] TensorCore v0.1.1
  [5d786b92] TerminalLoggers v0.1.7
  [8290d209] ThreadingUtilities v0.5.2
  [a759f4b9] TimerOutputs v0.5.23
  [0796e94c] Tokenize v0.5.29
  [3bb67fe8] TranscodingStreams v0.10.8
  [28d57a85] Transducers v0.4.82
  [28dd2a49] TransformsBase v1.4.1
  [d5829a12] TriangularSolve v0.2.0
  [410a4b4d] Tricks v0.1.8
  [781d530d] TruncatedStacktraces v1.4.0
  [9d95f2ec] TypedTables v1.4.6
  [5c2747f8] URIs v1.5.1
  [3a884ed6] UnPack v1.0.2
  [1cfade01] UnicodeFun v0.4.1
  [1986cc42] Unitful v1.19.1
  [45397f5d] UnitfulLatexify v1.6.3
  [41fe7b60] Unzip v0.2.0
⌃ [04a0146e] Variography v0.22.1
  [3d5dd08c] VectorizationBase v0.21.67
  [19fa3120] VertexSafeGraphs v0.2.0
  [ea10d353] WeakRefStrings v1.4.2
  [0f1e0344] WebIO v0.8.21
  [104b5d7c] WebSockets v1.6.0
  [cc8bc4a8] Widgets v0.6.6
  [efce3f68] WoodburyMatrices v1.0.0
  [76eceee3] WorkerUtilities v1.6.1
⌅ [68821587] Arpack_jll v3.5.1+1
  [6e34b625] Bzip2_jll v1.0.8+1
  [83423d85] Cairo_jll v1.18.0+2
  [cd4c43a9] Dierckx_jll v0.1.0+0
  [2702e6a9] EpollShim_jll v0.0.20230411+0
  [2e619515] Expat_jll v2.6.2+0
⌅ [b22a6f82] FFMPEG_jll v4.4.4+1
  [f5851436] FFTW_jll v3.3.10+0
  [a3f928ae] Fontconfig_jll v2.13.96+0
  [d7e528f0] FreeType2_jll v2.13.1+0
  [559328eb] FriBidi_jll v1.0.14+0
  [0656b61e] GLFW_jll v3.3.9+0
  [d2c73de3] GR_jll v0.73.5+0
  [78b55507] Gettext_jll v0.21.0+0
  [7746bdde] Glib_jll v2.80.2+0
  [3b182d85] Graphite2_jll v1.3.14+0
  [2e76f6c2] HarfBuzz_jll v2.8.1+1
  [1d5cc7b8] IntelOpenMP_jll v2024.1.0+0
  [aacddb02] JpegTurbo_jll v3.0.3+0
  [f7e6163d] Kaleido_jll v0.2.1+0
  [c1c5ebd0] LAME_jll v3.100.2+0
⌅ [88015f11] LERC_jll v3.0.0+1
  [1d63c593] LLVMOpenMP_jll v15.0.7+0
  [dd4b983a] LZO_jll v2.10.2+0
  [81d17ec3] L_BFGS_B_jll v3.0.1+0
⌅ [e9f186c6] Libffi_jll v3.2.2+1
  [d4300ac3] Libgcrypt_jll v1.8.11+0
  [7e76a0d4] Libglvnd_jll v1.6.0+0
  [7add5ba3] Libgpg_error_jll v1.49.0+0
  [94ce4f54] Libiconv_jll v1.17.0+0
  [4b2f31a3] Libmount_jll v2.40.1+0
⌅ [89763e89] Libtiff_jll v4.5.1+1
  [38a345b3] Libuuid_jll v2.40.1+0
  [856f044c] MKL_jll v2024.1.0+0
  [e7412a2a] Ogg_jll v1.3.5+1
  [458c3c95] OpenSSL_jll v3.0.13+1
  [efe28fd5] OpenSpecFun_jll v0.5.5+0
  [91d4177d] Opus_jll v1.3.2+0
  [30392449] Pixman_jll v0.43.4+0
⌅ [c0090381] Qt6Base_jll v6.5.3+1
  [f50d1b31] Rmath_jll v0.4.0+0
⌅ [fb77eaff] Sundials_jll v5.2.2+0
  [a44049a8] Vulkan_Loader_jll v1.3.243+0
  [a2964d1f] Wayland_jll v1.21.0+1
  [2381bf8a] Wayland_protocols_jll v1.31.0+0
  [02c8fc9c] XML2_jll v2.12.6+0
  [aed1982a] XSLT_jll v1.1.34+0
  [ffd25f8a] XZ_jll v5.4.6+0
  [f67eecfb] Xorg_libICE_jll v1.1.1+0
  [c834827a] Xorg_libSM_jll v1.2.4+0
  [4f6342f7] Xorg_libX11_jll v1.8.6+0
  [0c0b7dd1] Xorg_libXau_jll v1.0.11+0
  [935fb764] Xorg_libXcursor_jll v1.2.0+4
  [a3789734] Xorg_libXdmcp_jll v1.1.4+0
  [1082639a] Xorg_libXext_jll v1.3.6+0
  [d091e8ba] Xorg_libXfixes_jll v5.0.3+4
  [a51aa0fd] Xorg_libXi_jll v1.7.10+4
  [d1454406] Xorg_libXinerama_jll v1.1.4+4
  [ec84b674] Xorg_libXrandr_jll v1.5.2+4
  [ea2f1a96] Xorg_libXrender_jll v0.9.11+0
  [14d82f49] Xorg_libpthread_stubs_jll v0.1.1+0
  [c7cfdc94] Xorg_libxcb_jll v1.15.0+0
  [cc61e674] Xorg_libxkbfile_jll v1.1.2+0
  [e920d4aa] Xorg_xcb_util_cursor_jll v0.1.4+0
  [12413925] Xorg_xcb_util_image_jll v0.4.0+1
  [2def613f] Xorg_xcb_util_jll v0.4.0+1
  [975044d2] Xorg_xcb_util_keysyms_jll v0.4.0+1
  [0d47668e] Xorg_xcb_util_renderutil_jll v0.3.9+1
  [c22f9ab0] Xorg_xcb_util_wm_jll v0.4.1+1
  [35661453] Xorg_xkbcomp_jll v1.4.6+0
  [33bec58e] Xorg_xkeyboard_config_jll v2.39.0+0
  [c5fb5394] Xorg_xtrans_jll v1.5.0+0
  [3161d3a3] Zstd_jll v1.5.6+0
  [35ca27e7] eudev_jll v3.2.9+0
⌅ [214eeab7] fzf_jll v0.43.0+0
  [1a1c6b14] gperf_jll v3.1.1+0
  [a4ae2306] libaom_jll v3.9.0+0
  [0ac62f75] libass_jll v0.15.1+0
  [2db6ffa8] libevdev_jll v1.11.0+0
  [f638f0a6] libfdk_aac_jll v2.0.2+0
  [36db933b] libinput_jll v1.18.0+0
  [b53b4c65] libpng_jll v1.6.43+1
  [f27f6e37] libvorbis_jll v1.3.7+1
  [009596ad] mtdev_jll v1.1.6+0
  [1317d2d5] oneTBB_jll v2021.12.0+0
  [1270edf5] x264_jll v2021.5.5+0
  [dfaa095f] x265_jll v3.5.0+0
  [d8fb68d0] xkbcommon_jll v1.4.1+1
  [0dad84c5] ArgTools v1.1.1
  [56f22d72] Artifacts
  [2a0f44e3] Base64
  [ade2ca70] Dates
  [8ba89e20] Distributed
  [f43a241f] Downloads v1.6.0
  [7b1f6079] FileWatching
  [9fa8497b] Future
  [b77e0a4c] InteractiveUtils
  [4af54fe1] LazyArtifacts
  [b27032c2] LibCURL v0.6.4
  [76f85450] LibGit2
  [8f399da3] Libdl
  [37e2e46d] LinearAlgebra
  [56ddb016] Logging
  [d6f4376e] Markdown
  [a63ad114] Mmap
  [ca575930] NetworkOptions v1.2.0
  [44cfe95a] Pkg v1.10.0
  [de0858da] Printf
  [3fa0cd96] REPL
  [9a3f8284] Random
  [ea8e919c] SHA v0.7.0
  [9e88b42a] Serialization
  [1a1011a3] SharedArrays
  [6462fe0b] Sockets
  [2f01184e] SparseArrays v1.10.0
  [10745b16] Statistics v1.10.0
  [4607b0f0] SuiteSparse
  [fa267f1f] TOML v1.0.3
  [a4e569a6] Tar v1.10.0
  [8dfed614] Test
  [cf7118a7] UUIDs
  [4ec0a83e] Unicode
  [e66e0078] CompilerSupportLibraries_jll v1.1.1+0
  [deac9b47] LibCURL_jll v8.4.0+0
  [e37daf67] LibGit2_jll v1.6.4+0
  [29816b5a] LibSSH2_jll v1.11.0+1
  [c8ffd9c3] MbedTLS_jll v2.28.2+1
  [14a3606d] MozillaCACerts_jll v2023.1.10
  [4536629a] OpenBLAS_jll v0.3.23+4
  [05823500] OpenLibm_jll v0.8.1+2
  [efcefdf7] PCRE2_jll v10.42.0+1
  [bea87d4a] SuiteSparse_jll v7.2.1+1
  [83775a58] Zlib_jll v1.2.13+1
  [8e850b90] libblastrampoline_jll v5.8.0+1
  [8e850ede] nghttp2_jll v1.52.0+1
  [3f19e933] p7zip_jll v17.4.0+2
Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. To see why use `status --outdated -m`
  • Output of versioninfo()
Julia Version 1.10.3
Commit 0b4590a5507 (2024-04-30 10:59 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: macOS (x86_64-apple-darwin22.4.0)
  CPU: 12 × Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, skylake)
Threads: 1 default, 0 interactive, 1 GC (on 12 virtual cores)

Additional context
@dtxl dtxl added the bug Something isn't working label May 17, 2024
@ChrisRackauckas
Copy link
Member

@gdalle is this supposed to be living in ADTypes?

@gdalle
Copy link

gdalle commented May 17, 2024

For what it's worth I don't think our recent changes caused this bug, but we could definitely add something like NoAD to ADTypes.jl. Although I would rather call it AutoNothing to respect the naming conventions.

@sjdaines
Copy link
Contributor

MWE showing that this can be triggered by using OptimizationOptim.JL Optim.BFGS(), when using upper/lower bounds:

(NB: Looks like this is a regression introduced in Optimization.jl v3.25.0)

import Optimization
import OptimizationOptimJL

rosenbrock(x, p) = (p[1] - x[1])^2 + p[2] * (x[2] - x[1]^2)^2
optfunc = Optimization.OptimizationFunction(rosenbrock, Optimization.AutoForwardDiff())

x0 = zeros(2)
_p = [1.0, 100.0]

prob  = Optimization.OptimizationProblem(optfunc, x0, _p)
sol = Optimization.solve(prob, OptimizationOptimJL.Optim.BFGS())  # OK

prob_lbub = Optimization.OptimizationProblem(optfunc, x0, _p; lb=[-2.0, -1.0], ub=[2.0, 3.0])
sol = Optimization.solve(prob_lbub, OptimizationOptimJL.Optim.BFGS())  # fails

with stack trace:

ERROR: UndefVarError: `NoAD` not defined
Stacktrace:
 [1] #__init#2
   @ ~/.julia/packages/OptimizationOptimJL/heecd/src/OptimizationOptimJL.jl:93 [inlined]
 [2] __init (repeats 2 times)
   @ ~/.julia/packages/OptimizationOptimJL/heecd/src/OptimizationOptimJL.jl:75 [inlined]
 [3] #init#628
   @ ~/.julia/packages/SciMLBase/SDjaO/src/solve.jl:174 [inlined]
 [4] init
   @ ~/.julia/packages/SciMLBase/SDjaO/src/solve.jl:172 [inlined]
 [5] solve(::SciMLBase.OptimizationProblem{…}, ::Optim.BFGS{…}; kwargs::@Kwargs{})
   @ SciMLBase ~/.julia/packages/SciMLBase/SDjaO/src/solve.jl:96
 [6] solve(::SciMLBase.OptimizationProblem{…}, ::Optim.BFGS{…})
   @ SciMLBase ~/.julia/packages/SciMLBase/SDjaO/src/solve.jl:93
 [7] top-level scope
   @ REPL[50]:1
Some type information was truncated. Use `show(err)` to see complete types.

@sjdaines
Copy link
Contributor

sjdaines commented May 19, 2024 •
edited
Loading

The breaking change is this commit: 3d5d102 PR #741 @Vaibhavdixit02

sjdaines referenced this issue May 19, 2024
@Vaibhavdixit02
Update OptimizationOptimJL.jl
3d5d102
@sjdaines sjdaines mentioned this issue May 19, 2024
Merged
5 tasks
@Vaibhavdixit02 Vaibhavdixit02 mentioned this issue May 19, 2024
Merged
5 tasks
@Vaibhavdixit02
Copy link
Member

@sjdaines you are correct, I don't know how I missed this. Thanks a lot!

This was referenced May 21, 2024
Closed
Closed
sjdaines added a commit to sjdaines/Optimization.jl that referenced this issue May 21, 2024
@sjdaines
Add OptimizationOptimJL.Optim.BFGS() tests for issues 747, 754
764c066 
SciML#754
SciML#747

partially addressing SciML#755

NB: unrelated problem, tests using Optimization.AutoModelingToolkit() were failing,
added code
    @test (sol = solve(prob, Optim.Newton())) isa Any  # test exception not thrown
and similar so exception is caught and other tests run
@sjdaines sjdaines mentioned this issue May 21, 2024
Closed
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

OptimizationOptimJL NoAD fix SciML/Optimization.jl
5 participants
@sjdaines @ChrisRackauckas @dtxl @gdalle @Vaibhavdixit02