Upstream DiffEq Patches

[avik-pal]

DiffEq Patches that need to go through before a proper package release:

• SteadyStateAdjoint can be optimized further to prevent regeneration of the backward pass multiple times in the Operator ([WIP] Optimize Steady State Adjoint SciMLSensitivity.jl#542)
• More sensible termination conditions (See https://github.com/SciML/FastDEQ.jl/blob/main/src/solve.jl). Checking all values for termination is not feasible (and unnecessary) for DEQs. There are 2 things that need to be done here:
  • Either update https://github.com/SciML/DiffEqCallbacks.jl/blob/master/src/terminatesteadystate.jl with additional termination conditions or let these stay here (not sure these are relevant beyond DEQ applications)
  • Expose updating termination condition for DynamicSS (https://github.com/SciML/SteadyStateDiffEq.jl/blob/f700bcbe6c7e8570da8c6554056170dca9e314e6/src/solve.jl#L70)