https://www.autodiff.org/Docs/euroad/Trond_Steihaug.pdf describes a bit how it would be done via jvps and hvps, which would mix in AD tricks.
Activity
avik-pal commentedon Feb 18, 2024
Revisiting this seems like Halley should never compute a Hessian in the first place.
It should be done with a HVP. The linear solve can also be done with a krylov method but that is a separate point.