|
What is the Gram-Schmidt projection formula for gradients? |
Answered by
Ultron09
Aug 28, 2026
Replies: 1 comment
|
g_proj = g - sum_k ((g . u_k) / ||u_k||^2) * u_k where u_k are basis vectors spanning the memory subspace. |
0 replies
Answer selected by
Ultron09
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
g_proj = g - sum_k ((g . u_k) / ||u_k||^2) * u_k where u_k are basis vectors spanning the memory subspace.