It is like the pinv in Matlab,
This is useful when solving some equations and then the solution is something like:
(X'X)^(-1)X'y and X'X is invertible.
This may be the solution to some linear regressions (which I encountered in the machine learning course).