use np.linalg.lstsq to _optimize?

[yigaza]

def _optimize(self, alpha: float, lr: float, n_iter: int) -> np.ndarray:
try:
return np.linalg.lstsq(self.mutual_ics[:self.size, :self.size],self.single_ics[:self.size])[0]
except:
return self.weights[:self.size];

very fast

[xuehongyanL]

That's a good shoot! Have you assessed the impact on final results?

[yigaza]

I obtained similar results. But omit alpha*loss_l1 may be bad idea?

[xuehongyanL]

Thank you for your insightful suggestion. We'll make a decision after further evaluations.

[xuehongyanL]

After careful assessment, we have found that l1 regularization has such a significant impact on the stability of the model that we cannot adopt this optimization as default. However, we have implemented it as an optional feature. Thank you for your contribution to this project, once again.