parallel processing #72

josef-pkt opened this Issue Sep 21, 2011 · 1 comment


None yet

1 participant


just some thoughts

do we use joblib?

Alexandre rewrote the permutation t-test to use joblib.

Problems on Windows

see especially Robert's comments

cost of creating new process on Windows:
my guess: if each new process needs to import scipy.stats, then there is not much point to multiprocessing on Windows.
correct or not? (example would be an rvs from scipy.stats.distributions)


added joblib in #111

for discussion

conclusion was
importing joblib from scikit-learn is slow
needs at least a few seconds of calculations to pay for the extra cost

@josef-pkt josef-pkt closed this May 2, 2012
@josef-pkt josef-pkt added a commit to josef-pkt/statsmodels that referenced this issue Jul 17, 2013
@josef-pkt josef-pkt REF: numdiff add lower bound on epsilon, closes #72 6bc9e2b
@PierreBdR PierreBdR pushed a commit to PierreBdR/statsmodels that referenced this issue Sep 2, 2014
@josef-pkt josef-pkt REF: numdiff add lower bound on epsilon, closes #72 9f6442e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment