Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory error on a 6 hour 64 channel recording #227

Closed
KaiserArndt2 opened this issue Sep 1, 2020 · 2 comments · Fixed by #595
Closed

Memory error on a 6 hour 64 channel recording #227

KaiserArndt2 opened this issue Sep 1, 2020 · 2 comments · Fixed by #595

Comments

@KaiserArndt2
Copy link

KaiserArndt2 commented Sep 1, 2020

When trying to run KS2 I can't get past learnAndSolve8b. I have tried modifying the ops.NT in config file (using values ranging from 16 X 1024 to 128 X 1024), all attempts have ended in memory errors at the learnAndSolve8b step. I have seen thread 135 about possibly cutting the recordings or template matching and neither of those options work for us. I was hoping you would have a solution to this memory error.

Thanks,
Kaiser

@JoseGuzman
Copy link
Contributor

JoseGuzman commented Sep 8, 2020

I'm not sure that it's related to issue #135. It happens also to me with smaller data. It may be also related to issue #218?

I think it happens when some batches are not having spikes at all - e.g. recordings with very spurious activity or when setting ops.minFR very low (I tend to use 1/600, 1 spike in 600 sampling points). Check #44 (comment) for details.

@marius10p
Copy link
Contributor

What Jose said, try increasing your batch size much more. Also, remember to add ops.ntbuff:

ops.NT = 64*1024+ ops.ntbuff; % must be multiple of 32 + ntbuff. This is the batch size (try decreasing if out of memory).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants