Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

out of memory issue #300

Closed
rajatsaxena opened this issue Dec 24, 2020 · 2 comments · Fixed by #595
Closed

out of memory issue #300

rajatsaxena opened this issue Dec 24, 2020 · 2 comments · Fixed by #595

Comments

@rajatsaxena
Copy link
Contributor

I am using 128channel UCLA silicon probes to record for ~5hours, and the final output binary file is of the order of 140GB. I am running into memory issues. I have 64GB RAM and 8GB GPU. Here is the error output:

9471.83 sec, 5401 / 8421 batches, 154 units, nspks: 7777541.0000, mu: 17.1072, nst0: 2342 
9498.16 sec, 5501 / 8421 batches, 154 units, nspks: 7872951.0000, mu: 17.1072, nst0: 7256 
Out of memory. Type HELP MEMORY for your options.

Error in trackAndSort (line 185)
        fWpc(:,:,2*size(st3,1)) = 0;

Error in runTemplates (line 34)
[rez, st3, fW,fWpc] = trackAndSort(rez, iorder);

Error in learnAndSolve8b (line 39)
rez         = runTemplates(rez);

Error in main_kilosort_VR8_fullRecording (line 46)
rez = learnAndSolve8b(rez, iseed)
@marius10p
Copy link
Contributor

We normally don't have problems with recordings of up to 30 mil spikes and with less RAM. Can you monitor your RAM useage to see where it's going? Are you on a Linux machine?

@rajatsaxena
Copy link
Contributor Author

this got resolved in ks3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants