Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[r] Out-of-memory issues on cellxgene_census R acceptance tests #2463

Open
johnkerl opened this issue Apr 22, 2024 · 2 comments
Open

[r] Out-of-memory issues on cellxgene_census R acceptance tests #2463

johnkerl opened this issue Apr 22, 2024 · 2 comments
Assignees

Comments

@johnkerl
Copy link
Member

This may, of course, be a bug within cellxgene_census. However, the Python and R APIs should be working similarly enough that if one API is not OOMing and another is OOMing, on the same dataset and query pattern, there is likely either a TileDB-SOMA code flaw or a TileDB-SOMA documentation flaw.

Reported by @ebezzi.

@johnkerl
Copy link
Member Author

@ebezzi were these resolved by adding rm and gc calls to your R test cases?

@ebezzi
Copy link
Member

ebezzi commented May 16, 2024

Yeah, that specific test was fixed via rm+gc. There is still a test that sometimes fails because of OOM (test_seurat_common-cell-type-large-buffer-size), and it's not a garbage collection issue since this test loads everything in memory. We'll monitor and see how frequent the failures are, and worst case we'll lower the limit of queried cells (right now it's 15M).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants