Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement sparse matrices #384

Closed
Markus-Goetz opened this issue Sep 13, 2019 · 3 comments
Closed

Implement sparse matrices #384

Markus-Goetz opened this issue Sep 13, 2019 · 3 comments
Labels
API Anything relating the API enhancement New feature or request GSoC help wanted Extra attention is needed type system

Comments

@Markus-Goetz
Copy link
Member

Feature functionality
Design and implement a distributed sparse DNDarray class. Come up with one or more reasonable storage formats (e.g. COO, CRS, CSC, ...)

Additional context
PyTorch implements COO only at the moment with a very restricted operation set.

Interface design might be inspired by Armadillo and/or SciPy.sprarse

@Markus-Goetz Markus-Goetz added enhancement New feature or request help wanted Extra attention is needed type system API Anything relating the API labels Sep 13, 2019
@Markus-Goetz
Copy link
Member Author

Here is a great paper summarizing formats and operations on sparse tensors. I would go with a COO format first where the set of entries is roughly evenly distributed

http://groups.csail.mit.edu/commit/papers/2016/parker-thesis.pdf

@ClaudiaComito
Copy link
Contributor

CSR addressed in #1028 , thanks @Mystic-Slice

@ClaudiaComito
Copy link
Contributor

ClaudiaComito commented Aug 4, 2023

the ht.sparse module has been implemented by @Mystic-Slice and released with v1.3.0. For the time being it supports distributed CSR matrices and element-wise operations. More work needed.

Related issues: #1039 #1040 #1046 #1043 #1044

@AmirTouilPU has initiated work on distributed COO support, PR #988 is stuck for now.

I'll close this issue for now.


Reviewed within #1109

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
API Anything relating the API enhancement New feature or request GSoC help wanted Extra attention is needed type system
Projects
None yet
Development

No branches or pull requests

4 participants