Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SYSTEMDS-2686] Compressed overlapping column groups #1080

Merged
merged 1 commit into from Oct 19, 2020

Conversation

Baunsgaard
Copy link
Contributor

[SYSTEMDS-2686] Compressed overlapping column groups

This commit change the compressed right multiplication to perform in
compressed space, resulting in significantly faster execution.
The technique employed results in overlapping column groups, that contain
partial results of the matrix multiplication.
The downside is that some operations that previously was possible on
compressed space no longer works, for the overlapping column groups.

To still support all the operations, then decompression is used for
cases where it is impossible to execute on the compressed matrices.

Another addition is that statistics now contain compression and
decompression times if compression is enabled.

This commit change the compressed right multiplication to perform in
compressed space, resulting in significantly faster execution.
The technique employed results in overlapping column groups, that contain
partial results of the matrix multiplication.
The downside is that some operations that previously was possible on
compressed space no longer works, for the overlapping column groups.

To still support all the operations, then decompression is used for
cases where it is impossible to execute on the compressed matrices.

Another addition is that statistics now contain compression and
decompression times if compression is enabled.

Furthermore the tests have been extended to include tests for the
overlapping resulting in + 10000 tests in compression now.
@Baunsgaard Baunsgaard merged commit 472d778 into apache:master Oct 19, 2020
@github-pages github-pages bot temporarily deployed to github-pages October 19, 2020 09:36 Inactive
@Baunsgaard Baunsgaard deleted the C-MMR branch October 19, 2020 13:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
1 participant