Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tested efficient sparse apriori version #329 #404

Merged
merged 5 commits into from
Jul 3, 2018

Conversation

DanielMorales9
Copy link
Contributor

Description

Improved memory efficiency for apriori algorithm when SparseDataFrame is passed as a input

Related issues or pull requests

#329

@pep8speaks
Copy link

pep8speaks commented Jun 29, 2018

Hello @DanielMorales9! Thanks for updating the PR.

Line 77:12: E127 continuation line over-indented for visual indent
Line 80:12: E127 continuation line over-indented for visual indent
Line 94:16: E127 continuation line over-indented for visual indent
Line 97:16: E127 continuation line over-indented for visual indent

Comment last updated on July 02, 2018 at 16:45 Hours UTC

@coveralls
Copy link

coveralls commented Jun 30, 2018

Coverage Status

Coverage increased (+0.03%) to 91.358% when pulling 8d3aba4 on DanielMorales9:master into 470224e on rasbt:master.

@rasbt
Copy link
Owner

rasbt commented Jul 2, 2018

That's awesome, thanks a lot for the PR!

  • Could you remove the pytest cache directory ( .pytest_cache/v/cache/nodeids) from the commit? (please feel free to add .pytest_cache/ to the gitignore file)
  • Add a short note to the changelog file
  • Change df : pandas DataFrame to df : pandas DataFrame or SparseDataFrame in the docstring

That would be awesome

@rasbt
Copy link
Owner

rasbt commented Jul 3, 2018

THat's great, thx a lot!

@rasbt rasbt merged commit 02a9d4e into rasbt:master Jul 3, 2018
@jaksmid
Copy link

jaksmid commented Jul 12, 2018

I am sorry that I am a bit late to the conversation but regarding the PR, what is the added benefit of the PR compared to the sparse example that is already on the MLxtend page?
http://rasbt.github.io/mlxtend/user_guide/frequent_patterns/apriori/#example-3-sparse-representation

The MLxtend already supported the sparse dataframes in the apriori.py.

@DanielMorales9
Copy link
Contributor Author

It was not memory efficient

@jaksmid
Copy link

jaksmid commented Jul 12, 2018

Sorry, my bad, I didn't notice that the SparseDataframe was transformed to non sparse values.
Disregard my comment then.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants