-
Notifications
You must be signed in to change notification settings - Fork 857
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
add support for newer pandas sparse dataframes in frequent_patterns (#…
…621) * add support for newer pandas sparse dataframes in frequent_patterns SparseDataFrame has been deprecated, pandas now recommands to create standard DataFrames and store sparse Series as SparseArray. This allows to combine both dense and sparse columns. Improve valid_input_check with sparse values; it previously uncompressed the whole dataframe to check for invalid values, which defeats its purpose. It now only checks existing values, which prevents memory error, and is also much faster. Update apriori.ipynb notebook to use the new pandas sparse DataFrame. * use pandas version number to detect new sparse dataframes * limitations on columns of sparse DaraFrame still apply Contrary to what I thought in 0a8fa8f, this issue is still not fixed. * fix bug introduced by commit 22915a8 with empty DataFrame
- Loading branch information
Showing
5 changed files
with
92 additions
and
22 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters