✨ Skrub version 0.10.0 has been released ✨
Main Changes
- New transformers are now available:
SessionEncodergroups timestamped data by sessions,DropSimilarhelps with dropping redundant columns. ToFloatnow includesdecimalandthousandas parameters to parse numerical columns that use formatting different from the python default (such as "1 234,5").- The
TableReportcan now be exported in text format (Markdown formatting), or as a dictionary. - DataOps have been improved with better caching, as well as easier access and search of nodes in the graph. It is also possible to filter which columns are shown in the parallel coordinate plot.
In detail
TableReport
- A summarized version of the
TableReportcan now be exported in Markdown. By @rcap107 in #2048 - The
TableReportcan now be exported as a dictionary. By @m4nn2609-dot in #2188 - It is now possible to specify how many rows should be shown by the
TableReportvia thetable_report_n_rowsconfiguration option. By @m4nn2609-dot in #2193
Transformers
- The
SessionEncoderis now available. This encoder adds asession_idcolumn that groups together events that happen within the same session gap. Events can also be grouped by a column or list of columns to distinguish between users or devices (for example). By @rcap107 in #1930 - The
ToFloattransformer now allows to specifydecimalandthousandseparators to parse numerical columns that use formatting different from the default (such as "1 234,5"). Additionally, negative numbers indicated in parentheses are converted to negative numbers ("(135)" becomes "-135"). By @gabrielapgomezji in #1772 - The HTML diagram of skrub estimators now includes a link to the online documentation. By @rcap107 in #2036
- A new transformer,
DropSimilar, allows dropping columns that are strongly correlated with each other. By @emassoulie in #2023
Data Ops
- Dataop nodes now have a unique ID. This makes it easier to search for specific nodes in the DataOp to extract and set their values. By @jeromedockes in #2062, #2090, #2194
- It is now possible to set the variable preview values on a DataOp. By @jeromedockes in #2081
skrub.varnow has thebecomes_defaultparameter, to indicate that the provided previewvalueshould be treated as a default for this variable in all contexts. By @jeromedockes in #2082- Predict, predict_proba, etc. are now cached during SkrubLearner.score() by @jeromedockes in #2195
- It is now possible to choose which columns of the parallel coordinate plot are shown. By @jeromedockes in #2202
Bugfixes
- Datetime-based transformers had inconsistent behaviors when they encountered duration columns. This has been fixed by @rcap107 in #2069
- The
TableReportcould not plot dataframes that contained$$as value. This was fixed by @Michenina-Lab in #2154 - Fixed an error in the
TableReportthat occurred when the data range is very narrow. By @jeromedockes in #2189
Misc
- The fetcher for the dataset on electricity forecasting in France has been added by @lisaleemcb in #2013
- The
objectselector has been added toskrub.selectorsby @omkar-334 in #2171
Deprecations/dependencies
- The parameter
order_byof theTableReportis now deprecated by @uniheko in #2101 - Matplotlib's minimum required version has been increased from 3.4.3 to 3.6.1 by @rcap107 in #2159
New Contributors
- @sandrineh made their first contribution in #1908
- @VeraCurly made their first contribution in #2095
- @4navi made their first contribution in #2099
- @AlicjaKo made their first contribution in #2094
- @siddiqua-tamk made their first contribution in #2105
- @uniheko made their first contribution in #2101
- @omkar-334 made their first contribution in #2119
- @aidbar made their first contribution in #2100
- @hafsaelibrahimi made their first contribution in #2151
- @Maryahcee made their first contribution in #2108
- @uju-ds made their first contribution in #2104
- @rajalakshmikr made their first contribution in #2156
- @eve2705 made their first contribution in #2157
- @maureen-githaiga made their first contribution in #2102
- @Michenina-Lab made their first contribution in #2154
- @glitch-ux made their first contribution in #2168
- @m4nn2609-dot made their first contribution in #2188
Full Changelog: 0.9.0...0.10.0