Skip to content

0.10.0

Latest

Choose a tag to compare

@rcap107 rcap107 released this 06 Jul 14:24

✨ Skrub version 0.10.0 has been released ✨

Main Changes

  • New transformers are now available: SessionEncoder groups timestamped data by sessions, DropSimilar helps with dropping redundant columns.
  • ToFloat now includes decimal and thousand as parameters to parse numerical columns that use formatting different from the python default (such as "1 234,5").
  • The TableReport can now be exported in text format (Markdown formatting), or as a dictionary.
  • DataOps have been improved with better caching, as well as easier access and search of nodes in the graph. It is also possible to filter which columns are shown in the parallel coordinate plot.

In detail

TableReport

  • A summarized version of the TableReport can now be exported in Markdown. By @rcap107 in #2048
  • The TableReport can now be exported as a dictionary. By @m4nn2609-dot in #2188
  • It is now possible to specify how many rows should be shown by the TableReport via the table_report_n_rows configuration option. By @m4nn2609-dot in #2193

Transformers

  • The SessionEncoder is now available. This encoder adds a session_id column that groups together events that happen within the same session gap. Events can also be grouped by a column or list of columns to distinguish between users or devices (for example). By @rcap107 in #1930
  • The ToFloat transformer now allows to specify decimal and thousand separators to parse numerical columns that use formatting different from the default (such as "1 234,5"). Additionally, negative numbers indicated in parentheses are converted to negative numbers ("(135)" becomes "-135"). By @gabrielapgomezji in #1772
  • The HTML diagram of skrub estimators now includes a link to the online documentation. By @rcap107 in #2036
  • A new transformer, DropSimilar, allows dropping columns that are strongly correlated with each other. By @emassoulie in #2023

Data Ops

  • Dataop nodes now have a unique ID. This makes it easier to search for specific nodes in the DataOp to extract and set their values. By @jeromedockes in #2062, #2090, #2194
  • It is now possible to set the variable preview values on a DataOp. By @jeromedockes in #2081
  • skrub.var now has the becomes_default parameter, to indicate that the provided preview value should be treated as a default for this variable in all contexts. By @jeromedockes in #2082
  • Predict, predict_proba, etc. are now cached during SkrubLearner.score() by @jeromedockes in #2195
  • It is now possible to choose which columns of the parallel coordinate plot are shown. By @jeromedockes in #2202

Bugfixes

  • Datetime-based transformers had inconsistent behaviors when they encountered duration columns. This has been fixed by @rcap107 in #2069
  • The TableReport could not plot dataframes that contained $$ as value. This was fixed by @Michenina-Lab in #2154
  • Fixed an error in the TableReport that occurred when the data range is very narrow. By @jeromedockes in #2189

Misc

  • The fetcher for the dataset on electricity forecasting in France has been added by @lisaleemcb in #2013
  • The object selector has been added to skrub.selectors by @omkar-334 in #2171

Deprecations/dependencies

  • The parameter order_by of the TableReport is now deprecated by @uniheko in #2101
  • Matplotlib's minimum required version has been increased from 3.4.3 to 3.6.1 by @rcap107 in #2159

New Contributors

Full Changelog: 0.9.0...0.10.0