Skip to content

Releases: Breaka84/Spooq

Version 3.3.1

24 Jun 13:43
a7150c8
Compare
Choose a tag to compare
  • [MOD] Add option to store logged cleansed values as MapType (Enum & Threshold based cleansers)
  • [FIX] Fix TOC on PyPi, add more links to PyPi

Version 3.3.0

22 Apr 12:58
Compare
Choose a tag to compare
  • [MOD] (BREAKING CHANGE!) rename package back to Spooq (dropping "2").
    This means you need to update all imports from spooq2.xxx.yyy to spooq.xxx.yyy in your code!
  • [MOD] prepare for PyPi release
  • [REM] drop official support for Spark 2.x (it most probably still works without issues,
    but some tests fail on Spark2 due to different columns ordering and the effort is too high to
    maintain both versions with respect to tests)
  • [REM] drop separate spark package (bin-folder) as pip package can now handle all tests as well

Version 3.2.0

22 Apr 12:13
14adc13
Compare
Choose a tag to compare
  • [MOD] add functionality to log cleansed values into separate struct column (column_to_log_cleansed_values)
  • [MOD] add ignore_ambiguous_columns to Mapper
  • [MOD] log spooq version when importing
  • [ADD] github action to test on label (test-it) or merge into master