Version v0.32.24
This release brings several performance improvements, new features, and important dependency updates. Notably, it enhances the performance of the find_replace function, introduces new options to data cleaning utilities, and enforces compatibility with the latest pandas version. Several dependencies have also been updated for improved stability and compatibility.
New Features
- Improved performance of
find_replaceby replacing.apply()with the more efficient.map()method, resulting in up to 5.9x speedup on large datasets. Unmapped values are now preserved correctly. (f5d97e, ANUPAM MISHRA) - Added a
strip_whitespaceparameter to theclean_namesfunction, allowing users to optionally remove leading and trailing whitespace from column names. (3a3dd4, Samuel Oranyeli) - Added a
drop_firstparameter to theexpand_columnfunction, enabling users to drop the first category when expanding categorical columns. (7154f4, manav252) - Improved the
expandfunction for polars to avoid potentially expensive schema computations. (048478, Samuel Oranyeli)
Bug Fixes
- Fixed a HealthCheck failure in
test_ecdf_stringby suppressing slow test warnings and adjusting test settings for better compatibility with Hypothesis. (64df4c, mjsr84)
Deprecations
- Enforced dependency on pandas >=3.0.0 and Python >=3.11, ensuring compatibility with the latest pandas release. (ad159d, Raffaele Mancuso)
Dependency Updates
- Bumped
prefix-dev/setup-pixifrom 0.9.5 to 0.10.1. (ae633c, 23b223, c1b57b, dependabot[bot]) - Bumped
actions/checkoutfrom 6 to 7. (b30eed, dependabot[bot]) - Bumped
actions/setup-pythonfrom 6 to 7. (90fdbc, dependabot[bot]) - Bumped
codecov/codecov-actionfrom 6 to 7. (260420, dependabot[bot]) - Bumped
pysparkfrom 3.3.2 to 3.4.4. (4c1ec5, dependabot[bot]) - Bumped
idnafrom 3.7 to 3.15. (a8f700, dependabot[bot])
Documentation
- Made API module headings linkable for improved navigation. (dc0d17, Aarav C. Shah)
Thank you to all contributors for their work on this release!