Skip to content
This repository was archived by the owner on Jun 13, 2026. It is now read-only.

v1.0.4 — Geo-Compound Blocking & Cardinality Filter

Choose a tag to compare

View all tags
@benzsevern benzsevern released this 06 Apr 18:21
· 8 commits to main since this release
v1.0.4
268c85f

Geo-compound blocking and cardinality filter in column-context config

The pipeline's column-context config builder now produces smarter blocking and matchkey configurations.

What changed

  • Geo-compound blocking: When geo columns exist in pipeline context, blocking keys compound them with name/string columns. Picks lowest-cardinality geo (state > city) for broadest discrimination.
  • Soundex isolation: Soundex passes only apply to name fields — never compound geo+name keys where soundex on "CA" produces meaningless "C000".
  • Cardinality filter: Low-cardinality string columns (e.g., hospital_type with 5 values) are excluded from fuzzy matchkeys to prevent score inflation.
  • Null-safe cardinality: Uses drop_nulls().n_unique() instead of n_unique() which counts null as distinct.
  • Helper extraction: _make_blocking() reduces config duplication across 4 blocking paths.

Install

pip install goldenpipe==1.0.4

Full Changelog: v1.0.3...v1.0.4

Assets 2
Loading