Repository navigation
CSV Tidy 0.5.0
CSV Tidy 0.5.0
Dates without separators, tab-separated files, per-column formats in profile init,
protection against formulas in exported files, a fix for the local interface, and tooling that
checks what the project claims: types, every supported Python version on Linux, Windows, and
macOS, test coverage, dependency vulnerabilities, and code scanning.
Upgrade notes. Profiles, CLI options, exit codes, and the Python API of 0.4 keep working
unchanged; everything new is opt-in. JSON reports gain transformations.neutralize_formulas
(an empty list when unused). A profile written by 0.5 is still read by 0.4 unless it uses a
tab delimiter, a date format without separators, or neutralize_formulas.
Added
- Date formats without separators, such as
YYYYMMDD(20261231) andDDMMYYYY, for source
and output dates in profiles, options, and the local interface (which listsYYYYMMDD).
They may use only the fixed-width tokensYYYY,MM, andDD;YYYYMDand mixed formats
such asYYYY-MMDDare rejected with an explanation. - Tab-separated files:
delimiter = "\t"in profiles,--delimiter taband
--output-delimiter tab(a tab character or\talso works), a Tab choice in the local
interface, and tab in the guidedprofile init. The single-column hint also recognizes
tabs, and next-step commands spell the option as--delimiter tab. profile initoptions for per-column formats:--column-number-format COLUMN=FORMATand
--column-date-format COLUMN=FORMAT, for files whose columns use different number or date
formats. They are checked before anything is written.- Opt-in neutralization of spreadsheet formulas (CSV injection): values of selected text
columns that start with=,+,-,@, a tab, or a carriage return get a leading',
as OWASP recommends. Select it withneutralize_formulasin[transform],
--neutralize-formulas COLUMN(--no-neutralize-formulasclears it), or Repair:
protect formulas in the local interface; it works in batch processing and the Python
API (Overrides.neutralize_formulas). It runs after normalize and before deduplicate.
Number and date columns cannot be selected. JSON reports gain
transformations.neutralize_formulas;orderand text reports name the step only when
it is selected, and generated profiles write the key only when it is used. - README: status badges, quick links, and screenshots of the local interface in its dark and
light themes (docs/images/). - A code of conduct (Contributor Covenant 2.1), linked from the README and CONTRIBUTING.md and
included in the source distribution. - The new-issue page links questions to Discussions and security reports to private
vulnerability reporting; blank issues stay available for contact requests.
Changed
- Security reports now go through GitHub private vulnerability reporting instead of a
detail-free contact-request issue (SECURITY.md). - Release process:
mainis protected, so a release commit reaches it through a pull request
with passing CI, and the tag points to the resultingmaincommit (docs/RELEASE.md). - Type annotations are checked with mypy in strict mode, locally and in every CI job. The
check found imprecise annotations, which are corrected without any change in behavior; for
exampleOutputError.outcomesis now declared as a tuple ofArtifactOutcome. - CI tests every supported Python version (3.11 to 3.15) on Linux, and Python 3.11 and 3.15 on
Windows and macOS. On macOS the distribution smoke test checks thatcsv-tidy shortcut installrefuses with exit code 2, since shortcuts are made on Windows and Linux only. - CI measures line and branch coverage of the tests (94% when this was added) and fails below
92%. - A dependency audit (pip-audit) checks every package pinned for development and CI against
published vulnerabilities, on pull requests, onmain, and weekly. - CodeQL analyzes the Python code and the local interface's JavaScript with the
security-extendedqueries, on pull requests, onmain, and weekly. - Package metadata: Documentation, Source, and Releases links.
Fixed
- Local interface: a refused request (another origin, a missing session key, or a body that
is not JSON) could reset the connection on Windows before the answer arrived, so the
client saw a network error instead of the refusal. The server now reads the rest of a
refused request's body (up to 1 MB) before it closes the connection.
Verification
- CI on the tagged commit
9e2f064, all passed:
CI (Linux with Python 3.11 to
3.15, Windows and macOS with Python 3.11 and 3.15),
CodeQL, and the
dependency audit. - The wheel and the source distribution were built from
git archive v0.5.0. The wheel passed
scripts/smoke_dist.pyin a fresh environment on Windows 11 with Python 3.13, before upload
and again as downloaded from this release. - SHA-256:
csv_tidy-0.5.0.tar.gz:a7c2a0a002ec41acfc98eefe2661b1e12de4d8fce6fb7029d9ac37912cea4f5ecsv_tidy-0.5.0-py3-none-any.whl:136607587a5e68055c48354ad21a886f85860bd2166ae28bc1c99154720f22f2