Skip to content

CSV Tidy 0.5.0

Choose a tag to compare

@JudikaM JudikaM released this 28 Oct 18:58
· 37 commits to main since this release
9e2f064

CSV Tidy 0.5.0

Dates without separators, tab-separated files, per-column formats in profile init,
protection against formulas in exported files, a fix for the local interface, and tooling that
checks what the project claims: types, every supported Python version on Linux, Windows, and
macOS, test coverage, dependency vulnerabilities, and code scanning.

Upgrade notes. Profiles, CLI options, exit codes, and the Python API of 0.4 keep working
unchanged; everything new is opt-in. JSON reports gain transformations.neutralize_formulas
(an empty list when unused). A profile written by 0.5 is still read by 0.4 unless it uses a
tab delimiter, a date format without separators, or neutralize_formulas.

Added

  • Date formats without separators, such as YYYYMMDD (20261231) and DDMMYYYY, for source
    and output dates in profiles, options, and the local interface (which lists YYYYMMDD).
    They may use only the fixed-width tokens YYYY, MM, and DD; YYYYMD and mixed formats
    such as YYYY-MMDD are rejected with an explanation.
  • Tab-separated files: delimiter = "\t" in profiles, --delimiter tab and
    --output-delimiter tab (a tab character or \t also works), a Tab choice in the local
    interface, and tab in the guided profile init. The single-column hint also recognizes
    tabs, and next-step commands spell the option as --delimiter tab.
  • profile init options for per-column formats: --column-number-format COLUMN=FORMAT and
    --column-date-format COLUMN=FORMAT, for files whose columns use different number or date
    formats. They are checked before anything is written.
  • Opt-in neutralization of spreadsheet formulas (CSV injection): values of selected text
    columns that start with =, +, -, @, a tab, or a carriage return get a leading ',
    as OWASP recommends. Select it with neutralize_formulas in [transform],
    --neutralize-formulas COLUMN (--no-neutralize-formulas clears it), or Repair:
    protect formulas
    in the local interface; it works in batch processing and the Python
    API (Overrides.neutralize_formulas). It runs after normalize and before deduplicate.
    Number and date columns cannot be selected. JSON reports gain
    transformations.neutralize_formulas; order and text reports name the step only when
    it is selected, and generated profiles write the key only when it is used.
  • README: status badges, quick links, and screenshots of the local interface in its dark and
    light themes (docs/images/).
  • A code of conduct (Contributor Covenant 2.1), linked from the README and CONTRIBUTING.md and
    included in the source distribution.
  • The new-issue page links questions to Discussions and security reports to private
    vulnerability reporting; blank issues stay available for contact requests.

Changed

  • Security reports now go through GitHub private vulnerability reporting instead of a
    detail-free contact-request issue (SECURITY.md).
  • Release process: main is protected, so a release commit reaches it through a pull request
    with passing CI, and the tag points to the resulting main commit (docs/RELEASE.md).
  • Type annotations are checked with mypy in strict mode, locally and in every CI job. The
    check found imprecise annotations, which are corrected without any change in behavior; for
    example OutputError.outcomes is now declared as a tuple of ArtifactOutcome.
  • CI tests every supported Python version (3.11 to 3.15) on Linux, and Python 3.11 and 3.15 on
    Windows and macOS. On macOS the distribution smoke test checks that csv-tidy shortcut install refuses with exit code 2, since shortcuts are made on Windows and Linux only.
  • CI measures line and branch coverage of the tests (94% when this was added) and fails below
    92%.
  • A dependency audit (pip-audit) checks every package pinned for development and CI against
    published vulnerabilities, on pull requests, on main, and weekly.
  • CodeQL analyzes the Python code and the local interface's JavaScript with the
    security-extended queries, on pull requests, on main, and weekly.
  • Package metadata: Documentation, Source, and Releases links.

Fixed

  • Local interface: a refused request (another origin, a missing session key, or a body that
    is not JSON) could reset the connection on Windows before the answer arrived, so the
    client saw a network error instead of the refusal. The server now reads the rest of a
    refused request's body (up to 1 MB) before it closes the connection.

Verification

  • CI on the tagged commit 9e2f064, all passed:
    CI (Linux with Python 3.11 to
    3.15, Windows and macOS with Python 3.11 and 3.15),
    CodeQL, and the
    dependency audit.
  • The wheel and the source distribution were built from git archive v0.5.0. The wheel passed
    scripts/smoke_dist.py in a fresh environment on Windows 11 with Python 3.13, before upload
    and again as downloaded from this release.
  • SHA-256:
    • csv_tidy-0.5.0.tar.gz: a7c2a0a002ec41acfc98eefe2661b1e12de4d8fce6fb7029d9ac37912cea4f5e
    • csv_tidy-0.5.0-py3-none-any.whl: 136607587a5e68055c48354ad21a886f85860bd2166ae28bc1c99154720f22f2