Skip to content

CPDataKit v0.3.0

Choose a tag to compare

@17636365690 17636365690 released this 29 Aug 17:05
· 10 commits to main since this release
ff00fa2

CPDataKit v0.3.0 - Safer HDF5 workflows and practical inspection

CPDataKit 0.3.0 brings the reliability and scale work from the maintenance cycle into one release.
The existing default workflow stays familiar while large files, metadata, and external inputs become
easier to inspect.

Highlights

  • Read selected HDF5 fields or iterate over bounded chunks without loading the full table.
  • Opt into record-axis storage chunking and use the included benchmark for 100k- and 1M-record cases.
  • Validate HDF5 envelopes, embedded schemas, hashes, and provenance; writes remain atomic.
  • Inspect CSV, JSON, CPDataKit HDF5, and selected DAMASK DADF5 inputs from the CLI.
  • Produce HTML, Markdown, or canonical JSON reports with validation findings and descriptive statistics.
  • Use the read-only DAMASK DADF5 adapter and the hash-verified Surfalex HF Workflow 7A reference.
  • Preserve nested metadata on Dataset copies and immutable schema conventions in Python and JSON output.
  • Extend CI coverage across Python 3.10-3.13, lower-bound dependencies, clean-wheel smoke checks, and CodeQL.

Verification

The release tree passes the Ubuntu/Windows Python 3.10-3.13 CI matrix, lower-bound dependency tests,
Ruff checks, reproducible distribution checks, wheel smoke tests, and CodeQL analysis.