Datasets

Datasets

AXIOM's current dataset path is small, local, and JSONL-focused.

inspect → validate → stats → clean

Commands:

axiom dataset inspect ./data/train.jsonl
axiom dataset validate ./data/train.jsonl
axiom dataset stats ./data/train.jsonl
axiom dataset clean ./data/train.jsonl ./data/train.cleaned.jsonl

Validation checks JSON object structure and duplicates. Statistics report record, field, and rough token counts. Cleaning writes a new file and leaves the source unchanged. None of these commands proves semantic quality or training readiness.