pycleandata

Retrieve and clean data sets for use in machine learning experiments. See also pygendata.

Usage

To process all configured data sets:

$ python3 cleandata.py

Or to specify a single data set using the key from data.yml:

$ python3 cleandata.py <dataset_key>

Requirements

Python 3
numpy
pandas
PyYAML

Future work

better documentation, especially this file
rename cd_data/ to output/ for consistency with pygendata
specify config file as command-line option
...and place output in a subdirectory of output/ named after it
add a suitable license
more flexibility regarding normalisation (and remove the term standardisation)