Repository navigation
Releases
pyml-datasets 0.23.0
Added
- If
richorrich-argparseis not installed, thepyml-datasetscommand tells which
package is missing and how to install it, and ends with exit code 3, instead of failing with
a traceback.
Changed
richandrich-argparseare no longer installed with the package. They are the optional
cliextra now, so a plain installation needs NumPy alone. Thepyml-datasetscommand and
python -m pyml_datasetsneed the extra. Loading the datasets never used them.
pyml-datasets 0.22.0
Added
pyml-datasets listandpyml-datasets showtake--format {text,md,json}:textis the output as before.mdis Markdown: a table forlist, and sections in the style ofNOTICE.mdforshow.jsonis for programs:listgives an array of objects andshowgives one object with
every fact, whether--fullis given or not. The default limit oflistdoes not cut
the JSON, only--limitdoes.
--output PATH(-o) writes the result to a file instead of the terminal, and--force
overwrites a file that exists.- A file is always written in UTF-8, without a byte order mark and with
\nat the end of
every line, whatever the console, the locale and the platform are. A character is never
replaced. - A text file has no colors and no links and is wrapped at 100 characters, not at the width
of the terminal. - Without
--formatthe extension.md,.txtor.jsonchooses the format. The path is
taken from the current directory,~is expanded, and its directory must exist.-o -
is the terminal.
- A file is always written in UTF-8, without a byte order mark and with
python -m scripts listandpython -m scripts showtake the same options.
Changed
--format jsonon the terminal writes every character outside ASCII as an escape
(\u0131), so a console with another code page, such as cp1252 on Windows, still gets
valid JSON. A JSON file keeps the characters, in UTF-8.
Full changelog: https://pyml-datasets.readthedocs.io/en/latest/changelog.html
pyml-datasets 0.21.0
Added
pyml-datasets listcan filter and page the rows (python -m scripts listtakes the same
options):--name PATTERNkeeps the datasets whose name matches the pattern, likeILIKEin SQL.
*(or%) is any characters and?is one character, so--name "wine*"starts with
wineand--name "*quality"ends withquality. Capital letters do not matter. A
pattern without a wildcard has to match the whole name, and a tip below the table
suggests a wider pattern when it would find more datasets.--missingand--no-missingkeep the datasets that have, or do not have, missing
values.--limit N,--offset Nand--allpage the rows.
Changed
pyml-datasets listshows at most 25 rows unless--limitor--allis given. When the
table is cut, a line below it says which rows are shown and how many there are, for example
Showing 1-25 of 31.The package has fewer than 25 datasets now, so nothing is cut yet.- The line below the table says
1 dataset, not1 datasets.
Full changelog: https://pyml-datasets.readthedocs.io/en/latest/changelog.html
pyml-datasets 0.20.0
Added
pyml-datasets show NAME --fullalso prints the changes made to the data and the notes.
python -m scripts showtakes the same option.
Changed
pyml-datasets showprints sections: the header with the task and the license, then
Overview, Provenance, Features and Citation. Every feature name is listed, the numeric
and the categorical ones apart, where the lists were cut after ten names. The addresses
are links in terminals that support links. The changes made to the data and the notes
moved to--full, and a line below the report says how many there are. The output is
meant for people and is not a stable interface.
Fixed
pyml-datasetsno longer fails when the output cannot encode a character, for example
when it goes through a pipe on Windows, which uses cp1252:show combined_cycle_power_plant
failed on the letterıin the name of a creator. Such a character is now printed as?.
Full list of changes: see the changelog.
pyml-datasets 0.19.0
Added
- Options of
pyml-datasets list:--taskshows only the datasets of one task,--sort
orders the rows by name, number of samples or number of features, and--reverse
reverses the order. Datasets with an equal value stay in the order of their names. The
line below the table counts the datasets that are shown.python -m scripts listtakes
the same options.
Changed
- The columns
TaskandLicenseof the table are centered. The output is meant for
people and is not a stable interface.
Full list of changes: see the changelog.
pyml-datasets 0.18.0
Changed
import pyml_datasetsandlist_datasetsno longer import the module of every dataset.
Aload_<name>function,get_infoandload_datasetimport only the module of the
dataset they are asked for, so the import time does not grow with the number of datasets.
from pyml_datasets import load_iris,from pyml_datasets import *anddir()work as
before, and type checkers still report a misspelled loader name.pyml_datasets.datasetsholds an index of the dataset names and tasks,DATASET_TASKS,
in place ofENTRIES. Both are internal.
The package ships a generated __init__.pyi, which names every loader for type checkers and
IDEs.
Full list of changes: see the changelog.
pyml-datasets 0.17.0
Added
- The
pyml-datasetscommand, also run aspython -m pyml_datasets, with two sub-commands.listprints a table of the datasets with their task, license and shape.show NAMEprints the facts about one dataset: its license, source, citation and the changes made to the data. The output is meant for people and is not a stable interface.
Changed
richandrich-argparseare now dependencies of the package. They are used only by the command and are not imported byimport pyml_datasets.
The package has 20 datasets: 10 classification and 10 regression.
Full list of changes: https://pyml-datasets.readthedocs.io/en/latest/changelog.html
pyml-datasets 0.16.0
Added
- Dataset
superconductivity(UCI Superconductivty Data, CC BY 4.0): 21263 superconductors described by 81 numeric features, with the critical temperature as the regression target. 66 rows of the source repeat another row and are kept, so equal rows can end up in both parts of a split.
The package now has 20 datasets: 10 classification and 10 regression.
Full list of changes: https://pyml-datasets.readthedocs.io/en/latest/changelog.html
pyml-datasets 0.15.0
Added
- Dataset
mushroom(UCI Mushroom, CC BY 4.0): 8124 descriptions of hypothetical mushrooms from a field guide, with 22 categorical features, to be classified as edible or poisonous (48.2 percent are poisonous, and that class also holds mushrooms of unknown edibility). Entries ofstalk_rootthat the source marks as missing are stored asNaN.
The package now has 19 datasets: 10 classification and 9 regression.
Full list of changes: https://pyml-datasets.readthedocs.io/en/latest/changelog.html
pyml-datasets 0.14.0
Added
- Dataset
real_estate_valuation(UCI Real Estate Valuation, CC BY 4.0): 414 house sales in the Sindian District of New Taipei City, Taiwan, described by 6 numeric features (the transaction date, the house age, the distance to the nearest MRT station, the number of convenience stores and the latitude and longitude), with the house price of unit area as the target. The source says that the data was split randomly into a training and a testing part, but its file does not tell which sample belongs to which, so the split is not provided.
The package now has 18 datasets: 9 classification and 9 regression.
Full list of changes: https://pyml-datasets.readthedocs.io/en/latest/changelog.html