Skip to content

1.6.0

Latest
Compare
Choose a tag to compare
@acwooding acwooding released this 04 Feb 20:08
· 8 commits to master since this release
b2b6f21

Features

  • Add copy_dataset as a built in transformer function
  • Add new helper functions in helper.py:
    • dataset_from_fsurl: Create a dataset from the contents of an fsspec URL
    • metadata_from_fsurl: Create metadata, FILESET file list from fsspec URL
    • derived_dataset: Create a derived dataset via a single function call on .data from a
      previous dataset
  • Add support for using arbitrary conda channels in the environment.yml while forcing the order the channels getting added using a channel-order section (coming in #245)

API Changes

  • .DESCR -> .README
  • .EXTRA -> .FILESET

Documentation Updates

  • Update docs to be more clear and concise
  • Re-add process_20_newsgroups as a working example of a process function

Tests

  • Use a miniconda image directly instead of python image and installing miniconda on it
  • Fix docstring tests in _paths.py