Skip to content

v1.0

Choose a tag to compare

View all tags
@ChrisWRWX ChrisWRWX released this 21 Dec 19:43
· 1990 commits to main since this release
v1.0
6a82ef1
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

New Wrangles

  • Create.bins: segment and sort data values into bins
  • Extract.date_range: Extract date range between two dates
  • Extract.date_properties: Extract date properties from a date (day, month, year, etc...)
  • Extract.brackets: Extract text properties in brackets from the input
  • Date_calculator: Add or Subtract time from a date
  • Merge.dictionaries: Take dictionaries in multiple columns and merge them to a single dictionary.
  • Format.prefix and format.suffix
  • Convert.from_json: Convert a JSON representation into an object

Updated Wrangles

  • Standardize: allows a single find/replace to be applied in a recipe without requiring creating a DIY wrangle
  • Extract: allows a single extract to be applied in a recipe without requiring creating a DIY wrangle
  • Extract.custom: allow for now also allows a list of models
  • Extract.properties: type is now case insensitive. e.g( type: ShaPEs)
  • Extract.properties: error if property type selected is not in predefined list of properties
  • Extract.properties: parameter return_data_type. Allow the return value to be a string or a list (default)
  • Extract.remove_words: added parameter ignore_case
  • Translate: Allow full language name or code to be used. e.g. English or En
  • Translate: Added parameter case. Text case can be changed before translating for better accuracy
  • Log: Allow for usage of wildcards and escape character (*)
  • Rename: improved error information if rename column does not exist
  • Split.text: Added parameter element. Allow to select the element after splitting the text

Connectors

  • New Train Connector: train DIY wrangles from python recipes.
  • S3 Connector: Additional options for downloading and uploading files within run section.
  • File connector: If directory is not found then create directory rather than failing
  • HTTP: Allow passing params and json.

Misc

  • Improved Variable logic. Now replaced after recipe is read and converted to an object.
  • Recipes can be read from a http(s) url.
  • Wildcard expansion is now performed globally and not in individual wrangles (escape characters included).
  • Custom functions are now be passed to sub-recipes.
  • Improved error information if a user's custom function is not found.
  • Wrangles.recipe terminal command no longer fails if non-function variables are present in functions.py file.
  • Removed Geography Wrangle (duplicate of address).
  • Custom Write functions no longer require a return statement.
Assets 2
Loading