Skip to content

v0.5

Choose a tag to compare

@ChrisWRWX ChrisWRWX released this 10 Aug 19:35
· 2114 commits to main since this release

Misc

  • Add console command wrangles.recipe to execute a recipe from the terminal.
  • Enable passing a url pointed at a recipe to recipe.run.
  • Enable multi-level naming for run section in recipes. E.g. notifications.telegram executes a telegram class within the notification module.
  • Enable run / on failure within recipes.
  • Add Train Standardize function.

Connectors

  • NEW Recipe: Read/Wrangle/Write/Run a recipe, from a recipe.
  • NEW Salesforce: Connect to Salesforce.
  • NEW S3: Read/Write files from S3 buckets.
  • File: Added ability to pass an in memory file.
  • MSSQL: Enable running a list of commands.
  • MSSQL: Enable autocommit by default for run.
  • MySQL: Fix default port.
  • Notification: Add specific Telegram, Email and Slack notifications.
  • PriceFx: Add Company Parameters, Product References and Product Competition.
  • PriceFx: Indicate Source in the recipe for Product/Customer Extensions.
  • PriceFx: Expand ability to use labels instead of names.
  • SFTP: Reuse the File Connector in the background - enabling use of all File Connector options.
  • SSH: Allow a list of commands.
  • SSH: Allow passing in a private key as a file or string.

Wrangles

  • NEW maths: Execute a mathematical formula within a recipe. e.g. column1 * column2 + column3.
  • filter: Now allows many more options such as greater_than, is_in, contains etc.
  • extract.attributes: Add Bound option. When returning an object and a range is found (e.g. 10-20mm), dicate whether to return the min, mid or max value.
  • remove_words: can be set to ignore case.
  • split.text: Add element parameter to select a specific element after splitting.

Container

  • Container renamed from wrangles-pipeline to wrangles
  • Optimized container size for quicker startup