v1.3.0

Highlights

Row-Based Custom Function Improvements

Row-based custom functions now allow kwargs, passing recipe parameters and using input to limit the columns available.

wrangles:
  - custom.my_function:
        # if input is specified, only columns set here
        # will be available to the function. Otherwise
        # all columns will be available
        input: column*
        output: output column
        my_parameter: my_value

def my_function(column1, my_parameter, **kwargs):
  # kwargs will contain any non-explicitly referenced columns or parameters
  # my_parameter contains my_value from the recipe above.
  # column1 contains the value from the column named column1

Pandas functions

Additional Pandas functions are available natively from a recipe.

• Copy
• Drop
• Transpose
• Round
• Reindex

Other Changes

• Allow setting default values for select.list_element and select.dictionary_element.
• Allow multiple input columns for extract.address.
• Updated API requests to use the latest endpoints.
• Extract.custom. Move use_labels logic to the backend API call.
• Better error messages and schema validation when input/output lengths are inconsistent or invalid.
• Bugfix: Extract.attributes - allow any attribute type permitted by the backend + improved schema.
• Bugfix: fabric version caused issues when installing.
• Bugfix: MongoDB connector - ensure credentials using non-url safe characters are encoded correctly.
• Bugfix: Correct datatype for salesforce connector schema.
• Bugfix: Preserve column ordering if using not_columns for a write.