v1.8.0

• extract.ai
  • Pass through any additional unspecified parameters to the backend API.
  • Assume outputs of type array without a child type defined should be strings.
  • Added the ability to include header level messages.
  • Improved error handling. Clearer errors for invalid schema or API keys.
  • Allow the URL to be overridden.
• create.embeddings
  • Pass through any additional unspecified parameters to the backend API.
  • Allow the URL to be overridden.
  • Bugfix: Exponential backoff for retries was not working.
  • Added model parameter to schema.
• merge.concatenate
  • Fix errors caused by non-string values.
  • Add skip_empty parameter to skip empty values.
• Allow wrangles to be used to rename columns.
• Added by parameter for create.index. This will create a sequential index grouped by the defined columns.
• Added a default parameter for convert.from_json and convert.from_yaml in the case of an empty of erroneous input.
• Added a handler for more data types for convert.to_json including datetimes, numpy arrays and numpy floats/ints.
• Added select.sample - the rows can be specified as whole numbers or a decimal. 5 = 5 rows, 0.5 = 50% of rows.
• Make start or length optional for select.substring.
• Added the ability to reference custom functions to set the value of a variable.
• Added a sort wrangle.
• Bugfix: Fixed the schema definition for the wrangle recipe.
• Added the name of the recipe to the log entry.
• Add the ability to log info, warning or error messages with the log wrangle.
• Fixed pytest on v7.4.4 due to breaking changes in 8.0.0
• Allow the value for create.column to be a list or other complex object.
• Added use_spellcheck parameter to extract.custom.