Skip to content

v1.7.0

Choose a tag to compare

@ChrisWRWX ChrisWRWX released this 06 Nov 02:22
· 1557 commits to main since this release
  • select.group_by:
    • Added list option to gather rows as a python list.
    • Bugfix: Enable where to work.
    • Bugfix: Fix an issue when by and an aggregation contained the same column.
  • Added format.significant_figures to round numbers to a specified number of significant figures.
  • Added select.columns to be able to only include specified columns.
  • Added explode to explode rows that contain lists over many rows.
  • Added select.head to get the first n rows.
  • Added select.tail to get the last n rows.
  • Added unit conversion schema and tests for extract.attributes.
  • Added similarity wrangle to calculate the similarity between two vectors. This can use cosine or euclidean calculations.
  • Added case sensitive option for standardize.
  • Added case sensitive option for extract.custom.
  • create.embeddings:
    • Prevent empty strings causing failure.
    • Added ability to return embeddings as a numpy array.
    • Allow multiple inputs and outputs.
    • Optimize by using base64 encoding for requests.
    • Added retries parameter to specify the number of times to retry if the API request fails. This uses exponential backoff to help with rate limiting.
  • extract.ai - Added retries parameter to specify the number of times to retry if the API request fails. This uses exponential backoff to help with rate limiting.
  • Added a more succinct option for creating columns by defining as a dictionary of column headings and values. This supports the same dynamic column generation options as the test connector.
  • Bugfix: Rename had strange behaviour when the target column already existed.
  • Give a clearer error message if the recipe file is invalid.