Skip to content

0.14.1
Compare
Choose a tag to compare
@christinestraub christinestraub released this 21 May 22:52
· 65 commits to main since this release
0.14.1
30e5a0c
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Enhancements

  • Refactor code related to embedded text extraction. The embedded text extraction code is moved from unstructured-inference to unstructured.

Features

  • Large improvements to the ingest process:
    • Support for multiprocessing and async, with limits for both.
    • Streamlined to process when mapping CLI invocations to the underlying code
    • More granular steps introduced to give better control over process (i.e. dedicated step to uncompress files already in the local filesystem, new optional staging step before upload)
    • Use the python client when calling the unstructured api for partitioning or chunking
    • Saving the final content is now a dedicated destination connector (local) set as the default if none are provided. Avoids adding new files locally if uploading elsewhere.
    • Leverage last modified date when deciding if new files should be downloaded and reprocessed.
    • Add attribution to the pinecone connector
  • Add support for Python 3.12. unstructured now works with Python 3.12!
Assets 2