Skip to content

Release v1.0.0.post1

Choose a tag to compare

@github-actions github-actions released this 08 Aug 12:36
· 35 commits to main since this release

Changes in this release

  • Complete refactoring of the library with data models and optional dependencies
  • stanza and tiktoken are now an optional dependencies, to keep the library as lightweight as possible and to let developer freely choose which packages they want to install. Also, many companies have restrictions on which models they could use. This helps to overcome these limitations
  • added sentence splitter based on spaCy (optional dependency)
  • data models introduced: Chunk, TextPart, etc. to improve readability and library usage
  • introduced pipelines for unit testing, automatic release and automatic doc generation