v0.1.4

Full Changelog: https://github.com/RobinQu/instinct.cpp/commits/v0.1.4

• Features
  • instinct-assistant: file-search support. It takes a summary guided strategy inspired by RAPTOR, and follows practices adopted by OpenAI. See more at #16
    . It has some limitations, please refer to #22.
  • new instinct-transfomer module that ships built-in models based on transformer. Currently, only BGE-M3-Reranker is implemented. Most code in first version implementation is refined (copied) from chatllm.cpp for quick start.
  • instinct-retrieval:
    • a new MultiPathRetriever that handle recalls from multiple child retrievers and score results with a reranker model.
    • SimpleRetrieverOperator and DuckDBVectorStoreOpeartor for multi-instance managements.
    • CitationAnnotatingChain and SummaryChain to support citations and summary required in instinct-assistant.
    • Added a mandatory file-source metadata field to keep record of file identifier.
  • instinct-data:
    • Aggregate method on data template class
    • Added GetObjectState method on IObjectStore.
  • instinct-core:
    • Added LambdaInputParsr and LambdaOutputParser to simplify chain implementation.
    • ManagedApplicationContext to have more delicate lifecycle managements.
• Improvements
  • mini-assistant:
    • many bug fixes in related classes.
    • CLI options: we can now assign model provider separately for embedding model and chat model.
  • instinct-core:
    • Make options on chat model and embedding model optional using std::optional.
    • Fix a consistency issue of RecursiveCharacterTextSplitter with the one in langchain.
    • Better control of preloading assets of tokenizers.
  • instinct-server:
    • fix graceful shutdown of HttpLibServer.
  • bump duckdb to 0.10.2

8bde9376fa21401cba17e3ae7a094f07fa3e11293baf2cd729a37e3e9eec0868  doc-agent_linux-amd64.tar.gz
8fad76f8c402240189817b221442b7a596b927653e36ae61d431d1b0cd3776ef  doc-agent_macos-arm64.tar.gz
8042950bc8a28df375e58589423d87c77bae545d4f71d5acf1e224932cfae32f  mini-assistant_linux-amd64.tar.gz
848d1e7a4a2b80c42a7348d37d0337788e67f13d745acbed3652d65b964164c8  mini-assistant_macos-arm64.tar.gz