Repository navigation
sinapsis-chatbots v0.2.0
sinapsis-chatbots v0.2.0
This release introduces significant updates to the sinapsis-chatbots monorepo, including the addition of two new packages: sinapsis-chatbots-base and sinapsis-llama-index, as well as updates to sinapsis-llama-cpp. The changes aim to modularize functionality, improve compatibility with different LLM frameworks, and enhance the capabilities of the chatbot ecosystem.
Key Features
- sinapsis-chatbots-base
The sinapsis-chatbots-base package has been introduced to host core functionality for working with various LLM frameworks. This package extracts and consolidates the essential components previously contained within sinapsis-llama-cpp, making it easier to integrate with different LLM providers and frameworks.
- sinapsis-llama-index
The sinapsis-llama-index package introduces templates for working with embedding generation, retrieval, and insertion in vector databases using the core functionality of llama-index. This package is designed to streamline RAG (Retrieval-Augmented Generation) workflows.
Embedding Generation: Templates for generating embeddings from text using Llama models.
Vector Database Integration: Simplifies the process of inserting and retrieving embeddings in vector databases.
Retrieval-Augmented Generation (RAG): Enables developers to build RAG-based chatbots by leveraging vector database
capabilities.
- sinapsis-llama-cpp
The sinapsis-llama-cpp package has been updated with a new template to make queries with context from generic data. This enhancement allows developers to build more context-aware chatbots by incorporating relevant data into the query process. Furthermore, core functionality was removed from this package and moved to sinapsis-chatbots-base
Context-Aware Queries: New template for making queries with context from generic data sources.
Improved Flexibility: Enhances the ability to integrate with various data sources and use cases.
- New WebApp for RAG Chatbot
Apart from the llama_cpp_simple_chatbot app, we now integrate a new web application, providing a user-friendly interface for interacting with RAG-based chatbots. This webapp simplifies the process of building and testing RAG chatbots, making it easier for developers to experiment with different configurations.
User-Friendly Interface: Easy-to-use interface for interacting with RAG chatbots.
Context-Aware Chatting: Supports queries with context, enabling more accurate and relevant responses.
Multi-Source Support: Works seamlessly with various vector databases and data sources.