Skip to content

sinapsis-chatbots v0.2.0

Choose a tag to compare

@Natalia-OsorioClavijo Natalia-OsorioClavijo released this 01 Apr 21:05
· 43 commits to main since this release
0b9b081

sinapsis-chatbots v0.2.0

This release introduces significant updates to the sinapsis-chatbots monorepo, including the addition of two new packages: sinapsis-chatbots-base and sinapsis-llama-index, as well as updates to sinapsis-llama-cpp. The changes aim to modularize functionality, improve compatibility with different LLM frameworks, and enhance the capabilities of the chatbot ecosystem.

Key Features

  1. sinapsis-chatbots-base

The sinapsis-chatbots-base package has been introduced to host core functionality for working with various LLM frameworks. This package extracts and consolidates the essential components previously contained within sinapsis-llama-cpp, making it easier to integrate with different LLM providers and frameworks.

  1. sinapsis-llama-index

The sinapsis-llama-index package introduces templates for working with embedding generation, retrieval, and insertion in vector databases using the core functionality of llama-index. This package is designed to streamline RAG (Retrieval-Augmented Generation) workflows.

Embedding Generation: Templates for generating embeddings from text using Llama models.
Vector Database Integration: Simplifies the process of inserting and retrieving embeddings in vector databases.
Retrieval-Augmented Generation (RAG): Enables developers to build RAG-based chatbots by leveraging vector database 
capabilities.
  1. sinapsis-llama-cpp

The sinapsis-llama-cpp package has been updated with a new template to make queries with context from generic data. This enhancement allows developers to build more context-aware chatbots by incorporating relevant data into the query process. Furthermore, core functionality was removed from this package and moved to sinapsis-chatbots-base

Context-Aware Queries: New template for making queries with context from generic data sources.
Improved Flexibility: Enhances the ability to integrate with various data sources and use cases.
  1. New WebApp for RAG Chatbot

Apart from the llama_cpp_simple_chatbot app, we now integrate a new web application, providing a user-friendly interface for interacting with RAG-based chatbots. This webapp simplifies the process of building and testing RAG chatbots, making it easier for developers to experiment with different configurations.

User-Friendly Interface: Easy-to-use interface for interacting with RAG chatbots.
Context-Aware Chatting: Supports queries with context, enabling more accurate and relevant responses.
Multi-Source Support: Works seamlessly with various vector databases and data sources.