TiDB.AI

Introduction

A [WIP] conversational search RAG (Retrieval-Augmented Generation) app based on TiDB Serverless Vector Storage, providing a out-of-the-box and embeddable QA robot experience based on your knowledge on official and documentation sites.

Live Demo: TiDB.AI

With this tool, you can achieve:

Features

1. Perplexity-style Conversational Search page: Our platform features an advanced built-in website crawler, designed to elevate your browsing experience. This crawler effortlessly navigates official and documentation sites, ensuring comprehensive coverage and streamlined search processes through sitemap URL scraping.

2. Embeddable JavaScript Snippet: Integrate our conversational search window effortlessly into your website by copying and embedding a simple JavaScript code snippet. This widget, typically placed at the bottom right corner of your site, facilitates instant responses to product-related queries.

Quick Start [Working in Progress]

To deploy the application in a self-hosted environment, run the following command:

curl https://tidb.cloud/install.sh | sh

then:

ticloud create-app --template rag

Deployment [TODO]

For deploying the application to production, there are many options available:

• Deploy with Docker
• Deploy to Vercel

Tech Stack

• Next.js – Framework
• TypeScript – Language
• Tailwind – CSS
• shadcn/ui - Design
• TiDB – Database to store chat history, vector, json, and analytic
• Kysely - SQL query builder
• NextAuth.js – Auth
• Vercel – Deployments

Roadmap & Timeline

• Migrate tidb.ai to a TiDB Serverless vector storage instance with indexing capabilities. Estimated completion by March 29th.
• Revise the table structure to accommodate the requirements of the llamaindex's RAG process and successfully integrate llamaindex. Target date: April 4th.
• Multiple LLM support
• Conduct tests on Jina.AI's embedding and reranker API functionalities. Expected to be done by April 15th.
• Complete deployment documentation with a target date of April 10th. This includes:
  • Docker image deployment. [Working in Progress]
  • Self-hosted solutions.
  • Deployment on Vercel.
• Adapt the system for AWS Redrock Claude3, with an anticipated completion date of April 15th.
• Finalize the "How It Works" series of documentation by April 30th.

License

TiDB.AI is open-source under the Apache License, Version 2.0. You can find it here.