Skip to content

Open source ETL platform for retrieval augmented generation (RAG). Sync data from your SaaS tools to a vector database, where they can be easily queried by LLM apps

License

Notifications You must be signed in to change notification settings

Ensoul-Labs/sidekick

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Connect your SaaS tools to a vector database and keep your data synced

Slack Docs License Issues Twitter

Sidekick is a platform for integrating with SaaS tools like Salesforce, Github, Notion, Zendesk and syncing data between these tools and a vector database. You can also use the integrations and chunkers built by the core team and community to get started quickly, or quickly build new integrations and write custom chunkers for different content types based on Sidekick's DataConnector and DataChunker specs.

Demo

Demo Video with the Zendesk connector. Get an API key to test out the cloud version by creating an account on the Sidekick dashboard.

If you have any questions on how to get started, come join our Slack community!.

💎 Features

  • Dashboard to manage connectors, handle auth, and run queries
  • API Connectors to Zendesk, Notion, Google Drive, Confluence
  • General purpose web scraper for all other content
  • Support for Weaviate and Pinecone vector databases
  • FastAPI endpoint to query your Documents from all connected sources
  • FastAPI endpoint to perform Q&A over your Documents

🚧 Upcoming

  • Support for Milvus, and Qdrant vector stores
  • DropBox Connector
  • Query page for dashboard to replace FastAPI UI
  • Data synchronization via scheduling
  • Data synchronization via webhooks when available

Getting Started - 15 min

Check out the quickstart tutorial to get started.

Contributing

See CONTRIBUTING.md

Acknowledgments

About

Open source ETL platform for retrieval augmented generation (RAG). Sync data from your SaaS tools to a vector database, where they can be easily queried by LLM apps

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 80.7%
  • Python 18.0%
  • CSS 0.7%
  • Dockerfile 0.2%
  • JavaScript 0.2%
  • HTML 0.1%
  • Makefile 0.1%