Draft: develop into master

CHANGELOG.md

@@ -1,23 +1,30 @@
-### v1.1.0
- - **Hardware Acceleration Support**: Added support for CoreML, CUDA, ROCm to cater to diverse deployment environments.
- - **Docker-Compose and Install Script Improvements**: Updated `docker-compose` configurations and `install.sh` script for better setup experience and development workflow. Includes more specific version locking for reliability and easier automation.
- - **Permission System**: Implemented a fine-grained permission system.
- - **README and Usage Examples**: Updated documentation to enhance clarity and user guidance.
- - **Secret Management Overhaul**: Redesigned secret management using a factory/provider pattern for Google Secrets and local `.env` configurations.
- - **Storage Backend Overhaul**: Redesigned file storage using a factory/provider pattern for GCS or to simply store on local disk and share a volume between webapp & vector-db-proxy.
- - **MongoDB Model Enhancements**: Added filename support for MongoDB models and optimized queries.
- - **Vector Database Proxy Updates**: Updated Vector DB Proxy for better structure and maintainability, including production build optimizations.
- - **Local Storage and Thread Utilization**: Enhanced local storage handling and introduced thread utilization control.
- - **Code Quality and Dependency Management**: Addressed ESLint warnings, updated configurations, and removed unused dependencies.
- - **Frontend Updates**: Enabled avatars for apps and agents, added markdown preview for app descriptions, and improved UI components.
- - **Stripe Subscription and Billing**: Implemented Stripe functionalities for plan management and addon cross-selling.
-
----
+### v1.2.0
+ - Add support for ollama models.
+ - Implement more advanced retrieval strategies for data sources. (raw, self query, multi query, time weighted)
+ - First iteration of implementing plan limits and stripe handling.
+ - Make new accounts be Enterprise plan by default when no stripe API key set (for OS users).
+ - Make Airbyte setup handled from within webapp instead of install.sh
+ - Add human input checkbox on tasks to choose whether a task requires human input
+ - Update datasource tables and components to have a new embedding status progress bar.
+ - Improve consistency of avatars in chat and make them work with the local storage provider.
+ - Improve chat UX and add customer formatting for thoughts, tasks, and tool messages.
+ - Add ability to input descriptions on datasource fields for self-query retrieval.
+ - Add Docker volume and make Qdrant data persistent in docker-compose.
+ - Various bug fixes and optimizations to improve overall performance and reliability.
 
-Legacy changelog:
-
-### 1.0.0
- - TODO
+### v1.1.0
+ - Added support for CoreML, CUDA, ROCm to cater to diverse deployment environments.
+ - Updated `docker-compose` configurations and `install.sh` script for better setup experience and development workflow. Includes more specific version locking for reliability and easier automation.
+ - Implemented a fine-grained permission system.
+ - Updated documentation to enhance clarity and user guidance.
+ - Redesigned secret management using a factory/provider pattern for Google Secrets and local `.env` configurations.
+ - Redesigned file storage using a factory/provider pattern for GCS or to simply store on local disk and share a volume between webapp & vector-db-proxy.
+ - Added filename support for MongoDB models and optimized queries.
+ - Updated Vector DB Proxy for better structure and maintainability, including production build optimizations.
+ - Enhanced local storage handling and introduced thread utilization control.
+ - Addressed ESLint warnings, updated configurations, and removed unused dependencies.
+ - Enabled avatars for apps and agents, added markdown preview for app descriptions, and improved UI components.
+ - Implemented Stripe functionalities for plan management and addon cross-selling.
 
 ### 0.5.0
  - Add RAG from file upload or connection to other data source via Airbyte

agent-backend/.gitignore

@@ -167,11 +167,5 @@ keyfile.json
 *.ipynb
 src/output
 output
-src/tools/*
-!src/tools/global_tools.py
-!src/tools/build_request_from_api_spec.py
-!src/tools/code_execution_docker_notebook_tool.py
-!src/tools/code_execution_tool.py
-!src/tools/rag_tool.py
-
-.run
+
+.run

agent-backend/Dockerfile

@@ -1,5 +1,5 @@
 # Use the official Python image as the base image
-FROM python:3.11-slim as builder
+FROM python:3.11 as builder
 
 # Set the working directory inside the container
 WORKDIR /app

agent-backend/pyproject.toml

@@ -28,6 +28,13 @@ onnxruntime = "1.17.0"
 fastembed = "^0.2.2"
 qdrant-client = "^1.8.0"
 arxiv = "^2.1.0"
+lark = "^1.1.9"
+wikipedia = "^1.4.0"
+mediawikiapi = "^1.2"
+wikibase-rest-api-client = "^0.1.3"
+duckduckgo-search = "^5.3.0"
+stackapi = "^0.3.0"
+youtube-search = "^2.1.2"
 
 
 [build-system]