Release/v0.3.0

[denkv]

See CHANGELOG.md

[Copilot]

Pull request overview

This release PR prepares Learn2RAG v0.3.0 by replacing the Open WebUI pipelines subsystem with a direct OpenAI-compatible RAG API, adding continuous/delta import infrastructure, expanding loaders, and restructuring UI templates and packaging.

Changes:

• Adds scheduled imports, direct Qdrant ingestion, delta import state, Drupal/SharePoint support, and source-based payload handling.
• Removes open-webui-pipelines, updates Open WebUI packaging/startup, and adds OpenAI-style pipeline endpoints.
• Splits UI templates into page/list/add partials, adds pipeline cleanup/status UI, and updates release metadata/dependencies.

Reviewed changes

Copilot reviewed 71 out of 72 changed files in this pull request and generated 13 comments.

Show a summary per file

File	Description
.gitmodules	Removes open-webui-pipelines submodule.
CHANGELOG.md	Adds v0.3.0 release notes.
Distfiles	Removes deleted pipeline/setup assets.
LICENSE	Adds MIT license.
build-python	Stops building open-webui-pipelines.
drupal/README.md	Adds Drupal test environment docs.
drupal/docker-compose.yml	Adds Drupal dev compose file.
install	Stops installing open-webui-pipelines.
learn2rag/__main__.py	Adds scheduled launcher support.
learn2rag/compose/__init__.py	Cleans compose logging/health output.
learn2rag/evaluation/docker-compose.yml	Removes unused pipeline volume.
learn2rag/evaluation/tools.py	Disables outdated evaluation ingestion path.
learn2rag/importer/loaders/directory_loader.py	Updates hashing and PDF loading.
learn2rag/importer/loaders/drupal_loader.py	Adds Drupal delta helpers.
learn2rag/importer/loaders/html_loader.py	Adds full-site crawl and source-level documents.
learn2rag/importer/loaders/process_loaders.py	Adds direct/delta import processing.
learn2rag/importer/loaders/sharepoint_loader.py	Adds SharePoint hashing and delta helpers.
learn2rag/importer/main.py	Adds delta/direct-ingest CLI flow.
learn2rag/importer/readme.md	Documents importer v0.3-era behavior.
learn2rag/importer/tests/test_loaders.py	Expands loader/delta tests.
learn2rag/importer/utils/import_state.py	Adds persistent import state.
learn2rag/pipeline/CONFIG_PARAMS.md	Adds pipeline config docs.
learn2rag/pipeline/app.py	Adds OpenAI-style API endpoints.
learn2rag/pipeline/embeddings.py	Adds sparse/ColBERT embedding modes.
learn2rag/pipeline/generate.py	Reads source payload key.
learn2rag/pipeline/ingestion.py	Changes ingestion to accept documents directly.
learn2rag/pipeline/json_loader.py	Removes old JSON loader.
learn2rag/pipeline/main.py	Updates demo script for new ingestion flow.
learn2rag/pipeline/opt_config.json	Adds rewrite/rerank settings.
learn2rag/pipeline/rewrite.py	Adds query rewrite helpers.
learn2rag/pipeline/search.py	Refactors search, rewrite, and reranking.
learn2rag/pipeline/store.py	Adds Qdrant document/store operations.
learn2rag/ui/__init__.py	Adds new UI data flow, cleanup, locale, and config handling.
learn2rag/ui/templates/_pipelines_list_table.html	Removes old pipeline table partial.
learn2rag/ui/templates/base.html	Updates HTMX error indicator behavior.
learn2rag/ui/templates/compose/pipelines/continuous.yml	Adds continuous import/chat compose template.
learn2rag/ui/templates/compose/pipelines/import.yml	Updates one-time import template.
learn2rag/ui/templates/compose/pipelines/pipeline.yml	Updates chat-only compose template.
learn2rag/ui/templates/firststeps_pipelines.html	Starts default continuous pipeline.
learn2rag/ui/templates/models_add.html	Adds model creation partial.
learn2rag/ui/templates/models_list.html	Converts model table to partial.
learn2rag/ui/templates/models_page.html	Adds full models page wrapper.
learn2rag/ui/templates/pipelines_add.html	Adds pipeline creation partial.
learn2rag/ui/templates/pipelines_list.html	Converts pipeline list/status/actions.
learn2rag/ui/templates/pipelines_page.html	Adds full pipelines page wrapper.
learn2rag/ui/templates/sources_add.html	Adds source creation accordion.
learn2rag/ui/templates/sources_add_drupal.html	Adds Drupal source form.
learn2rag/ui/templates/sources_add_local.html	Adds local source form.
learn2rag/ui/templates/sources_add_sharepoint.html	Adds SharePoint source form.
learn2rag/ui/templates/sources_add_web.html	Adds web source form.
learn2rag/ui/templates/sources_list.html	Converts source table to partial.
learn2rag/ui/templates/sources_page.html	Adds full sources page wrapper.
open-webui-pipelines/langgraph_stream_pipeline.py	Removes legacy pipeline adapter.
open-webui-pipelines/langgraph_stream_pipeline/valves.json	Removes legacy pipeline config.
package-linux	Updates Open WebUI packaging and removes pipelines binary.
package-windows	Updates Open WebUI packaging and removes pipelines binary.
pyproject.toml	Pins dependencies and adds scheduler dependency.
services/install-open-webui	Recreates Open WebUI venv during install.
services/install-open-webui-pipelines	Removes legacy install script.
services/setup-open-webui	Removes legacy setup script.
services/start-import	Runs importer directly with shell tracing.
services/start-import.linux	Removes separate ingestion step.
services/start-import.windows.bat	Removes separate ingestion step.
services/start-open-webui-pipelines	Removes legacy service launcher.
start.linux	Removes pipeline initialization step.
start.windows.bat	Removes pipeline initialization step.
uninstall.linux	Fixes pyapp removal paths.
uv.lock	Updates resolved dependencies.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[denkv]

C:\Users\user\AppData\Local\pyapp\data\learn2rag\4701829833702727377\0.2.0\Lib\site-packages\learn2rag\pipeline\qdrant.py:11: UserWarning: Api key is used with an insecure connection.
  client = QdrantClient(
2026-05-27 07:07:21,932 INFO     httpx HTTP Request: GET http://localhost:9002 "HTTP/1.1 200 OK"
C:\Users\user\AppData\Local\pyapp\data\learn2rag\4701829833702727377\0.2.0\Lib\site-packages\qdrant_client\qdrant_remote.py:280: UserWarning: Qdrant client version 1.17.1 is incompatible with
server version 1.15.4. Major versions should match and minor version difference must not exceed 1. Set check_compatibility=False to skip version check.
  show_warning(
2026-05-27 07:07:27,949 INFO     Learn2RAGImporter Running full import
2026-05-27 07:07:27,949 INFO     Learn2RAGImporter Processing entry: {'loader_id': 'b8bdce0a-7f7b-4dd3-a559-e8fab70ff142', 'loader_type': 'DirectoryLoader', 'path': 'C:\\Users\\user\\Documents
\\RAG', 'recursive': 'True'}, please wait...
2026-05-27 07:07:28,055 INFO     Learn2RAGImporter Pandoc found, version: 3.9.0.2
0it [00:00, ?it/s]
2026-05-27 07:07:28,560 INFO     Learn2RAGImporter Loaded 1 documents from 'C:\Users\user\Documents\RAG'. File types: {'pdf': 1}
2026-05-27 07:07:28,561 INFO     Learn2RAGImporter Loaded 1 documents from C:\Users\user\Documents\RAG using DirectoryLoader for configuration entry with loader_id: b8bdce0a-7f7b-4dd3-a559-e8f
ab70ff142.
2026-05-27 07:07:30,604 INFO     httpx HTTP Request: GET http://localhost:9002/collections/learn2rag/exists "HTTP/1.1 200 OK"
INFO:     127.0.0.1:49737 - "GET /pipelines HTTP/1.1" 200 OK
2026-05-27 07:07:32,739 ERROR    Learn2RAGImporter Error loading configuration: [WinError 10054] An existing connection was forcibly closed by the remote host
2026-05-27 07:07:46,794 INFO     learn2rag.compose Stopping project a9742757-ef11-4b1a-98ab-3d641aeacd37 due to stopped services: ['qdrant', 'main']