[Feature Request]: Feature Request: Document Tagging System for Better Content Organization

[axunrun]

Do you need to file a feature request?

• I have searched the existing feature request and this feature request is not already filed.
• I believe this is a legitimate feature request, not just a question or bug.

Feature Request Description

Current Situation

Currently, when uploading multiple documents, especially split chapters from different sources (like multiple novels), all documents are stored in the same workspace without any categorization. This makes it difficult to:

• Distinguish between different document sources
• Group related content together (e.g., chapters from the same novel)
• Filter or query documents based on their origin or type

Feature Request

Add a document tagging system that would allow users to:

1. Add custom tags to documents during upload
2. Automatically generate tags based on filename patterns
3. Filter and query documents based on tags

Use Cases

1. Novel Chapter Management

   • When uploading split chapters from multiple novels
   • Each chapter could be tagged with its novel name
   • Makes it easier to query or process chapters from a specific novel

2. Document Source Tracking

   • Different document sources (books, articles, reports) can be tagged accordingly
   • Helps maintain clear separation between different content types

3. Automated Organization

   • Automatically extract tags from filenames (e.g., "Novel1_Chapter1.txt" → tags: ["Novel1", "Chapter"])
   • Allow custom tag rules based on filename patterns

Suggested Implementation

1. API Enhancement

   # Example API additions
   POST /documents/upload
   {
     "file": binary_data,
     "tags": ["novel_name", "chapter_1", "source_type"]
   }
   
   POST /documents/file_batch
   {
     "files": binary_data[],
     "tag_rules": {
       "pattern": "^(.*?)_Chapter",  # Extract novel name before "_Chapter"
       "tags": ["source:{match_1}"]  # Create tag using matched pattern
     }
   }

2. Storage

   • Add tags field to document metadata
   • Include tag information in document status responses

3. Query Enhancement

   GET /documents?tags=novel_name
   GET /documents?tags=source:novel1,chapter:1

Benefits

1. Better organization of large document collections
2. Improved document retrieval and filtering
3. Clear separation between different content sources
4. Enhanced content management for split documents

Impact

This feature would significantly improve the usability of LightRAG for users working with:

• Multiple document sources
• Split documents (like book chapters)
• Large document collections requiring organization
• Content from different domains or categories

Would love to hear your thoughts on this feature request and discuss any implementation details or alternatives you might suggest.

Additional Context

No response