microsoft
diff --git a/‎README.md
Lines changed: 52 additions & 41 deletions b/‎README.md
Lines changed: 52 additions & 41 deletions
diff --git a/‎RELEASE_NOTES.md
Lines changed: 48 additions & 0 deletions b/‎RELEASE_NOTES.md
Lines changed: 48 additions & 0 deletions
diff --git a/‎application/single_app/config.py
Lines changed: 26 additions & 4 deletions b/‎application/single_app/config.py
Lines changed: 26 additions & 4 deletions
diff --git a/‎application/single_app/functions_documents.py
Lines changed: 61 additions & 2 deletions b/‎application/single_app/functions_documents.py
Lines changed: 61 additions & 2 deletions
@@ -215,52 +215,53 @@ Below is a summary of recent additions, reflecting the state as of version `v0.2
 
 Here's a structured changelog entry for version `v0.213.001` following your previous format:
 
-### **(v0.213.001)**
+### **(v0.214.001)**
 
 #### New Features
 
-1. **Dark Mode Support**
-   - Added full dark mode theming with support for:
-     - Chat interface (left and right panes)
-     - File metadata panels
-     - Dropdowns, headers, buttons, and classification tables
-   - User preferences persist across sessions.
-   - Dark mode toggle in navbar with text labels and styling fixes (no flash during navigation).
-2. **Admin Management Enhancements**
-   - Admin Settings UI updated to show version check.
-   - Added logout_hint parameter to resolve multi-identity logout errors.
-   - Updated favicon and admin settings layout for improved clarity and usability.
-3. **UI Banner & Visual Updates**
-   - New top-of-page banner added (configurable).
-   - Local CSS/JS used across admin, group, and user workspaces for consistency and performance.
-   - Updated `base.html` and `workspace.html` to reflect visual improvements.
-4. **Security Improvements**
-   - Implemented `X-Content-Type-Options: nosniff` header to mitigate MIME sniffing vulnerabilities.
-5. **Build & Deployment**
-   - Added `docker_image_publish_dev.yml` GitHub Action workflow for publishing dev Docker images.
-   - Updated Dockerfile to use **Python 3.12**.
-6. **Version Enforcement**
-   - GitHub workflow `enforce-dev-to-main.yml` added to prevent pull requests to `main` unless from `development`.
+*   **Dark Mode Support**
+    *   Added full dark mode theming with support for:
+        *   Chat interface (left and right panes)
+        *   File metadata panels
+        *   Dropdowns, headers, buttons, and classification tables
+    *   User preferences persist across sessions.
+    *   Dark mode toggle in navbar with text labels and styling fixes (no flash during navigation).
+*   **Admin Management Enhancements**
+    *   **First-Time Configuration Wizard**: Introduced a guided setup wizard on the Admin Settings page. This wizard simplifies the initial configuration process for application basics (title, logo), GPT API settings, workspace settings, additional services (Embedding, AI Search, Document Intelligence), and optional features. (Ref: `README.md`, `admin_settings.js`, `admin_settings.html`)
+    *   Admin Settings UI updated to show application version check status, comparing against the latest GitHub release. (Ref: `route_frontend_admin_settings.py`, `admin_settings.html`)
+    *   Added `logout_hint` parameter to resolve multi-identity logout errors.
+    *   Updated favicon and admin settings layout for improved clarity and usability.
+*   **UI Banner & Visual Updates**
+    *   **Enhanced Document Dropdown (Chat Interface)**: The document selection dropdown in the chat interface has been significantly improved:
+        *   Increased width and scrollability for better handling of numerous documents.
+        *   Client-side search/filter functionality added to quickly find documents.
+        *   Improved visual feedback, including a "no matches found" message. (Ref: `chats.css`, `chat-documents.js`, `chats.html`)
+    *   New top-of-page banner added (configurable).
+    *   Local CSS/JS used across admin, group, and user workspaces for consistency and performance.
+    *   Updated `base.html` and `workspace.html` to reflect visual improvements.
+*   **Application Setup & Configuration**
+    *   **Automatic Storage Container Creation**: The application now attempts to automatically create the `user-documents` and `group-documents` Azure Storage containers during initialization if they are not found, provided "Enhanced Citations" are enabled and a valid storage connection string is configured. Manual creation as per documentation is still the recommended primary approach. (Ref: `config.py`)
+    *   Updated documentation for Azure Storage Account setup, including guidance for the new First-Time Configuration Wizard. (Ref: `README.md`)
+*   **Security Improvements**
+    *   Implemented `X-Content-Type-Options: nosniff` header to mitigate MIME sniffing vulnerabilities.
+    *   Enhanced security for loading AI Search index schema JSON files by implementing path validation and using `secure_filename` in backend settings. (Ref: `route_backend_settings.py`)
+*   **Build & Deployment**
+    *   Added `docker_image_publish_dev.yml` GitHub Action workflow for publishing dev Docker images.
+    *   Updated Dockerfile to use Python 3.12.
+*   **Version Enforcement**
+    *   GitHub workflow `enforce-dev-to-main.yml` added to prevent pull requests to `main` unless from `development`.
 
 #### Bug Fixes
 
-A. **Document Processing**
-
-- Resolved document deletion error.
-
-C. **UI & Usability**
-
-- Local assets now used for JS/CSS to improve load times and offline compatibility.
-- General CSS cleanups across admin and workspace UIs.
-
-D. **General Stability**
-
-- Merged contributions from multiple devs including UI fixes, backend updates, and config changes.
-- Removed unused video/audio container declarations for a leaner frontend.
-
-------
-
-Let me know if you'd like a markdown-formatted file or a GitHub release tag summary version.
+*   **A. Document Processing**
+    *   **Document Deletion**: Resolved an issue where documents were not properly deleted from Azure Blob Storage. Now, when a document is deleted from the application, its corresponding blob is also removed from the `user-documents` or `group-documents` container if enhanced citations are enabled. (Ref: `functions_documents.py`)
+    *   **Configuration Validation (Enhanced Citations)**: Added validation in Admin Settings to ensure that if "Enhanced Citations" is enabled, the "Office Docs Storage Account Connection String" is also provided. If the connection string is missing, Enhanced Citations will be automatically disabled, and a warning message will be displayed to the admin, preventing silent failures. (Ref: `route_frontend_admin_settings.py`)
+*   **C. UI & Usability**
+    *   **Local Assets for SimpleMDE**: The SimpleMDE Markdown editor assets (JS/CSS) are now served locally from `/static/js/simplemde/` and `/static/css/simplemde.min.css` instead of a CDN. This improves page load times, reduces external dependencies, and allows for use in offline or air-gapped environments. (Ref: `simplemde.min.js`, `simplemde.min.css` additions, template updates in `group_workspaces.html`, `workspace.html`)
+    *   General CSS cleanups across admin and workspace UIs.
+*   **D. General Stability**
+    *   Merged contributions from multiple devs including UI fixes, backend updates, and config changes.
+    *   Removed unused video/audio container declarations for a leaner frontend.
 
 ## Release Notes
 
@@ -636,7 +637,17 @@ Core configuration values are managed via environment variables, typically set i
     *   To verify or synchronize settings from Azure back to a local `.env` file:
     *   Press `Ctrl+Shift+P`, type `Azure App Service: Download Remote Settings`, select your App Service, and choose where to save the file (e.g., overwrite your local `.env`). This is useful to capture settings automatically added by Azure (like `APPLICATIONINSIGHTS_CONNECTION_STRING` or `WEBSITE_AUTH_AAD_ALLOWED_TENANTS`).
 
-    ![Download remote settings command](./images/download_remote_settings.png) 
+    ![Download remote settings command](./images/download_remote_settings.png)
+
+5.  **First-Time Configuration Wizard**:
+    *   When you first access the admin settings page, a configuration wizard will guide you through the required and optional settings.
+    *   The wizard will help you configure:
+        *   **Application basics**: Title and logo customization
+        *   **GPT API settings**: Configure Azure OpenAI endpoints and models
+        *   **Workspace settings**: Enable personal and group workspaces
+        *   **Additional services**: Configure embedding, AI Search, Document Intelligence, and other required services
+        *   **Optional features**: Content safety, user feedback, conversation archiving, and other optional features
+    *   Required settings are clearly marked, ensuring that you configure all necessary components for your deployment scenario.
 
 #### Alternate Method: Update App Settings via JSON (Advanced)
 
 
@@ -2,6 +2,54 @@
 
 # Feature Release
 
+### **(v0.214.001)**
+
+#### New Features
+
+*   **Dark Mode Support**
+    *   Added full dark mode theming with support for:
+        *   Chat interface (left and right panes)
+        *   File metadata panels
+        *   Dropdowns, headers, buttons, and classification tables
+    *   User preferences persist across sessions.
+    *   Dark mode toggle in navbar with text labels and styling fixes (no flash during navigation).
+*   **Admin Management Enhancements**
+    *   **First-Time Configuration Wizard**: Introduced a guided setup wizard on the Admin Settings page. This wizard simplifies the initial configuration process for application basics (title, logo), GPT API settings, workspace settings, additional services (Embedding, AI Search, Document Intelligence), and optional features. (Ref: `README.md`, `admin_settings.js`, `admin_settings.html`)
+    *   Admin Settings UI updated to show application version check status, comparing against the latest GitHub release. (Ref: `route_frontend_admin_settings.py`, `admin_settings.html`)
+    *   Added `logout_hint` parameter to resolve multi-identity logout errors.
+    *   Updated favicon and admin settings layout for improved clarity and usability.
+*   **UI Banner & Visual Updates**
+    *   **Enhanced Document Dropdown (Chat Interface)**: The document selection dropdown in the chat interface has been significantly improved:
+        *   Increased width and scrollability for better handling of numerous documents.
+        *   Client-side search/filter functionality added to quickly find documents.
+        *   Improved visual feedback, including a "no matches found" message. (Ref: `chats.css`, `chat-documents.js`, `chats.html`)
+    *   New top-of-page banner added (configurable).
+    *   Local CSS/JS used across admin, group, and user workspaces for consistency and performance.
+    *   Updated `base.html` and `workspace.html` to reflect visual improvements.
+*   **Application Setup & Configuration**
+    *   **Automatic Storage Container Creation**: The application now attempts to automatically create the `user-documents` and `group-documents` Azure Storage containers during initialization if they are not found, provided "Enhanced Citations" are enabled and a valid storage connection string is configured. Manual creation as per documentation is still the recommended primary approach. (Ref: `config.py`)
+    *   Updated documentation for Azure Storage Account setup, including guidance for the new First-Time Configuration Wizard. (Ref: `README.md`)
+*   **Security Improvements**
+    *   Implemented `X-Content-Type-Options: nosniff` header to mitigate MIME sniffing vulnerabilities.
+    *   Enhanced security for loading AI Search index schema JSON files by implementing path validation and using `secure_filename` in backend settings. (Ref: `route_backend_settings.py`)
+*   **Build & Deployment**
+    *   Added `docker_image_publish_dev.yml` GitHub Action workflow for publishing dev Docker images.
+    *   Updated Dockerfile to use Python 3.12.
+*   **Version Enforcement**
+    *   GitHub workflow `enforce-dev-to-main.yml` added to prevent pull requests to `main` unless from `development`.
+
+#### Bug Fixes
+
+*   **A. Document Processing**
+    *   **Document Deletion**: Resolved an issue where documents were not properly deleted from Azure Blob Storage. Now, when a document is deleted from the application, its corresponding blob is also removed from the `user-documents` or `group-documents` container if enhanced citations are enabled. (Ref: `functions_documents.py`)
+    *   **Configuration Validation (Enhanced Citations)**: Added validation in Admin Settings to ensure that if "Enhanced Citations" is enabled, the "Office Docs Storage Account Connection String" is also provided. If the connection string is missing, Enhanced Citations will be automatically disabled, and a warning message will be displayed to the admin, preventing silent failures. (Ref: `route_frontend_admin_settings.py`)
+*   **C. UI & Usability**
+    *   **Local Assets for SimpleMDE**: The SimpleMDE Markdown editor assets (JS/CSS) are now served locally from `/static/js/simplemde/` and `/static/css/simplemde.min.css` instead of a CDN. This improves page load times, reduces external dependencies, and allows for use in offline or air-gapped environments. (Ref: `simplemde.min.js`, `simplemde.min.css` additions, template updates in `group_workspaces.html`, `workspace.html`)
+    *   General CSS cleanups across admin and workspace UIs.
+*   **D. General Stability**
+    *   Merged contributions from multiple devs including UI fixes, backend updates, and config changes.
+    *   Removed unused video/audio container declarations for a leaner frontend.
+
 ### **(v0.213.001)**
 
 #### New Features
 
@@ -86,7 +86,7 @@
 
 app.config['SECRET_KEY'] = os.getenv("SECRET_KEY")
 app.config['SESSION_TYPE'] = 'filesystem'
-app.config['VERSION'] = '0.213.003'
+app.config['VERSION'] = '0.214.001'
 Session(app)
 
 CLIENTS = {}
@@ -383,10 +383,32 @@ def initialize_clients(settings):
 
         try:
             if enable_enhanced_citations:
-                CLIENTS["storage_account_office_docs_client"] = BlobServiceClient.from_connection_string(settings.get("office_docs_storage_account_url"))
+                blob_service_client = BlobServiceClient.from_connection_string(settings.get("office_docs_storage_account_url"))
+                CLIENTS["storage_account_office_docs_client"] = blob_service_client
+                
+                # Create containers if they don't exist
+                # This addresses the issue where the application assumes containers exist
+                for container_name in [storage_account_user_documents_container_name, storage_account_group_documents_container_name]:
+                    try:
+                        container_client = blob_service_client.get_container_client(container_name)
+                        if not container_client.exists():
+                            print(f"Container '{container_name}' does not exist. Creating...")
+                            container_client.create_container()
+                            print(f"Container '{container_name}' created successfully.")
+                        else:
+                            print(f"Container '{container_name}' already exists.")
+                    except Exception as container_error:
+                        print(f"Error creating container {container_name}: {str(container_error)}")
+                
+                # Handle video and audio support when enabled
                 # if enable_video_file_support:
-                #     CLIENTS["storage_account_video_files_client"] = BlobServiceClient.from_connection_string(settings.get("video_files_storage_account_url"))
+                #     video_client = BlobServiceClient.from_connection_string(settings.get("video_files_storage_account_url"))
+                #     CLIENTS["storage_account_video_files_client"] = video_client
+                #     # Create video containers if needed
+                #
                 # if enable_audio_file_support:
-                #     CLIENTS["storage_account_audio_files_client"] = BlobServiceClient.from_connection_string(settings.get("audio_files_storage_account_url"))
+                #     audio_client = BlobServiceClient.from_connection_string(settings.get("audio_files_storage_account_url"))
+                #     CLIENTS["storage_account_audio_files_client"] = audio_client
+                #     # Create audio containers if needed
         except Exception as e:
             print(f"Failed to initialize Blob Storage clients: {e}")
@@ -1110,8 +1110,55 @@ def get_document_version(user_id, document_id, version, group_id=None):
     except Exception as e:
         return jsonify({'error': f'Error retrieving document version: {str(e)}'}), 500
 
+def delete_from_blob_storage(document_id, user_id, file_name, group_id=None):
+    """Delete a document from Azure Blob Storage."""
+    is_group = group_id is not None
+    storage_account_container_name = (
+        storage_account_group_documents_container_name
+        if is_group else
+        storage_account_user_documents_container_name
+    )
+    
+    # Check if enhanced citations are enabled and blob client is available
+    settings = get_settings()
+    enable_enhanced_citations = settings.get("enable_enhanced_citations", False)
+    
+    if not enable_enhanced_citations:
+        return  # No need to proceed if enhanced citations are disabled
+    
+    try:
+        # Construct the blob path using the same format as in upload_to_blob
+        blob_path = f"{group_id}/{file_name}" if is_group else f"{user_id}/{file_name}"
+        
+        # Get the blob client
+        blob_service_client = CLIENTS.get("storage_account_office_docs_client")
+        if not blob_service_client:
+            print(f"Warning: Enhanced citations enabled but blob service client not configured.")
+            return
+            
+        # Get container client
+        container_client = blob_service_client.get_container_client(storage_account_container_name)
+        if not container_client:
+            print(f"Warning: Could not get container client for {storage_account_container_name}")
+            return
+            
+        # Get blob client
+        blob_client = container_client.get_blob_client(blob_path)
+        
+        # Delete the blob if it exists
+        if blob_client.exists():
+            blob_client.delete_blob()
+            print(f"Successfully deleted blob at {blob_path}")
+        else:
+            print(f"No blob found at {blob_path} to delete")
+            
+    except Exception as e:
+        print(f"Error deleting document from blob storage: {str(e)}")
+        # Don't raise the exception, as we want the Cosmos DB deletion to proceed
+        # even if blob deletion fails
+
 def delete_document(user_id, document_id, group_id=None):
-    """Delete a document from the user's documents in Cosmos DB."""
+    """Delete a document from the user's documents in Cosmos DB and blob storage if enhanced citations are enabled."""
     is_group = group_id is not None
     cosmos_container = cosmos_group_documents_container if is_group else cosmos_user_documents_container
 
@@ -1123,7 +1170,19 @@ def delete_document(user_id, document_id, group_id=None):
 
         if (document_item.get('user_id') != user_id) or (is_group and document_item.get('group_id') != group_id):
             raise Exception("Unauthorized access to document")
-
+            
+        # Get the file name from the document to use for blob deletion
+        file_name = document_item.get('file_name')
+        
+        # First try to delete from blob storage
+        try:
+            if file_name:
+                delete_from_blob_storage(document_id, user_id, file_name, group_id)
+        except Exception as blob_error:
+            # Log the error but continue with Cosmos DB deletion
+            print(f"Error deleting from blob storage (continuing with document deletion): {str(blob_error)}")
+        
+        # Then delete from Cosmos DB
         cosmos_container.delete_item(
             item=document_id,
             partition_key=document_id