Skip to content

v0.4.0 - Marketing Analytics Explorer (Feature 004)

Latest
Latest

Choose a tag to compare

View all tags
@bryan-db bryan-db released this 07 Oct 15:18
· 3 commits to 004-data-exploration-frontend since this release
v0.4.0
b06729b

Marketing Analytics Explorer - Live Databricks Integration

Complete implementation of Feature 004 with 5 React dashboards fetching live data from Unity Catalog.

🎯 Features Implemented

Analytics Dashboards (5 total)

  • ✅ DataOverview: Summary metrics across all data sources
  • ✅ CampaignPerformance: Campaign analytics with role-based filtering
  • ✅ ContentEngagement: Event tracking and content analysis
  • ✅ AudienceInsights: Segment demographics and comparison
  • ✅ AttributionAnalysis: Funnel metrics and attribution models

Data Integration

  • ✅ Unity Catalog integration (bryan_li.synthetic_datasets, bryan_li.analytics)
  • ✅ SQL Warehouse queries via Statement Execution API 2.0
  • ✅ React Query hooks for caching and state management
  • ✅ Role-based access control (CMO vs Analyst)
  • ✅ Sync table fallback to Delta Lake

🔧 Infrastructure Improvements

CORS & API Configuration

  • ✅ Vite proxy configuration for local development
  • ✅ dbsqlClient with relative URLs in dev mode
  • ✅ Environment validation (warehouse ID, tokens, catalog)
  • ✅ Dev mode mock authentication

Schema Corrections

  • ✅ Fixed: raw_data → synthetic_datasets
  • ✅ Fixed: target_segments → target_segment
  • ✅ Fixed: total_engagements → event_count
  • ✅ Removed _sync suffix assumptions
  • ✅ Added schema validation with DESCRIBE commands

📚 Documentation

Project Constitution

  • ✅ 14 core principles for Databricks development
  • ✅ Mandatory Unity Catalog, serverless compute, Asset Bundles
  • ✅ Schema validation and testing practices
  • ✅ Version control and release management requirements
  • ✅ Lessons learned from implementation

🧪 Testing

  • ✅ Contract tests for all 5 gold table schemas
  • ✅ Real Databricks infrastructure validation
  • ✅ Schema mismatch detection and prevention

📦 Tech Stack

  • React 18 + Vite + Material-UI v5
  • TanStack React Query
  • Recharts + Nivo (visualizations)
  • Databricks SQL Warehouse (03560442e95cb440)
  • Unity Catalog with medallion architecture

🚀 Deployment

Access dashboards at: http://localhost:5173/dashboards/overview

Environment Variables Required:

VITE_DATABRICKS_HOST=https://e2-demo-field-eng.cloud.databricks.com
VITE_DATABRICKS_TOKEN=<your-pat-token>
VITE_DATABRICKS_WAREHOUSE_ID=03560442e95cb440
VITE_DATABRICKS_CATALOG=bryan_li

🔄 Rollback

To rollback to previous version: git checkout v0.3.0

Full Changelog: v0.3.0...v0.4.0

Assets 2
Loading