[FEATURE] AI 4 : RAG Pipeline - Document Ingestion and Vector Store

[TFT444]

Objective

Build the ingestion pipeline that loads Azure security documentation, OpenShield rules, CIS controls and NIST controls into a vector store for retrieval.

What needs to be built

• Document loader for OpenShield rules and compliance frameworks
• Chunking and embedding pipeline
• Vector store integration
• Refresh mechanism when new rules are added

Acceptance criteria

• All OpenShield rules successfully ingested
• CIS and NIST controls ingested
• Vector store queryable with relevant results returned
• Refresh works without full rebuild

Priority

Phase 2