.Net: Az Template Support

[markwallace-microsoft]

Investigation

• Create a POC for the following RAG scenario
  • Create a template that contains the following
    • Application with a single endpoint that will perform RAG queries
    • All resources required to execute RAG queries e.g. LLM, Vector Database, ...
    • Support for configuring any supported SK AI or Vector Database service
  • Deploy the template and a REST API endpoint is made available which can be used to perform RAG queries

Description

"Azure Up Templates" into the Semantic Kernel repo to streamline the deployment process of the Kernel and its dependent services into Azure infrastructure. These templates are included in azd and the 'ai command line'

Requirements:

1. Azure Resource Manager (ARM) Templates Creation:
   • Develop ARM and/or bison templates for automatic deployment of the Semantic Kernel along with required Azure resources (e.g., VMs, Storage accounts, App Services, Databases, etc.).
   • Ensure templates support customization parameters (e.g., region, VM size, database scaling).
2. Template Documentation:
   • Provide comprehensive documentation for each template, explaining the parameters, default values, and instructions for customization.
   • Include examples of different deployment scenarios using the templates
3. Monitoring and Logging:
   • Integrate with Azure Monitor or other monitoring solutions to provide real-time insights.
4. Security and Compliance:
   • Ensure templates follow best security practices (e.g., secure parameters, least privilege principle).

Investigate:

1. Can templates be generated, and it is useful at runtime? E.g. Kernel.GenerateBisonTemplate()