refactor: replace ai foundry avm pattern with cognitive service account avm resource module

[Harsh-Microsoft]

Purpose

This pull request refactors and re-enables the deployment of AI Foundry resources in the infrastructure Bicep templates. The changes break out the AI Foundry project and AI Services into separate, modular deployments, add support for private endpoints, and improve configuration flexibility and clarity. Additionally, a new ai-project.bicep module is introduced to manage AI Foundry projects as first-class resources.

Key changes include:

AI Foundry Resource Modularization and Re-enablement

• Replaces the previously disabled monolithic AI Foundry module with separate modules for Cognitive Services (AI Services), private endpoints, and the AI Foundry project itself, allowing for more granular control and future extensibility. (infra/main.bicep, infra/main_custom.bicep) [1] [2]

New AI Project Module

• Introduces modules/ai-project.bicep, which provisions an AI Foundry project as a child resource of a Cognitive Services account, with support for tagging, managed identity, and outputting key resource identifiers. (infra/modules/ai-project.bicep)

Private Networking and Endpoint Support

• Adds a dedicated module for creating private endpoints for AI Foundry AI Services, including configuration for private DNS zones and subnet assignment, improving support for secure, network-isolated deployments. (infra/main.bicep, infra/main_custom.bicep) [1] [2]

Parameter and Variable Enhancements

• Adds new variables for AI Foundry project resource names and descriptions, improving naming consistency and clarity across deployments. (infra/main.bicep, infra/main_custom.bicep) [1] [2]

Dependency and Output Adjustments

• Updates module dependencies to ensure correct deployment order, especially regarding the new modular resources, and adjusts outputs for downstream consumption. (infra/main.bicep)

These changes collectively improve maintainability, security, and clarity for managing AI Foundry resources in the infrastructure codebase.

Does this introduce a breaking change?

• Yes
• No

Golden Path Validation

• I have tested the primary workflows (the "golden path") to ensure they function correctly without errors.

Deployment Validation

• I have validated the deployment process successfully and all services are running as expected with this change.

What to Check

Verify that the following are valid

• ...

Other Information