feat: Merge the AVM WAF,Azd Quota check, EXP changes from dev to main

[Roopan-Microsoft]

Purpose

• This pull request introduces significant enhancements to the deployment configuration, infrastructure scripts, and end-to-end testing framework. Key updates include improved Azure resource configuration, enhanced script robustness, and enriched test functionality for better validation and debugging.

Deployment Configuration Updates:

• Log Analytics Workspace Reuse Instructions: Added detailed steps in docs/DeploymentGuide.md for configuring an existing Log Analytics Workspace, including instructions to retrieve and set the Workspace ID.
• Improved Parameter Definitions: Updated infra/main.bicep to include new parameters like aiDeploymentsLocation and increased default capacities for GPT and embedding model deployments. [1] [2]
• Parameter File Migration: Replaced infra/main.bicepparam with infra/main.parameters.json for better compatibility and clarity in parameter management. [1] [2]

Infrastructure Script Enhancements:

• Retry Logic for Azure Blob Upload: Improved the infra/scripts/copy_kb_files.sh script with retry logic for file uploads to Azure Blob Storage, ensuring robustness against transient failures.
• Azure Subscription Validation: Enhanced infra/scripts/process_sample_data.sh to authenticate Azure CLI users and validate the selected subscription, providing fallback options for switching subscriptions interactively.

End-to-End Testing Improvements:

• Draft Section Validation: Refactored tests/e2e-test/pages/draftPage.py to include a robust timeout-based validation mechanism for draft sections, ensuring content integrity and detailed error reporting.
• Chat History Management: Added methods in tests/e2e-test/pages/generatePage.py for showing, closing, and deleting chat history, enhancing test coverage for user interaction flows.

These changes collectively improve the usability, reliability, and maintainability of the project.

Does this introduce a breaking change?

• Yes
• No

Golden Path Validation

• I have tested the primary workflows (the "golden path") to ensure they function correctly without errors.

Deployment Validation

• I have validated the deployment process successfully and all services are running as expected with this change.

What to Check

Verify that the following are valid

• I have built and tested the code locally and in a deployed app
• For frontend changes, I have pulled the latest code from main, built the frontend, and committed all static files.
• This is a change for all users of this app. No code or asset is specific to my use case or my organization.

Other Information

[github-actions]

🎉 This PR is included in version 1.4.2 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀