Releases: microsoft/Power-CAT-Copilot-Studio-Kit
Release list
Copilot Agent Kit August 2026 Update 1 – Agent Review Tool Setup Fix
Agent Review Tool setup update
This maintenance update improves the setup experience for the Agent Review Tool.
After installing or upgrading Copilot Agent Kit:
- Open Setup Wizard.
- Open the Agent Review installer.
- Select Set up Agent Review.
- Wait until all four setup checks show Ready.
- Select Open Agent Review Tool.
For complete requirements and troubleshooting, see
Set up Agent Review with the Setup Wizard and Installer.
Changes included from the August 2026 release
-
New feature: Agent Change Tracker - Opt agents into continuous change tracking and see what changed, who made the change, and when it was saved. Agent Change Tracker captures a baseline when tracking begins, then organizes supported additions, updates, and removals into a versioned timeline with maker details, before-and-after values, friendly summaries, and YAML details. Learn more about Agent Change Tracker
-
Enhanced Agent Library with a gallery of ready-to-deploy MCP Apps.
-
Agent Review Tool: Review the new GitHub Copilot harness-based Copilot Studio agents with Skill Evaluator, Agent Map, instruction coverage, and Cost and Efficiency insights.
-
Skills and Automations: Upload agent skills, Microsoft Scout automations, or automation installers. Review quality, safety, readiness, and compatibility with Copilot Cowork, Microsoft Scout, and Copilot Studio.
-
Agent Inventory enhancements:
- Added Agent Inventory Settings to configure how agents are discovered, synchronized, and monitored across environments.
- Added a dedicated Agent Inventory Bulk Actions within model-driven app for quarantining, unquarantining, and reassigning multiple agents.
- Added multilingual metadata extraction to improve inventory support for agents in different languages.
- Added richer governance metadata, including Skills, Powered By, and other key agent attributes.
-
Optimized Agent Value Summary daily scans to reduce AI credit consumption when generating summaries.
-
Enhanced Agent Debugger:
- Added support for GitHub Copilot harness-based Copilot Studio agents.
- Added filter for channel and improved duration formatting.
-
Enhanced Test Automation so adaptive cards can be used as test responses.
First Time Setup Instructions
Upgrade Instructions
Important Instructions
- Before you download and install the Copilot Agent Kit, ensure that you enable code components and code apps in your environment first.
Copilot Agent Kit August 2026
Changes
-
New feature: Agent Change Tracker - Opt agents into continuous change tracking and see what changed, who made the change, and when it was saved. Agent Change Tracker captures a baseline when tracking begins, then organizes supported additions, updates, and removals into a versioned timeline with maker details, before-and-after values, friendly summaries, and YAML details. Learn more about Agent Change Tracker
-
Enhanced Agent Library with a gallery of ready-to-deploy MCP Apps.
-
Agent Review Tool: Review the new GitHub Copilot harness-based Copilot Studio agents with Skill Evaluator, Agent Map, instruction coverage, and Cost and Efficiency insights.
-
Skills and Automations: Upload agent skills, Microsoft Scout automations, or automation installers. Review quality, safety, readiness, and compatibility with Copilot Cowork, Microsoft Scout, and Copilot Studio.
-
Agent Inventory enhancements:
- Added Agent Inventory Settings to configure how agents are discovered, synchronized, and monitored across environments.
- Added a dedicated Agent Inventory Bulk Actions within model-driven app for quarantining, unquarantining, and reassigning multiple agents.
- Added multilingual metadata extraction to improve inventory support for agents in different languages.
- Added richer governance metadata, including Skills, Powered By, and other key agent attributes.
-
Optimized Agent Value Summary daily scans to reduce AI credit consumption when generating summaries.
-
Enhanced Agent Debugger:
- Added support for GitHub Copilot harness-based Copilot Studio agents.
- Added filter for channel and improved duration formatting.
-
Enhanced Test Automation so adaptive cards can be used as test responses.
First Time Setup Instructions
Upgrade Instructions
Important Instructions
- Before you download and install the Copilot Agent Kit, ensure that you enable code components and code apps in your environment first.
Copilot Agent Kit June 2026
Changes
-
Added Test Automation Pipeline Automation for agents requiring authentication, enabling automated execution of test suites as part of deployment and DevOps workflows.
-
Agent Insights Hub enhancements:
- Added Agent Configuration filtering
- Added support for Copilot Evaluation, Microsoft 365 Copilot, and SharePoint channels
- Improved channel filtering and handling of unknown/unmapped channels
- Simplified reporting by removing Action ID from grids, exports, and drill-in views
-
Added In-Feature Settings for Advanced Testing, providing guided configuration of connections, cloud flows, environment variables directly within the feature experience.
-
Added Agent Inventory Actions, allowing administrators to take actions directly from Agent Inventory.
-
Enhanced Agent Library:
- Added agent template filtering
- Improved draft mode with clear active/inactive status indicators
- Added support for GCC and GCC High environments
-
Moved Agent Usage Components to the main solution, simplifying deployment and solution management.
Github issues fixed (improvements and issues):
-
At least one flow hard-coded to Commercial API (not compliant with GCC) #727
-
Setup Wizard | Get Solution Flows Details optimization to reduce execution timeouts #761
-
Hard-coded commercial endpoints fail in GCC for Agent Library & Adaptive Card Gallery #748
First Time Setup Instructions
Upgrade Instructions
Important Instructions
- Before you download and install the Copilot Agent Kit, ensure that you enable code components and code apps in your environment first.
Copilot Agent Kit May 2026
Changes
-
Copilot Studio Kit is becoming Copilot Agent Kit. The new name reflects the Kit's expanding focus on supporting Microsoft agentic solutions across Copilot Studio, Microsoft 365 Copilot, Microsoft Agent 365, Azure AI Foundry, and other agent-based platforms. While most of the documentation and assets still reference Copilot Studio Kit, the solution and user experience have largely been updated to the Copilot Agent Kit branding.
-
Added Agent Metrics Dashboard allowing makers and administrators to create custom dashboards and forecasts using Copilot Agent Kit data.
-
Added Conversation Analyzer Dashboard providing an at-a-glance view of analysis coverage, trends, sentiment, credit consumption, and key analysis results.
-
Added Feature Health & Settings Views for Power Shield, providing guided setup, health monitoring, and feature-specific configuration directly within the feature experience.
-
Conversation KPI enhancements for agent tools, knowledge files, autonomous agents, and connected agents.
-
Added new Agent Inventory fields:
- Uses Computer Use
- Number of Evaluations
- Agent Owning Business Unit
-
Agent Insights Hub enhancements:
- Added insights for autonomous agents, including run counts, success rates, and execution duration metrics
- Added visibility into connected agents, including invocation counts and success rates
-
Added Wave 2 Agent Library templates:
- AI Learning Advisor – personalized guidance for Microsoft AI, Copilot Studio, Power Apps, Power Automate, Dataverse, and Microsoft 365 Copilot
- Status Update Agent – generates progress reports, accomplishments, and activity summaries from Microsoft 365 data
- SME Finder – identifies subject matter experts across the organization and prepares outreach recommendations
- Project Delta Digest – summarizes project activity, milestones, blockers, and emerging risks
- Personal News Digest – creates personalized business update summaries from Microsoft 365 signals
-
Migrated Conversation Analyzer to a Code App architecture.
-
Compliance Hub: Fixed threshold configuration issues.
-
Test Automation now automatically processes dialogs presented by the agent at the start of a test session, eliminating the need for one-time manual setup per account and agent.
-
Added file input support to Test Automation, allowing test cases to provide files as inputs to agents.
-
Agent Debugger enhancements:
- Support for snapshots
- Added Agent Details view
- Added direct link to Agent
-
Agent Review Tool: Added support for CI/CD pipeline integration, enabling automated agent reviews as part of deployment workflows.
Github issues fixed (improvements and issues):
First Time Setup Instructions
Upgrade Instructions
Important Instructions
- Before you download and install the Copilot Agent Kit, ensure that you enable code components and code apps in your environment first.
Copilot Agent Kit mid-June 2026
Changes
- Added support for custom agent templates in the Agent Library
First Time Setup Instructions
Upgrade Instructions
Important Instructions
- Before you download and install the Copilot Agent Kit, ensure that you enable code components and code apps in your environment first.
Copilot Studio Kit April 2026
Changes
- New feature: Agent Library, a curated set of pre-configured agent templates (both custom and declarative) designed for high-impact, common business scenarios based on Microsoft customer success team analysis. Custom agents such as "Know My Customer" and "Request Tracker" can be installed directly into Copilot Studio or downloaded for manual import. Declarative agents are built with the M365 VS Code extension and can be customized before installation. All templates are hosted in a public GitHub repository with live updates, and two new reusable components ("log chain of thoughts" and "save conversation history") have been added to the Component Library.
- New feature: Agent Debugger, a diagnostic tool inside the Copilot Studio Kit Admin app that lets administrators load any recorded conversation and inspect every decision the agent made, including topics, actions, knowledge searches, timing data, and token consumption.
- New feature: PowerShield, a governance tool for managing agent and connector access through a DLP (Data Loss Prevention) policy request and automation process. Makers can submit requests for custom DLP policies tied to specific projects, including environment selection, connector and action requests, and a customizable questionnaire. Admins can review, approve, and automatically provision DLP policies via Power Platform APIs. The process includes notifications, comment threads for clarification, and the ability to withdraw or modify requests before approval.
- Agent Value Summary Dashboard, Prompt Advisor, and Automated Testing landing page have been modernized to Code Apps.
- Agent Review Tool now supports reviewing declarative agents from a ZIP file, with support for additional review patterns.
- Conversation Analyzer improvements: support for exporting analysis data, ability to delete previous analysis records, improved error handling when the selected agent has no transcripts, and Next/Previous navigation in the detailed analysis results view.
- Test cases and in-product evaluations can now be selectively exported to Excel, covering both Copilot Studio Kit automated test cases and Copilot Studio native evals.
- Conversation KPIs now include user prompts and agent responses, along with available feedback and knowledge file insights—covering files that were surfaced, used, and cited in the answers.
- Agent Inventory base agent data population from PPAC Agents Inventory is now configurable (enabled / disabled)
Github issues fixed (improvements and issues):
- Bug: Conversation KPI generation fails when environment/user date format is dd.MM.yyyy instead of ISO 8601 #665
- Bug: Setup Wizard links to flows do not navigate to flow in GCC High #648
- MSFT Authentication GCC Tenant #319
- March 2026 "Query Power Platform resources: Agents" fails in GCC #661
- Feature request: Agent Owner field within Inventory #671
- Feature Request: Agent Inventory - Include Agent Schema In Inventory #417
- Feature request: Agent Inventory - show if agent settings has 'use general knowledge' and 'use info from the web' #575
- Agent Inventory is showing Deleted Agents #664
- The response is not a JSON format (Agent Data Load Grand Child) #652
- Bug: Retrieve a list of environments failing for agent inventory data load #650
- Bug: Agent Inventory | Usage Data Load (GrandChild) Http request failed: Bad Request #603
- Bug: Agent Usage stopped generating reports #628
- Bug: Cannot have usage data for the agent #674
- Connection request for Power Platform Admin Centre #657
- [Agent Test Runner] Conversation ID not resolved when ConversationStart topic is disabled #514
First Time Setup Instructions
Upgrade Instructions
Important Instructions
- Before you download and install the Copilot Studio Kit, ensure that you enable code components and code apps in your environment first.
Copilot Studio Kit March 2026
Changes
- New feature: Agent Insights Hub, monitor agent performance, usage metrics, and conversation analytics across your Copilot Studio agents.
- New feature: Component Library, collection of ready-to-use, pre-built components for Microsoft Copilot Studio
- Conversation KPIs now shows the feedback data if available
- Agent Inventory populates the base agent data from PPAC Agents Inventory
Github issues fixed (improvements and issues):
- Agent Compliance | Compliance Scan flow 'A binary incompatibility #584
- Missing Unquarentine button #580
- Bug: Conversation KPIs - Discrepancies between Copilot Studio Analytics and Copilot Studio Kit / Dashboard refresh issue #598
- Plan Validation Test Fails with “Pass threshold was not met (0/10)” — Actual Tools Not Detected. #552
- [Bug] Agent Inventory | Agents Data Load (GrandChild) flow: The 'GetFeatureEnabledState' message is not supported #585
- Timeout Error with Agent Inventory | Usage Data Load #511
- Bug: Default environment agent consumption missing #608
- Bug: Billed messages vs PAPAC consumption mismatch #609
- Bug: Billed messages and Power platform admin center billed message mismatch #610
- Bug: Agent Sync not updating after running Child flow #618
- Bug: Agent Compliance | Compliance Scan flow error #612
- Agent Inventory Compliance Scan flow error in Copilot Studio #602
First Time Setup Instructions
Upgrade Instructions
Important Instructions
- Before you download and install the Copilot Studio Kit, ensure that you enable code components and code apps in your environment first.
Copilot Studio Kit January 2026
Changes
- Added rubric management for AI grading instructions
- Added AI-powered rubric refinement workflow
- Added rubric selection and AI grading for Test Automation (Generative Answers test type)
- Expanded usage data range to six months
Github issues fixed (improvements and issues):
- Compliance Hub: GetBotQuarantineStatus fails when called from custom page in GCC #463
- Conversation KPI generation fails due to null reference and conversation ID length limit #486
- Compliance Case Inventory: Button missing label #509
- Increase Test Utterance field length beyond 2000 characters #515
- Compliance Hub: Comments input box too small / UI issue #519
- Compliance Hub: Comments cut off in timeline #520
- Compliance Hub: Enforcement action shows choice ID instead of value #521
- Compliance Hub: Unformatted date shown in case details #522
- Compliance Hub: SLA deadline shows placeholder text #523
- Compliance Hub: Update Case flow fails on “unrelate violation” step #525
- Missing Power CAT Copilot Studio Kit security roles #528
- Conversation KPIs: Chat history order incorrect and CSAT not populating #533
- Agent Inventory: Skip disabled environments during data load #535
- Conversation KPI generation: Skip failed records and update status on errors #538
- Usage data load: Report download fails #539
- Conversation KPI data not syncing to Power BI report #569
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Kit December 2025
Changes
- Agent Review Tool has improved UI and engine.
- SharePoint File Sync now supports syncing over 500 files
- Conversation KPI: Corrected display where Conversation ID appeared as “deflection”
- Agent Review Tool: Improved load performance for review details
- Agent Inventory: AI Prompts recognized as Tools
- Agent Inventory: Web Search available in inventory
- Agent Value Summary: Corrected summary number inconsistencies
- Usage performance improvements within Agent Inventory
- Localization updates for Side Navigation.
- Setup Wizard: Dropdown control for Boolean values (replaces free-text field)
- Agent Inventory: Console error fix (#445)
- Sync Agent: Button state logic fixed (#459)
- Conversation KPI: Transcript merging updated to respect new inactivity thresholds
Github issues fixed (improvements and issues):
- Generative Answer Failure #433
- Inventory Data Question Handling #453
- Agent Review Tool slow loading #269
- Conversation KPI “deflection” ID issue #345
- Web Search in Inventory #439
- Web Search in Inventory #450
- Tools not detected in Inventory #441
- Agent Inventory Console Error #445
- Sync Agent button disabled #459
- Agent Value Summary number oddities #480
- Hard-coded AdminAlias in "Agent Compliance | Quarantine" flow #461
- Compliance Hub Threshold Configs – Support Additional Filter Operators #466
- Bing Usage Field / Bing Usage Compliance Threshold and Email #439
- Compliance Hub – Don't add users to Maker group #442
First Time Setup Instructions
Upgrade Instructions
Copilot Studio Kit October 2025
Changes
Compliance Hub - Customizable agent compliance review process leveraging information in the Agent Inventory- Separate landing pages for administrators and makers - simplified roles with increased data segregation for makers
- Historical agent usage information in agent details view
- Agent configuration cloning
- Conversation Analyzer prompt management improvements, improved conversation selection
- Validation for tracked variables for Conversation KPIs
- Secret masking in e.g. agent configuration view
- Complete agent response in test results show all messages received from the agent
- Adaptive card actions support for Microsoft Authentication
- Knowledge support in Plan Validation
Issues fixed: