From e2283dad81db77484f2a7ba2c8bf64c48e2eacf3 Mon Sep 17 00:00:00 2001 From: sandeepyadav-lt Date: Wed, 5 Nov 2025 00:58:58 +0530 Subject: [PATCH 1/2] atx-6205 Update terminology in AI RCA documentation: changed "Always failing" to "Consistent Failures" for clarity. --- docs/analytics-ai-root-cause-analysis.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/analytics-ai-root-cause-analysis.md b/docs/analytics-ai-root-cause-analysis.md index c8427ea8..0bf52c2d 100644 --- a/docs/analytics-ai-root-cause-analysis.md +++ b/docs/analytics-ai-root-cause-analysis.md @@ -76,7 +76,7 @@ AI RCA is an intelligent feature that uses advanced machine learning algorithms 2. **Configure Analysis Scope**: Choose which types of test failures to analyze: - **All failures**: Analyze every failed test, regardless of previous status - **New failures**: Analyze only tests that have failed recently after having passed at least 10 consecutive times previously. - - **Always failing**: Analyze only tests that have failed in all of their previous 5 runs to identify persistent issues. + - **Consistent Failures**: Analyze only tests that have failed in all of their previous 5 runs to identify persistent issues. ### Step 3: Set Special Instructions (Optional) From ca16c94c0ec1ae96c8c17dbac7a1141ddfd996bf Mon Sep 17 00:00:00 2001 From: sandeepyadav-lt Date: Wed, 5 Nov 2025 02:10:37 +0530 Subject: [PATCH 2/2] Enhance AI RCA documentation by adding project name targeting rules and clarifying cross-category logic for intelligent targeting configuration. atx-6209 --- docs/analytics-ai-root-cause-analysis.md | 11 ++++++++--- 1 file changed, 8 insertions(+), 3 deletions(-) diff --git a/docs/analytics-ai-root-cause-analysis.md b/docs/analytics-ai-root-cause-analysis.md index 0bf52c2d..9a645c17 100644 --- a/docs/analytics-ai-root-cause-analysis.md +++ b/docs/analytics-ai-root-cause-analysis.md @@ -130,7 +130,7 @@ Our CRM application has specific failure patterns to watch for: ### Step 4: Configure Intelligent Targeting -Configure intelligent targeting rules to precisely control which tests, builds, tags, or jobs are included in AI-powered analysis: +Configure intelligent targeting rules to precisely control which tests, builds, tags, projects, or jobs are included in AI-powered analysis: 1. **Add Targeting Rules**: Enter regex patterns in the input field 2. **Click Include (+) or Exclude (-)**: Choose whether to include or exclude matching tests @@ -139,6 +139,7 @@ Configure intelligent targeting rules to precisely control which tests, builds, - **Build Names**: Include or exclude builds with specific names (e.g., hourly, nightly) - **Test Tags**: Include or exclude tests with specific tags (e.g., playwright_test, atxHyperexecute_test) - **Build Tags**: Include or exclude builds with specific tags (e.g., hourly, nightly) + - **Project Names**: Include or exclude tests from specific projects using regex patterns - **Job Labels**: Include tests with specific job labels or tags #### Rule Logic and Application @@ -148,7 +149,7 @@ The intelligent targeting system applies rules using the following logic: **Rule Evaluation Process:** 1. **Include Rules (AND Logic)**: All Include rules within the same category must match for a test to be considered 2. **Exclude Rules (OR Logic)**: Any Exclude rule that matches will immediately exclude the test from analysis -3. **Cross-Category Logic**: Include rules across different categories (Test Names, Build Tags, etc.) must ALL match +3. **Cross-Category Logic**: Include rules across different categories (Test Names, Build Tags, Project Names, etc.) must ALL match 4. **Exclusion Precedence**: Exclude rules take priority over Include rules - if any exclude rule matches, the test is excluded regardless of include matches **Best Practices for Rule Configuration:** @@ -173,7 +174,11 @@ The intelligent targeting system applies rules using the following logic: - **Include**: `playwright_test|atxHyperexecute_test` - Focus on specific test frameworks - **Exclude**: `.*smoke.*` - Skip smoke tests -**Result**: AI-powered analysis will run only on production tests (excluding non-critical ones) from hourly builds, focusing on Playwright or HyperExecute test tags, while excluding smoke tests. This configuration helps narrow down analysis to the most critical test scenarios. +**Project Names:** +- **Include**: `^ecommerce|^payment` - Only analyze tests from projects starting with "ecommerce" or "payment" +- **Exclude**: `.*staging.*` - Skip tests from staging projects + +**Result**: AI-powered analysis will run only on production tests (excluding non-critical ones) from hourly builds, focusing on Playwright or HyperExecute test tags, while excluding smoke tests. The analysis will target ecommerce and payment projects, excluding staging projects. This configuration helps narrow down analysis to the most critical test scenarios. :::