From 6a0fc41acd4b431c4edbcd5a1a1c75031d4c0e27 Mon Sep 17 00:00:00 2001 From: Pratyush Sharma <56130065+pratyush618@users.noreply.github.com> Date: Tue, 7 Apr 2026 15:19:48 +0530 Subject: [PATCH 1/3] Fix MDX parsing error in statistical-analysis doc --- docs/docs/advanced/statistical-analysis.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/docs/docs/advanced/statistical-analysis.md b/docs/docs/advanced/statistical-analysis.md index 4bc47a5..1e76215 100644 --- a/docs/docs/advanced/statistical-analysis.md +++ b/docs/docs/advanced/statistical-analysis.md @@ -102,10 +102,10 @@ Stability assessments are based on the coefficient of variation (CV): | CV Range | Assessment | |---|---| -| CV <= 0.05 | Highly stable | -| CV <= threshold | Stable | -| CV <= threshold x 2 | Moderately unstable | -| CV > threshold x 2 | Highly unstable | +| CV ≤ 0.05 | Highly stable | +| CV ≤ threshold | Stable | +| CV ≤ threshold x 2 | Moderately unstable | +| CV > threshold x 2 | Highly unstable | A warning is emitted if fewer than 3 runs are provided. From 2210603d4a4d5a5000227e0b7ba7c49e2883e6a6 Mon Sep 17 00:00:00 2001 From: Pratyush Sharma <56130065+pratyush618@users.noreply.github.com> Date: Wed, 8 Apr 2026 00:22:42 +0530 Subject: [PATCH 2/3] Fix MDX parsing errors in mutation-testing and red-teaming docs --- docs/docs/advanced/mutation-testing.md | 4 ++-- docs/docs/advanced/red-teaming.md | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/docs/advanced/mutation-testing.md b/docs/docs/advanced/mutation-testing.md index 830aae2..6e2306d 100644 --- a/docs/docs/advanced/mutation-testing.md +++ b/docs/docs/advanced/mutation-testing.md @@ -143,6 +143,6 @@ A mutation is considered "detected" if **any** metric on **any** test input prod As a rule of thumb: -- **>80% detection rate** -- strong evaluation coverage +- **80%+ detection rate** -- strong evaluation coverage - **50--80% detection rate** -- acceptable but review undetected mutations -- **<50% detection rate** -- evaluation metrics need improvement +- **Under 50% detection rate** -- evaluation metrics need improvement diff --git a/docs/docs/advanced/red-teaming.md b/docs/docs/advanced/red-teaming.md index 80a2840..8c92c2f 100644 --- a/docs/docs/advanced/red-teaming.md +++ b/docs/docs/advanced/red-teaming.md @@ -77,7 +77,7 @@ void agentShouldHandleBoundaryInputs(AgentTestCase testCase) { Built-in boundary tests: - Empty string -- Extremely long input (>100k characters) +- Extremely long input (100k+ characters) - Special characters and unicode - SQL/HTML/JSON injection strings - Null bytes and control characters From fc2226c8cee88c4a802049a252e786f77f40bfcf Mon Sep 17 00:00:00 2001 From: Pratyush Sharma <56130065+pratyush618@users.noreply.github.com> Date: Wed, 8 Apr 2026 00:22:47 +0530 Subject: [PATCH 3/3] Add docs build check workflow for PRs --- .github/workflows/docs-check.yml | 31 +++++++++++++++++++++++++++++++ 1 file changed, 31 insertions(+) create mode 100644 .github/workflows/docs-check.yml diff --git a/.github/workflows/docs-check.yml b/.github/workflows/docs-check.yml new file mode 100644 index 0000000..eb3c334 --- /dev/null +++ b/.github/workflows/docs-check.yml @@ -0,0 +1,31 @@ +name: Docs Check + +on: + pull_request: + paths: + - 'docs/**' + - '.github/workflows/docs-check.yml' + +jobs: + build: + name: Build Documentation + runs-on: ubuntu-latest + defaults: + run: + working-directory: docs + steps: + - name: Checkout + uses: actions/checkout@v6 + + - name: Set up Node.js + uses: actions/setup-node@v6 + with: + node-version: 20 + cache: npm + cache-dependency-path: docs/package-lock.json + + - name: Install dependencies + run: npm ci + + - name: Build site + run: npm run build