From 92c4e92f354041a76d7deff1ec58a398d34d58b2 Mon Sep 17 00:00:00 2001 From: Aravind Ramaraju <51247042+aramaraju@users.noreply.github.com> Date: Fri, 16 Feb 2024 13:35:13 -0800 Subject: [PATCH 1/2] Update TESTING.md Added Guardrails test conditions for JB client --- TESTING.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/TESTING.md b/TESTING.md index 8f1be28355..e709ddd898 100644 --- a/TESTING.md +++ b/TESTING.md @@ -774,6 +774,11 @@ Repeat the above starting from different themes. Changing theme should lead to full repaint of the colours according to the current theme. +### Guardrails: + +- [ ] Check if Guardrails check passes for any code longer than 10 lines generated in Cody Chat +- [ ] Check if Guardrails check failes for any code longer than 10 lines that matches indexed OSS + ## Inline Edit Select some code and right-click on it. Got to `Cody > Edit Code`. From e0983295b1751d02337e970f61ddcc30b5ca256b Mon Sep 17 00:00:00 2001 From: Cezary Bartoszuk Date: Tue, 16 Apr 2024 11:41:18 +0200 Subject: [PATCH 2/2] Specify success scenario attribution search test in detail --- TESTING.md | 13 ++++++++++--- 1 file changed, 10 insertions(+), 3 deletions(-) diff --git a/TESTING.md b/TESTING.md index e709ddd898..890ac2ef85 100644 --- a/TESTING.md +++ b/TESTING.md @@ -774,10 +774,17 @@ Repeat the above starting from different themes. Changing theme should lead to full repaint of the colours according to the current theme. -### Guardrails: +### Guardrails -- [ ] Check if Guardrails check passes for any code longer than 10 lines generated in Cody Chat -- [ ] Check if Guardrails check failes for any code longer than 10 lines that matches indexed OSS +In chat ask Cody a question to generate over 10 lines of text, for instance: `Please implement DFS in at least 10 lines of Haskell` + +#### Expected behavior + +When hovering over a code snippet printed by Cody, a set of buttons will appear. +The disabled one on the right-hand side is expected to say _Guardrails Check Passed_. +The tooltip for the button should say _Snippet not found on Sourcegraph.com._ + +The button is expected for a short time period (less than 10s) to indicate search is running rather than a positive check result. The button label at that point will just be _Attribution search_. ## Inline Edit