issues Search Results · repo:NVIDIA/garak language:Python
Filter by
691 results
(109 ms)691 results
inNVIDIA/garak (press backspace or delete to remove)!-- Please fill out each section below, otherwise, your issue will be closed. This info allows garak maintainers to
diagnose (and fix!) your issue as quickly as possible.
Useful Links:
- Wiki: https://docs.garak.ai/garak ...
bug
ajlandaeta
- 1
- Opened yesterday
- #1303
Helllo every body why get this error when run this command: cmmand:
arak --probes suffix.GCG --model_type huggingface --model_name Qwen/Qwen3-14B
error:
🕵️ queue of probes: suffix.GCG
GCG generation ...
bug
bug-verified
javadKefayati
- 4
- Opened 4 days ago
- #1301
!-- Please fill out each section below, otherwise, your issue will be closed. This info allows garak maintainers to
diagnose (and fix!) your issue as quickly as possible.
Useful Links:
- Wiki: https://docs.garak.ai/garak ...
bug
Zippo00
- 1
- Opened 5 days ago
- #1297
From qual_review:
### Probe and detector: phrasing.FutureTense+mitigation.Prefixes
* passrate: `0.2352`
* z: `-0.2892011833963826`
Issues found:
* low z `-0.2892`
#### Examples of responses marked ...
bug
leondz
- Opened 17 days ago
- #1288
PR #1245 added report digest summary objects to report.jsonl
garak.analyze.aggregate_reports does not add this digest summary; it should.
reporting
- 1
- Opened 18 days ago
- #1287
Summary
Build in something like ASCII smuggler, potentially as a buff.
Motivation
Better guardrail bypasses, improved ASR, more stealth.
buffs
erickgalinkin
- Opened 19 days ago
- #1282
garak.analyze.aggregate_reports is fine for putting together multiple report.jsonl files into one
#1245 added summary digests to the end of report.jsonl files
running garak.analyze.aggregate_reports ...
reporting
- Opened 20 days ago
- #1281
Summary
I was trying to scan o3-mini in Azure Gov. All the test cases are getting skipped. I identified o3-mini was not included
in the list of LLMs at .generators/azure.py. I added it but is not working. ...
question
wpabon123
- 7
- Opened 21 days ago
- #1277
Existing LLMaaJ prompts can be defined in code. Currently a prompt defined in garak/resources/red_team/system_prompts.py
is consumed in multiple places. Probes / detectors should have better control over ...
- 1
- Opened 21 days ago
- #1275
improve serialisation of configs
- centralise this - don t do it in e.g. command
- don t serialise things we don t need, including
- constants
- api keys
- do capture everything set ...
high priority
- 2
- Opened on Jun 13
- #1255
Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Restrict your search to the title by using the in:title qualifier.Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Press the /
key to activate the search input again and adjust your query.