issues Search Results · repo:NVIDIA/garak language:Python
Filter by
688 results
(126 ms)688 results
inNVIDIA/garak (press backspace or delete to remove)From qual_review:
### Probe and detector: phrasing.FutureTense+mitigation.Prefixes
* passrate: `0.2352`
* z: `-0.2892011833963826`
Issues found:
* low z `-0.2892`
#### Examples of responses marked ...
bug
leondz
- Opened 8 days ago
- #1288
PR #1254 added report digest summary objects to report.jsonl
garak.analyze.aggregate_reports does not add this digest summary; it should.
reporting
- Opened 9 days ago
- #1287
Summary
Build in something like ASCII smuggler, potentially as a buff.
Motivation
Better guardrail bypasses, improved ASR, more stealth.
buffs
erickgalinkin
- Opened 10 days ago
- #1282
garak.analyze.aggregate_reports is fine for putting together multiple report.jsonl files into one
#1245 added summary digests to the end of report.jsonl files
running garak.analyze.aggregate_reports ...
reporting
- Opened 11 days ago
- #1281
Summary
I was trying to scan o3-mini in Azure Gov. All the test cases are getting skipped. I identified o3-mini was not included
in the list of LLMs at .generators/azure.py. I added it but is not working. ...
question
wpabon123
- 5
- Opened 12 days ago
- #1277
Existing LLMaaJ prompts can be defined in code. Currently a prompt defined in garak/resources/red_team/system_prompts.py
is consumed in multiple places. Probes / detectors should have better control over ...
- 1
- Opened 13 days ago
- #1275
improve serialisation of configs
- centralise this - don t do it in e.g. command
- don t serialise things we don t need, including
- constants
- api keys
- do capture everything set ...
high priority
- 2
- Opened 29 days ago
- #1255
FAILED tests/plugins/test_plugin_load.py::test_instantiate_probes[probes.suffix.GCG] - garak.exception.GarakException:
np.infty was removed in the NumPy 2.0 release. Use np.inf instead. FAILED
tests/probes/test_probes.py::test_probe_metadata[probes.suffix.GCG] ...
bug
- 1
- Opened on Jun 6
- #1250
python -m garak -g1 -m test --report_prefix=./x -p test.Test
Image
this should be there once
bug
- Opened on Jun 6
- #1249
Remove octo generator
Acquired by nvidia 2409, api/sdk superceded by NIM
generators
- Opened on Jun 6
- #1247
Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Press the /
key to activate the search input again and adjust your query.Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Restrict your search to the title by using the in:title qualifier.