-
Notifications
You must be signed in to change notification settings - Fork 266
Issues: NVIDIA/garak
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
FEAT Add a custom REST LLM API template to Garak Config yaml file
#1041
opened Dec 10, 2024 by
EricXQiu
package garak for kali
housekeeping
Repository and project maintenance
#1036
opened Dec 5, 2024 by
leondz
error: 'latin-1' codec can't encode character '\u2026'
bug
Something isn't working
#1035
opened Dec 4, 2024 by
wiktorw767
probes: fileformats probe fails when targeting a local modal path
bug
Something isn't working
#1034
opened Dec 3, 2024 by
jmartin-tech
align prompt count per probe
architecture
Architectural upgrades
probes
Content & activity of LLM probes
#1032
opened Dec 2, 2024 by
leondz
reporting: enable logging & skipping of unrecognised probes, detectors in digest generation
reporting
Reporting, analysis, and other per-run result functions
#1024
opened Nov 25, 2024 by
leondz
probe: Image Hijack
new plugin
Describes an entirely new probe, detector, generator or harness
probes
Content & activity of LLM probes
#1023
opened Nov 25, 2024 by
leondz
probe: gritty pixy
new plugin
Describes an entirely new probe, detector, generator or harness
probes
Content & activity of LLM probes
#1020
opened Nov 22, 2024 by
leondz
atkgen: illegal content probe
probes
Content & activity of LLM probes
#993
opened Nov 11, 2024 by
leondz
detector: Use LLMaaJ to see if models are following payload instructions
architecture
Architectural upgrades
detectors
work on code that inherits from or manages Detector
feature: Enable Architectural upgrades
use_safetensors/True
for HF models and expose as config var
architecture
feature: Block pickle loading unless garak’s configured to do unsafe things
architecture
Architectural upgrades
feature: add plugin file date/hash to plugin load messages & logs for auditing
architecture
Architectural upgrades
test: run tests automatically at fixed time intervals, to catch shifts in dependencies
housekeeping
Repository and project maintenance
tests
Testing-related
feature: support audit trails, where asset IDs can be plugged in
architecture
Architectural upgrades
feature: Enable skipping of tests for policy points target is permissive over
architecture
Architectural upgrades
policy
Related to policy scanning
#983
opened Nov 11, 2024 by
leondz
feature: report target’s apparent policy & match to a predefined policies
architecture
Architectural upgrades
policy
Related to policy scanning
#982
opened Nov 11, 2024 by
leondz
11 tasks
atkgen: flexible probe
probes
Content & activity of LLM probes
#981
opened Nov 11, 2024 by
leondz
7 tasks
atkgen: Establish pipeline toolkit from target (represented as a detector) to trained model
architecture
Architectural upgrades
probes
Content & activity of LLM probes
#980
opened Nov 11, 2024 by
leondz
detector: non-engagement
detectors
work on code that inherits from or manages Detector
new plugin
Describes an entirely new probe, detector, generator or harness
#975
opened Nov 7, 2024 by
leondz
Previous Next
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.