Repository navigation
Releases: AbdaullahAG/SemGuard
Releases Β· AbdaullahAG/SemGuard
Release list
SemGuard v2.0.0 β Expanded Arabic Dataset (807 examples) & AGPLv3
What's New in v2.0.0
- π Arabic Security Dataset expanded from 319 β 807 validated examples across 7 threat categories
- π€ LLM-as-Judge validation pipeline using three independent judges (GPT-4o, Grok-4, Llama 3.3 70B), achieving Fleiss' ΞΊ = 0.839
- π Performance jump: mean F1 improved from 0.872 β 0.989 (+13.7%) after retraining
- π New finding: quantitative analysis of 527 rejected examples reveals a 98.2% inter-judge disagreement rate for the impersonation category
- π§Ή Repository restructured: separated dataset-generation dependencies (
requirements-dataset.txt) from core runtime (requirements.txt), organizeddataset_pipeline/ - βοΈ License changed to AGPLv3 to ensure network-deployed derivatives remain open
Paper
Accepted at IEEE AEECT 2026: "SemGuard: A Triple-Anchor Semantic Security Gateway for Multilingual Prompt Attack Detection in Large Language Models"
Dataset
Full dataset (including judge votes and disagreement corpus): HuggingFace