Skip to content

SecJev v1.1.0 — SecJev-2B

Choose a tag to compare

@ChenzhengUESTC ChenzhengUESTC released this 26 Sep 13:01
· 6 commits to main since this release
5adf512

SecJev-2B is now available: trained LoRA weights, decision head, calibrated probabilities, tokenizer and inference code. The pinned Qwen3.5-2B-Base backbone is downloaded separately by the included bootstrap script.

The model first learns general decisions from Kev’s method and data, then trains for three epochs on SecJev-Corpus v1.0.0. Epoch 3 was selected using the full development split; calibration uses its own split. This is our own 2B run, not an official Kev-2B checkpoint.

Security test metric SecJev-2B
Micro accuracy (21,634 questions) 86.48%
Macro-average accuracy (14 tasks) 92.98%
Macro-average balanced accuracy 90.31%

Original Kev clean suites: decision-v7 84.50%; transfer-v4 75.91%.

  • SecJev-2B-v1.1.0.tar.gz: actual trained model adapter/head, inference scripts, model card, selection and evaluation records.
  • SecJev-code-v1.1.0.tar.gz: repository source, including 2B training and evaluation.
  • SHA256SUMS.txt: download checksums.

Inference instructions · Per-task results and all checkpoints · Training recipe

The corpus is unchanged: SecJev-Corpus v1.0.0. The 0.8B release remains available. Existing SecJev and upstream terms continue to apply.

Package checks confirm unchanged adapter bytes, head tensors and temperature, plus CPU/GPU prediction agreement on six development cases across all three question types. This is packaging validation, not a new accuracy benchmark. Known limitations, including weak vehicle-message tasks and a failed handwritten policy example, are documented in the model card.