Skip to content

Experiment Protocol

Jump to bottom
Anubha Parashar edited this page Aug 11, 2026 · 1 revision

Experiment Protocol

Models

  • qwen3:4b
  • gemma3:4b
  • llama3.2:3b
  • phi4-mini

Repetitions

The final paper run used five repetitions with adaptive evaluation.

Outcomes

  • regression-detection recall
  • equal-budget random recall
  • test reduction
  • task success
  • malicious proposal behavior
  • runtime containment
  • attack success
  • latency
  • recorded cost

Statistics

The completed report includes bootstrap confidence intervals, McNemar's exact test, paired permutation testing, Benjamini-Hochberg correction, and paired effect-size reporting.

Resume rule

Preserve the evidence JSONL cache and use resume mode after local server or machine interruptions.

DeltaCert-Agent — research prototype for change-impact-aware recertification of tool-using LLM agents.

DeltaCert-Agent

Main repository

Clone this wiki locally