Skip to content

simurg v1.0.0

Choose a tag to compare

@doofzoff doofzoff released this 24 Aug 18:36
· 26 commits to main since this release

first public release, now on PyPI.

SIMURG catches LLM decoding corruption while the answer is still being generated: repetition loops, cross lingual drift, regurgitation, structural garbage, template leakage. It holds the opening of every stream, releases it only when verified clean, re checks at every checkpoint, and aborts within a few hundred characters of the moment the model goes bad.

what is in v1.0.0

  • zero leak protocol: hold, release, re check, abort, with conformal calibrated thresholds and onset localization
  • five detector ensemble plus a 15 weight online learning tier that keeps learning in production
  • GuardedLLM: wraps any OpenAI compatible endpoint (vLLM, Ollama, llama.cpp, TGI) with an abort, retry, fallback model ladder
  • fit_custom_detector: teach it your model's specific failure patterns from a few dozen examples, with an honesty gate
  • live guard dashboard: real time score and 15 feature charts, session recording, replay at 128x
  • live training dashboard with per epoch weight evolution
  • reproducible CorruptBench benchmark: stream TPR 0.975 on the held out split, 0 false alarms on 121 real production texts

install

pip install simurg

3 lines to your first guarded stream

from simurg import GuardedLLM

llm = GuardedLLM("http://localhost:8000/v1", model="my-model", retries=1)
result = llm.chat([{"role": "user", "content": "hello"}])
print(result.ok, result.verdict)

links

the research paper

the full 13 page technical report is in the repo: https://github.com/doofzoff/SIMURG/blob/main/paper/simurg_paper.pdf?raw=true