feat(inference+mobile): sovereign inference on our mesh + installable mobile PWA (twin or box) - #31
Merged
Merged
Conversation
… mobile PWA (twin or box)
Two asks, one capstone: run LLMs on OUR infrastructure (not a cloud provider), and see/reach it
from a phone.
Sovereign inference (tools/inference.py):
- a model is an immutable DATA SPHERE (provenance, pinned integrity, residency-fenced); loading
weights needs a read Grant; a mutated model is un-citable.
- inference_service_workload: serving a model is a GPU workload the compute plane places on a
TRUSTED backend (Needs firewall keeps a sensitive model off untrusted/volunteer/vendor).
- route_inference: FAIL-CLOSED sovereign-first. A sensitive prompt (or a residency-fenced model)
goes to a sovereign endpoint or BLOCKS — it never leaves for a cloud LLM. Non-sensitive may fall
back to a vendor connector only when policy allows.
This is the difference between "our infrastructure" and "a cloud provider like Claude."
Mobile PWA (portal_server.py):
- installable (manifest.webmanifest + service worker, offline-ish shell), mobile-responsive, apple
web-app tags; a twin/box endpoint badge (SOURCEOS_ENDPOINT).
- /api/inference surfaces the sovereign posture + per-model routing; a "Sovereign inference" console
section shows sensitive prompts routing sovereign or blocked.
Access model: default to the TWIN (always-on rendezvous — the box sleeps, the twin doesn't; grants
+ coordinator live there), opt-in DIRECT to the box for LAN/offline. Same reference-vs-direct
lattice from the mount analysis, applied to control access.
capd/sovereign-inference.mesh.capd.json. Tests: +7 inference +4 portal = 156 tools tests green.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Two asks, one capstone: run LLMs on our infrastructure (not a cloud provider), and see/reach it from a phone.
Sovereign inference (
tools/inference.py)route_inferenceis fail-closed sovereign-first: a sensitive prompt (or residency-fenced model) routes to a sovereign endpoint or BLOCKS — it never leaves for a cloud LLM. That's the difference between "our infrastructure" and "a cloud provider like Claude."Mobile PWA (
portal_server.py)/api/inferenceshows the sovereign posture + per-model routing.156 tools tests green (+11).
capd/sovereign-inference.mesh.capd.json.