Skip to content

v13

Choose a tag to compare

@markusbug markusbug released this 22 Feb 21:31
· 338 commits to main since this release

What's New in v13

End-to-End Encrypted Proxy for ethOS Inference

  • EHBP (Encrypted HTTP Body Protocol) — ethOS devices now route LLM requests through a billing proxy using HPKE encryption. Prompts and completions are end-to-end encrypted between the device and the Tinfoil TEE enclave; the proxy server never sees plaintext.
  • Server-side billing — the Tinfoil API key stays on the server. The proxy reads token usage from enclave response headers for metering, without breaking encryption.
  • New TinfoilProxyClient — dedicated LlmClient implementation for privileged (ethOS) devices that wraps the Go bridge's EHBP functions.
  • Go bridge expanded — added ProxiedChatCompletion and ProxiedChatCompletionStream with automatic EHBP transport caching, attestation verification, and key rotation retry logic.

Model Update

  • Default model changed to kimi-k2-5 (previously minimax/minimax-m2.5).