Skip to content

Service claw llamacpp service

github-actions[bot] edited this page Oct 13, 2026 · 2 revisions

claw-llamacpp-service

Rendered from .ai/manifests/ on every publish. Rules for this service: CLAUDE.md · guide: service guide.

Property Value
Directory apps/claw-llamacpp-service
Port 4017
Database postgresql
Test files 22 (vitest)
Internal packages @claw/shared-auth, @claw/shared-constants, @claw/shared-entitlements, @claw/shared-rabbitmq, @claw/shared-types, @claw/shared-utilities

Persistence models

  • BinaryRelease
  • FrontierCatalogEntry
  • HardwareSnapshot
  • ModelLoadEvent
  • PreflightOverrideAudit
  • PullJob
  • RuntimeConfig

HTTP API (26)

Method Route Source
GET /catalog catalog.controller.ts
GET /catalog/:id catalog.controller.ts
POST /catalog/:id/pull pull-jobs.controller.ts
POST /catalog/hf-auto-sync catalog.controller.ts
POST /catalog/hf-import catalog.controller.ts
GET /catalog/hf-models/:author/:name catalog.controller.ts
GET /catalog/hf-search catalog.controller.ts
POST /catalog/refresh catalog.controller.ts
GET /hardware hardware.controller.ts
POST /hardware/refresh hardware.controller.ts
GET /health health.controller.ts
GET /internal/llamacpp/loaded-snapshot catalog-internal.controller.ts
PUT /models/:id/config models-lifecycle.controller.ts
POST /models/:id/load models-lifecycle.controller.ts
POST /models/:id/unload models-lifecycle.controller.ts
DELETE /models/:id/weights models-lifecycle.controller.ts
GET /models/loaded models-lifecycle.controller.ts
GET /pull-jobs pull-jobs.controller.ts
DELETE /pull-jobs/:id pull-jobs.controller.ts
GET /pull-jobs/:id pull-jobs.controller.ts
POST /pull-jobs/:id/retry pull-jobs.controller.ts
GET /runtime-progress/probe runtime-progress.controller.ts
GET /runtime/info binary.controller.ts
POST /runtime/update binary.controller.ts
POST /v1/chat/completions inference.controller.ts
POST /v1/completions inference.controller.ts

Events (inferred from source; verify before a critical change)

  • Publishes: llamacpp.binary.installed, llamacpp.binary.updated, llamacpp.model.crashed, llamacpp.model.loaded, llamacpp.model.unloaded, llamacpp.preflight.overridden, llamacpp.pull.completed, llamacpp.pull.failed, llamacpp.pull.progress, llamacpp.pull.started, llamacpp.weights.deleted, log.server
  • Consumes: none found

Clone this wiki locally