docs(unsloth): grounded control-surface API map (probed live) - #1710
Merged
Conversation
§3.5 — probed the running unsloth Studio (:8888). Two HTTP surfaces: /v1
(OpenAI-compatible serving) + /api/* (Training & Model Management backend,
openapi at /openapi.json). The complete delegation surface, every capability
endpoint-backed:
- model lifecycle: POST /api/inference/load (+ /load-progress), /unload,
GET /api/inference/status|models, /v1/models
- capability checks: /api/models/check-embedding/{name}, /check-vision/{name}
- hub: POST /api/hub/download (HF pull), GET /api/hub/cached-models|cached-gguf
- serving: POST /v1/chat/completions, POST /v1/embeddings
- foundry handoff: POST /api/export/load-checkpoint, /api/export/export/gguf
- training data: /api/datasets/*, /api/data-recipe/*; health: GET /api/health
Implications: auto-load (#24) is clean HTTP (status→load→poll→health-probe),
not a CLI subprocess; embeddings (#40) verify via check-embedding then
/v1/embeddings; the foundry handoff is endpoint-backed.
CRITICAL live state: unsloth is running but EMPTY (/v1/models -> [],
/v1/embeddings -> "No GGUF model loaded"). Nothing serves until auto-load
runs — the prerequisite for peers-online and for testing #40. Local GGUFs
exist to load against.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Probed the running unsloth Studio and mapped the complete delegation surface (
/v1serving +/api/*management) into UNSLOTH-INTEGRATION.md §3.5. Every capability we delegate is endpoint-backed: model load/unload/status, check-embedding/check-vision, hub download, /v1 chat+embeddings, foundry load-checkpoint+export-gguf, datasets, health.Key outcomes: auto-load (#24) is clean HTTP not a CLI subprocess; embeddings (#40) verify via check-embedding then /v1/embeddings; foundry handoff is endpoint-backed.
Critical live finding: unsloth is running but EMPTY (no model loaded) — nothing serves until auto-load runs. That's the prerequisite for peers-online and for testing #40. Docs-only.
🤖 Generated with Claude Code