Repository navigation
Getting Started Running your first visualization
With both servers running, it's time to actually visualize a Transformer Layer. This guide will walk you through interacting with the Architecture Explorer and running a Live Inference trace.
Understanding how to trigger visualizations and read the resulting 3D geometry is the core skill required to use TokenPrint effectively. The interface is highly interactive and relies on your input to fetch data.
TokenPrint utilizes different visualization "Modes" available in the Top Bar. Switching modes unmounts the current 3D scene and mounts a new one, fetching entirely new datasets from the backend.
By default, TokenPrint opens in Architecture mode.
- On the left Sidebar, you will see a Model Loader. Click "Use live Qwen model".
- The UI will send a
GET /architecturerequest to the backend. - The 3D Canvas will populate with a massive point cloud. Each point represents a real tensor in the loaded model.
- Hover over any point with your mouse to see its name, shape, and parameter count in a tooltip.
- Notice the layers are colored by depth, creating a visual map of the model's structure.
TokenPrint can also inspect models without the backend via client-side parsing.
- Download any small
.gguffile (e.g., a quantized Llama 3 model from HuggingFace). - Drag and drop the
.gguffile directly onto the TokenPrint browser window. - The client-side parser will instantly read the header, skipping the heavy weights, and render a new Architecture point cloud.
Note The
.gguffile never leaves your browser. Parsing happens locally and instantly.
Let's watch the model think in real-time.
- Click the Generation tab in the Top Bar.
- In the bottom HUD, locate the prompt input box.
- Type a simple prompt, such as:
Name one primary color. - Press Enter or click Generate.
- TokenPrint will open a WebSocket stream (
WS /ws/generate) withtrace: true. - Watch as the 3D scene constructs a Transformer Stack.
- The camera will follow the execution layer-by-layer. You will see Attention blades, the SwiGLU funnel, and LayerNorm waists light up as data passes through them.
- At the top of the stack, watch the Top-k Skyline render the actual probability distributions for the next token.
flowchart LR
Input[Enter Prompt] --> WS[WebSocket Connection]
WS --> Stream[Token Stream]
subgraph Execution
Stream --> L1[Layer 1 Geometry]
L1 --> L2[Layer 2 Geometry]
L2 --> L3[...]
end
Execution --> Output[Top-k Probabilities]
Output --> Input
| Previous | Home | Next |
|---|---|---|
| Quick Start | Home | User Guide |
TokenPrint Wiki | Home | Getting Started | User Guide | Concepts | Architecture | API | GitHub
TokenPrint is an interactive 3D visualization platform for exploring transformer architectures, tensors, and real-time LLM inference.
- User Guide
- Architecture Explorer
- Live Inference
- Tensor Inspector
- Camera Controls
- HUD
- Timeline
- Scene Navigation
- Transformer Concepts
- Tokenization
- Embeddings
- Positional Encoding
- RoPE
- Multi-Head Attention
- KV Cache
- LayerNorm
- Feed Forward Network
- Residual Connections
- Logits
- Softmax
- Sampling
- Autoregressive Generation
- Visualization System
- Scene Graph
- Geometry
- Materials
- Animation System
- Color Mapping
- Camera System
- Interaction Model
- Architecture
- Overall Architecture
- Frontend
- Backend
- WebSocket Protocol
- Data Pipeline
- Renderer
- Event System