Skip to content

History / Performance Optimization

Revisions

  • Add Inference Software documentation Adds the Inference Software hub page and eight sub-pages following the serving stack from model import through performance analysis: Model Frontend, Graph Compiler, Quantization, Kernel Library, Memory Management, Batching and Scheduling, Runtime, Performance Optimization Same house style as the Physical Design pages: short intro, flow diagram, concept and metric tables over prose, common-problem tables, and best practices. Theory only, with no project-specific content or external reference sections. Updates _Sidebar with the new hierarchy. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

    Richard Huang committed Aug 3, 2026