AI Infra Debug

Strategy

1. Baseline measurements: “Before changing anything, I measured X, Y, Z. The bottleneck appears to be A.”
2. Concrete improvement: For example: reduced latency, improved GPU utilization, removed a memory bottleneck, improved batching, reduced redundant work, or found a config issue.
3. Final writeup: 1–2 page writeup

Report

Summary:

• Investigated [system/component].
• Found bottleneck in [area].
• Implemented/tested [change].
• Result: [metric before] -> [metric after].
• Remaining opportunities: [ranked list].

Method:

• Baseline setup
• Metrics collected
• Tools used
• Assumptions

Findings:

1. ...
2. ...
3. ...

Changes made:

• ...

Risks / tradeoffs:

• ...

Recommended next steps:

1. ...
2. ...
3. ...