v0.7.30 - the snake ate the inference server
New visualizer! Watch tt-inference-server models load progressively and then monitor model performance in real time.
You can now run remote sessions in tt-toplike; for instance set up your Quietbox 2 as a tt-toplike server and your Mac as a tt-toplike client, witnessing the results without needing to have a ssh connection.
Performance improvements abound.
What's Changed
- Enhance inference server monitoring and readiness detection, remote toplike sessions by @tsingletaryTT in #20
Full Changelog: v0.7.0...v0.7.30