Skip to content

v0.7.30 - the snake ate the inference server

Choose a tag to compare

@tsingletaryTT tsingletaryTT released this 08 Jul 21:05
5c7b8f3

New visualizer! Watch tt-inference-server models load progressively and then monitor model performance in real time.

You can now run remote sessions in tt-toplike; for instance set up your Quietbox 2 as a tt-toplike server and your Mac as a tt-toplike client, witnessing the results without needing to have a ssh connection.

Performance improvements abound.

What's Changed

  • Enhance inference server monitoring and readiness detection, remote toplike sessions by @tsingletaryTT in #20

Full Changelog: v0.7.0...v0.7.30