Repository navigation
TUFF 9.4.2
TUFF 9.4.2 gets the inference engines ready before you load a model.
- Engines download in the background when TUFF opens. When an update ships new engines, the first load of each model family used to wait for its engine to download under "Preparing inference engine". TUFF now fetches the engines your installed models need as soon as it opens, so that wait is gone by the time you press Load. A load started while a download is still running just waits for that same download. Engines you already have are only checked.
I also went through the rest of the loading path looking for anything slower than 8.x and didn't find anything else. Setting up the engine's GPU code takes about 0.05 s, and checking a model's weights takes the same time it did before 9.0 (about 2.6 s for Ornith 1.5 9B on a 16 GB M2 Air).