The Fable Computer, Part III: A Ternary AI Accelerator for PrismML’s Ternary-Bonsai-2-27B

[ryoji-info]

I would like to introduce a new paper, The Fable Computer, Part III, available at https://github.com/ryoji-info/FableComputer/blob/main/papers/Fable-Computer-Part-III.pdf. Part III aims to embed an AI model running on the Fable Computer. This time, we selected PrismML's Ternary-Bonsai-2-27B-mlx-2bit (https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-mlx-2bit). The Fable Computer will compute its ternary transformer weights, while other parts rely on CMOS. So, ideally, the Fable Computer, Part III, will be integrated into an SoC. Hopefully, discussion will be held broadly on these topics as well.