Skip to content

v1.0.0 - Asynchronous Speculative Layer-Streaming

Choose a tag to compare

View all tags
@Prajwal7-2002 Prajwal7-2002 released this 10 Nov 16:56
· 13 commits to main since this release
v1.0.0
e12ce0d

Official Flagship Release of StreamSpec v1.0.0. Enables 70B and DeepSeek-R1 inference on consumer silicon with zero GPU clusters using speculative chunk verification, DeepSeek MLA memory compression, and mathematical rejection sampling.

Assets 2
Loading