Skip to content

Releases: FasterDecoding/Medusa

Medusa-v0.1

11 Sep 20:35
Compare
Choose a tag to compare

Medusa is a easy-to-use framework that democratizes the acceleration techniques for LLM generation. Medusa-v0.1 uses several extra light-weighted decoding head, and exclude the need for draft model.