Skip to content

v0.1.3

Choose a tag to compare

@ivanium ivanium released this 10 Jan 23:39
· 101 commits to main since this release
8c5121e

v0.1.3 Release

Bug Fixes

  • Fix unique IPC socket when TP is enabled (#219)
  • Support flashinfer kvcache shape for vLLM (#216)
  • Fix exceptions in vLLM prefix-cache-related APIs (#212)
  • Export missing autopatch env (#196)
  • More precise vLLM version detection (#194)
  • Fix memory tracker IPC name collision (#192)
  • Fix type casting in get_avail_physical_pages (#190)
  • Fix vLLM version range (#182)
  • Fix SGLang clear() function support (#150)
  • Fix langchain AgentExecutor import (#209)
  • Fix type casting issue (#204)

Features

  • Add example for hybrid attention models (#218)

Documentation

  • Add deepwiki to README (#220)
  • Update README with kvcached caching note (#188)
  • Add action video and blog link (#178)

Maintenance

  • kvcached description update (#180)
  • Example READMEs venv path fix (#179)