Skip to content

langport 0.3.3

Choose a tag to compare

@jstzwj jstzwj released this 06 Aug 16:11
· 66 commits to main since this release
63a2a34

What's Changed

  • Support model Qwen
  • Inference speedup
  • Dynamic Batch Inference
  • Gateway logging