Skip to content

Choose a tag to compare

@foldl foldl released this 18 Oct 05:04
· 7 commits to master since this release

New Models

  • Intern-Decision
  • Spark-2.5
  • TeleOCR
  • MiniCPM5-2B
  • Instella-MoE

Highlight

  • Improved prefilling performance for qwen3.5 arch 🚀🚀🚀.
  • Decision API (text only. stay tuned for multi-media support):
    • models: Intern-Decision, H2O-Lightning.
    • actually, any model can be used to serve decision API.

Lowlight

  • RPC is not working.