Skip to content

v2.0.9

Choose a tag to compare

@samestrin samestrin released this 29 Jun 18:01
· 306 commits to main since this release
997a86f
  • New LLM Providers: Added support for AIML API (currently not respecting option values), DeepSeek, Forefront, Ollama, Replicate, and Writer.
  • New LLMInterface Methods: LLMInterface.setApiKey, LLMInterface.sendMesage, and LLMInterface.streamMessage.
  • Streaming: Streaming support available for: AI21 Studio, AIML API, DeepInfra, DeepSeek, Fireworks AI, FriendliAI, Groq, Hugging Face, LLaMa.CPP, Mistral AI, Monster API, NVIDIA,
    Octo AI, Ollama, OpenAI, Perplexity, Together AI, and Writer.
  • New Interface Function: LLMInterfaceStreamMessage
  • Test Coverage: 100% test coverage for all interface classes.
  • Examples: New usage examples.