Bidirectional Streaming

Bidirectional streaming

You may now add bidirectional input streams to your streaming functions. Input streams allow you to stream audio sequences, files, or different PartEnums as you please.

What's Changed

• Chore/add structured responses in streaming provider by @EggerMarc in #41
• feat: add bi-directional streaming support by @EggerMarc in #42

Full Changelog: 0.3.1...0.4.0

More Providers!

Added Huggingface, Ollama, generic helpers, generic Completions and Responses

What's Changed

• chore: add mistralrs provider for local models by @EggerMarc in #38
• chore(core): add parts macro by @EggerMarc in #39
• feat: add responses provider by @EggerMarc in #40

Full Changelog: 0.2.0...0.3.1

Python Tools

Updated tools-rs version, now chat-rs also supports python tool calling!

What's Changed

• Chore/update tools rs by @EggerMarc in #37

Full Changelog: 0.1.2...0.2.0

More Providers!

In this release, we added the following providers:

• Huggingface Router
• Ollama
• Cerebras
• Generic OpenAI Completions

What's Changed

• chore: add testing suite by @EggerMarc in #34
• Feat/image generation by @EggerMarc in #35
• feat(providers/completion): add completions provider for openai compl… by @EggerMarc in #36

Full Changelog: 0.1.1...0.1.2

Websockets

Add Websocket support (finally!), implemented ws both sync and async and provided an example for OpenAI

What's Changed

• Feat/websocket by @EggerMarc in #33

Full Changelog: 0.1...0.1.1

Transports

Abstract transport layer. Build your own transport, share clients, or ditch HTTP. Up to you.

What's Changed

• Feat/transports by @EggerMarc in #32

Full Changelog: 0.0.16...0.1

Human In The Loop

What's Changed

• Feat/hitl by @EggerMarc in #31

Full Changelog: 0.0.12...0.0.16

Gemini Fix

Full Changelog: 0.0.11...0.0.12

Router

Added Claude provider. Added Router provider. Router acts as your model gateway, you may provide it multiple different clients in order of fallback. Errors which cannot be retried will automatically prompt the loop to choose the next in line. You may also implement sorting strategies of the model, and add metadata to said model. In the examples we show how to make an embeddings based router!

What's Changed

• Feat/claude by @EggerMarc in #27
• Feat/router by @EggerMarc in #28
• feat(providers/router): add stream support to router by @EggerMarc in #29
• Feat/router stream by @EggerMarc in #30

Full Changelog: 0.0.9...0.0.11

OpenAI Release

Add OpenAI support over Streaming, Completions, and Embedding endpoints!

What's Changed

• Feature: Add OpenAI by @EggerMarc in #25
• Fix/OpenAI by @EggerMarc in #26

Full Changelog: 0.0.8...0.0.9