0.10.0
What's Changed
- Update model repository by @samuelrince in #213
- Estimate generation latency from tps and ttft data by @samuelrince in #211
- Fix IndexError in *_chat_wrapper_stream methods with openai provider by @dtamien in #212
- Add tests for OpenAI streaming with options by @samuelrince in #214
- Add support for Responses API and SDK v2 for OpenAI by @samuelrince in #216
- Update GPU embodied impacts by @samuelrince in #217
- Relax Anthropic and Hugging Face SDK constraints by @samuelrince in #218
- Add post for latency update by @samuelrince in #219
- Update models by @samuelrince in #220
- Add "made by" mention into the docs by @samuelrince in #221
New Contributors
Full Changelog: 0.9.3...0.10.0