Skip to content

[Feature Request]: Print to IOStream for Groq and Mistral Client #3065

Closed
@PanQiWei

Description

@PanQiWei

Is your feature request related to a problem? Please describe.

I saw the current implementation of Groq and Mistral Client doesn't print chunk to IOStream when in stream mode. And I observed that in Gemini and Together Client there are comments to describe why they can't be stream or will do in the future. I wonder is there something blocking print chunk to IOStream in Groq or Mistral Client, or just missing the implementation?

For myself, I manually add logic to print chunk to IOStream for GroqClient and it seems works well, with groq == 0.9.0, maybe we can also add the logic to MistralClient ?

Describe the solution you'd like

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    0.2Issues which are related to the pre 0.4 codebaseneeds-triage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions