Skip to content

Conversation

@pavelgj
Copy link
Collaborator

@pavelgj pavelgj commented Sep 5, 2024

The idea is to be able to do things like

await generate({
  prompt: prompt,
  model: model,
  use: [
    retry({ maxRetries: 2 }),
    smoothStreaming({ cadence: 25, randomize: true })
  ],
})

@pavelgj pavelgj requested review from apascal07 and mbleigh September 5, 2024 12:03
@pavelgj pavelgj requested a review from apascal07 September 9, 2024 21:36
@pavelgj pavelgj merged commit 280c60d into next Sep 10, 2024
@pavelgj pavelgj deleted the pj/generateMiddleware branch September 10, 2024 13:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

2 participants