Skip to content

Add streaming tokens#75

Merged
csris merged 3 commits intomainfrom
add-streaming-tokens
Mar 30, 2023
Merged

Add streaming tokens#75
csris merged 3 commits intomainfrom
add-streaming-tokens

Conversation

@justin-together
Copy link
Copy Markdown

@justin-together justin-together commented Mar 30, 2023 •
edited
Loading

  • Add streaming tokens and enable streaming by default.
  • Add early stopping on stop words.
  • Add --no-stream option to maintain the current output logic.

@justin-together justin-together requested a review from csris March 30, 2023 05:05
csris
csris approved these changes Mar 30, 2023
View reviewed changes
Copy link
Copy Markdown
Contributor

@csris csris left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@csris csris merged commit a71963d into main Mar 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@csris csris csris approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@justin-together @csris