Refactor interactive #6

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

qihqi merged 1 commit into AI-Hypercomputer:main from FanhaiLu1:interactive

Apr 4, 2024

Collaborator

FanhaiLu1 commented Apr 4, 2024 •

edited

Loading

This PR refactor current run_interactive.py, below are the changes:

Streaming decode text, remove all output text when decode finished
Support multiple prompts
Support end tokens and max_output_length stop instead of run 100 steps
A random slot instead of 0 slot
Enable profiler


          Refactor interactive

4e0b151

qihqi approved these changes

View reviewed changes

qihqi merged commit 21d1290 into AI-Hypercomputer:main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet