Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

interactive_cli requires making changes to services/constants.py #77

Open
stephenroller opened this issue May 10, 2022 · 1 comment
Open
Labels
better-eng Things that can help make things sane bug Something isn't working

Comments

@stephenroller
Copy link
Contributor

馃悰 Bug

Done as a temporary hack to reduce command line parameters, but it's pretty annoying. We need to add some CLI args to the script to allow the user to specify which model they want.

To Reproduce

Try to load up interactive with any other model. You can't :P

@Mrs-Hudson
Copy link

Thanks @stephenroller ! This would be a great add on because despite the huggingface release a lot of us do not have access to GPUs that can hold a 55GB model (Huggingface does not support parallelism yet for OPT models (Feature request: https://github.com/huggingface%20transformers/issues/17240)

Being able to run the 30B CLI without gibberish output and such bugs would be a great improvement!

@suchenzang suchenzang added the better-eng Things that can help make things sane label Oct 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
better-eng Things that can help make things sane bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants