New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make DS inference config readable from a json file #2532

Closed

awan-10 opened this issue Nov 22, 2022 · 0 comments

Assignees

Labels

enhancement inference

Contributor

awan-10 commented Nov 22, 2022 •

edited

Loading

@mrwyattii -- Please take a look at this issue for context: https://github.com/huggingface/transformers-bloom-inference/pull/37/files

@stas00 wants us to make the new DS inference config accept dict_or_path just like zero does?

The text was updated successfully, but these errors were encountered:

awan-10 added enhancement inference labels

awan-10 assigned mrwyattii

awan-10 mentioned this issue

Add configs to run int4 inference huggingface/transformers-bloom-inference#37

Open

mrwyattii mentioned this issue

Make DS-Inference config readable from JSON #2537

Merged

mrwyattii closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment