You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Oct 9, 2024. It is now read-only.
In TemporaryCheckpointsJSON(https://github.com/huggingface/transformers-bloom-inference/blob/main/inference_server/models/ds_inference.py#L80) ,

When use
glob.glob(f"{self.model_path}/*.bin")
, files path in the list will all containmodel_path
prefix (eg: modelname isbigscience/bloom
).While set it as
root_dir
(glob.glob("*.bin", root_dir=self.model_path)
) will not:And it will align to DeepSpeed's loading way (replace_module.py). Because when loading, it will add
root_dir
again:So, current dump way will duplicate
model_path
.And I raised a PR: #71 .
The text was updated successfully, but these errors were encountered: