Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

training issues for the model weights #12

Closed
runzeer opened this issue Nov 30, 2023 · 3 comments
Closed

training issues for the model weights #12

runzeer opened this issue Nov 30, 2023 · 3 comments

Comments

@runzeer
Copy link

runzeer commented Nov 30, 2023

Thanks for your excellent work? I noticed that your train scripts employed the "CodeLlama-${MODEL_SIZE}-Python-hf" weights. I also constructed a small dataset for training but I used your "llm-agents/tora-code-7b-v1.0" model weights to continue finetune on my data. But when I inference with the finetuned weights. There seems to be wrong and the generated output is "". So I wonder if the training script should be modified if I wanted to use the tora-code-7b-v1.0 weights. Could you help me? Thanks a lot!

@ZubinGou
Copy link
Contributor

ZubinGou commented Dec 1, 2023

Consider checking that the environment is consistent with the requirements.txt?

@runzeer
Copy link
Author

runzeer commented Dec 4, 2023

Thanks for your kindly help. It is because the vllm library cannot support the safetensors file saved by accelerator library. And when will the training data can be released? Thanks a lot!

@ZubinGou
Copy link
Contributor

ZubinGou commented Dec 4, 2023

Great to hear you were able to solve the issue! As for the full training data, we're pushing to expedite the release, but I don't have a specific timeline due to the internal review process. Please stay tuned for updates!

@ZubinGou ZubinGou closed this as completed Dec 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants