axolotl example #2784
Merged
axolotl example #2784
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
concretevitamin
approved these changes
Nov 14, 2023
There was a problem hiding this comment.
Wow, this is super awesome @manishiitg! Tested it out and both YAMLs work great. Thanks a bunch for sharing.
Made some suggestions, mostly about passing secrets via env vars.
llm/axolotl/mistral/qlora.yaml
Outdated
| val_set_size: 0.05 | ||
| output_dir: ./qlora-out | ||
|
|
||
| hub_model_id: manishiitg/mhenrichsen-alpaca_2k_test # TODO: Replace with hub model id |
There was a problem hiding this comment.
It seems like without changing these, training will throw
(axolotl, pid=13280) You don't have the rights to create a model under this namespace
(axolotl, pid=13280)
(axolotl, pid=13280) During handling of the above exception, another exception occurred:
(axolotl, pid=13280)
(axolotl, pid=13280) Traceback (most recent call last):
(axolotl, pid=13280) File "/root/miniconda3/envs/py3.10/lib/python3.10/site-packages/huggingface_hub/utils/_errors.py", line 261, in hf_raise_for_status
(axolotl, pid=13280) response.raise_for_status()
(axolotl, pid=13280) File "/root/miniconda3/envs/py3.10/lib/python3.10/site-packages/requests/models.py", line 1021, in raise_for_status
(axolotl, pid=13280) raise HTTPError(http_error_msg, response=self)
(axolotl, pid=13280) requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/api/models/manishiitg/mhenrichsen-alpaca_2k_test
It works when I comment it out (default to HF trainer's default behavior).
How about we comment out this line, and add some quick instruction to add to README for changing this string?
Do we want to comment out hf_use_auth_token line too?
Comment on lines
18
to
19
| hub_model_id: manishiitg/mistral-alpaca_2k_test # TODO: Replace with hub model id | ||
| hf_use_auth_token: false # TODO: push as private or public model |
There was a problem hiding this comment.
See the other comment - should comment out these?
Co-authored-by: Zongheng Yang <zongheng.y@gmail.com>
Co-authored-by: Zongheng Yang <zongheng.y@gmail.com>
Co-authored-by: Zongheng Yang <zongheng.y@gmail.com>
Co-authored-by: Zongheng Yang <zongheng.y@gmail.com>
Co-authored-by: Zongheng Yang <zongheng.y@gmail.com>
|
@concretevitamin incorporated comments |
|
Awesome @manishiitg ! Thanks for contributing this example! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Added example for using axolotl
Tested (run the relevant ones):
bash format.shpytest tests/test_smoke.pypytest tests/test_smoke.py::test_fill_in_the_namebash tests/backward_comaptibility_tests.sh