Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Errors running inference examples #7

Closed
tmm1 opened this issue Jun 2, 2023 · 5 comments
Closed

Errors running inference examples #7

tmm1 opened this issue Jun 2, 2023 · 5 comments

Comments

@tmm1
Copy link

tmm1 commented Jun 2, 2023

$ python test_inference/test_starcoder_nl2code.py
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/bigcode/starcoder/resolve/main/config.json

huggingface_hub.utils._errors.RepositoryNotFoundError: 401 Client Error. (Request ID: Root=1-647a1d8b-7884a0702c5cae05744608f7)

Repository Not Found for url: https://huggingface.co/bigcode/starcoder/resolve/main/config.json.
Please make sure you specified the correct `repo_id` and `repo_type`.

OSError: bigcode/starcoder is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models'
$ python test_inference/test_codet5_multitask.py
omegaconf.errors.ConfigKeyError: Missing key codet5-base-translate-cs-java
    full_key: codet5-base-translate-cs-java
    object_type=dict
@tmm1
Copy link
Author

tmm1 commented Jun 2, 2023

$ python test_codegen_nl2code.py
Traceback (most recent call last):
  File "CodeTF/codetf/models/causal_lm_models/__init__.py", line 76, in forward
    num_beams=self.beam_size)
AttributeError: 'CausalLMModel' object has no attribute 'beam_size'

@tmm1
Copy link
Author

tmm1 commented Jun 2, 2023

401 Client Error: Unauthorized for url: https://huggingface.co/bigcode/starcoder

this one requires huggingface-cli login and accepting the terms of the model on the huggingface

@bdqnghi
Copy link
Contributor

bdqnghi commented Jun 2, 2023

thanks, I have updated the requirement for huggingface-cli login in the README, also the issue of beamsize has been resolved, can you check again?

@tmm1
Copy link
Author

tmm1 commented Jun 3, 2023

codet5 still has issues

TypeError: T5ForConditionalGeneration.init() got an unexpected keyword argument 'load_in_4bit'

@bdqnghi
Copy link
Contributor

bdqnghi commented Jun 3, 2023

Please install these 3 dependencies, install directly from Github repo:

pip install -q -U git+https://github.com/huggingface/transformers.git
pip install -q -U git+https://github.com/huggingface/peft.git
pip install -q -U git+https://github.com/huggingface/accelerate.git

@bdqnghi bdqnghi closed this as completed Jun 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants