You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
Hugging Face is asking for token to access and run Llam2 model
To Reproduce
Steps to reproduce the behavior:
Import Client from llm_vm
Try performing completion request using llam2 as big_model.
Then run the python code . See the attached screen shot.
See error. See the attached screen shot
Expected behavior
Before invoking the model, Hugging Face expects a token having permission to the repo to be passed either via
huggingface-cli loginor by passingtoken=<your_token>`.
Screenshots
Desktop (please complete the following information):
OS: Windows
Browser [e.g. chrome, safari]
Version The latest build. Just cloned from the main repo about 3 hours ago.
Smartphone (please complete the following information):
Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered:
You can manage the HF login using from huggingface_hub import login
import sys
import os
# Import our client
from llm_vm.client import Client
# Import huggingface hub login
from huggingface_hub import login
# Login with HF API token
login(
os.getenv("LLM_VM_HUGGINGFACEHUB_API_TOKEN")
)
# Instantiate the client specifying which LLM you want to use
client = Client(
big_model='llama2'
)
# Put in to your prompt and go!
response = client.complete(
context='',
prompt = 'What is anarchy?'
)
print(
response, file=sys.stderr
) # Anarchy is a political system in which the state is abolished and the people are free...
Describe the bug
Hugging Face is asking for token to access and run Llam2 model
To Reproduce
Steps to reproduce the behavior:
Expected behavior
Before invoking the model, Hugging Face expects a token having permission to the repo to be passed either via
huggingface-cli login
or by passing
token=<your_token>`.Screenshots
![llm_vm llama2 error](https://private-user-images.githubusercontent.com/9824566/293498426-3ecb5f5b-d1b0-4607-8648-09e555903d7d.PNG?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjEzOTg4ODcsIm5iZiI6MTcyMTM5ODU4NywicGF0aCI6Ii85ODI0NTY2LzI5MzQ5ODQyNi0zZWNiNWY1Yi1kMWIwLTQ2MDctODY0OC0wOWU1NTU5MDNkN2QuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDcxOSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA3MTlUMTQxNjI3WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NzI3YjMwMWMyNjg4YjJkYmZmMmFhMGJjODk5ZDAyZDc0YTEzZDAzZWFiNjQzNjMxNzMzZGYwY2JjODk4MWM1MCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.ur2M4V4ogmDHkSMX5CjrwxUdxhXNUoSDWvqbyb2FgNw)
Desktop (please complete the following information):
Smartphone (please complete the following information):
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: