Skip to content

Commit e646fe5

Browse files
committed
Add docs
1 parent afa881c commit e646fe5

File tree

1 file changed

+8
-1
lines changed

1 file changed

+8
-1
lines changed

README.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -127,7 +127,7 @@ bigcodebench.evaluate \
127127
--execution [e2b|gradio|local] \
128128
--split [complete|instruct] \
129129
--subset [full|hard] \
130-
--backend [vllm|openai|anthropic|google|mistral|hf]
130+
--backend [vllm|openai|anthropic|google|mistral|hf|hf-inference]
131131
```
132132

133133
- All the resulted files will be stored in a folder named `bcb_results`.
@@ -177,6 +177,13 @@ Access Gemini APIs from [Google AI Studio](https://aistudio.google.com/)
177177
export GOOGLE_API_KEY=<your_google_api_key>
178178
```
179179

180+
Access the [Hugging Face Serverless Inference API](https://huggingface.co/docs/api-inference/en/index)
181+
```bash
182+
export HF_INFERENCE_API_KEY=<your_hf_api_key>
183+
```
184+
185+
Please make sure your HF access token has the `Make calls to inference providers` permission.
186+
180187
## 💻 LLM-generated Code
181188

182189
We share pre-generated code samples from LLMs we have [evaluated](https://huggingface.co/spaces/bigcode/bigcodebench-leaderboard) on the full set:

0 commit comments

Comments
 (0)