We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent c5a22bf commit a810f31Copy full SHA for a810f31
ADVANCED_USAGE.md
@@ -57,6 +57,7 @@ Below are all the arguments for `bigcodebench.evaluate` for the remote evaluatio
57
- `--id_range`: The range of the tasks to evaluate, default to `None`, e.g. `--id_range 10,20` will evaluate the tasks from 10 to 20
58
- `--backend`: The backend to use, default to `vllm`
59
- `--base_url`: The base URL of the backend for OpenAI-compatible APIs, default to `None`
60
+- `--revision`: The revision of the model with the vLLM or HF backend, default to `main`
61
- `--tp`: The tensor parallel size for the vLLM backend, default to `1`
62
- `--trust_remote_code`: Whether to trust the remote code, default to `False`
63
- `--tokenizer_name`: The name of the customized tokenizer, default to `None`
0 commit comments