Files

 main

/

examples

/

Copy path

Directory actions

More options

Directory actions

More options

Latest commit

syuoni

test: Accuracy test improvement (Part 3.1): Extend accuracy test suit…

Apr 1, 2025

b2f69db · Apr 1, 2025

History

History

/

examples

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
apps		apps	Update TensorRT-LLM (#2755)	Feb 11, 2025
auto_deploy		auto_deploy	perf: [AutoDeploy] Enable AutoDeploy as a backend in trtllm-bench (#3041	Mar 26, 2025
bert		bert	Update TensorRT-LLM (#2582)	Dec 17, 2024
bindings/executor		bindings/executor	Update TensorRT-LLM (#2582)	Dec 17, 2024
commandr		commandr	Update TensorRT-LLM (#2849)	Mar 4, 2025
cpp/executor		cpp/executor	Update TensorRT-LLM (#2873)	Mar 11, 2025
cpp_library		cpp_library	Update TensorRT-LLM (#1274)	Mar 12, 2024
deepseek_v3		deepseek_v3	doc: use alert formatting (#3153)	Mar 30, 2025
disaggregated		disaggregated	Update TensorRT-LLM (#2936)	Mar 18, 2025
dora		dora	Update TensorRT-LLM (#2755)	Feb 11, 2025
draft_target_model		draft_target_model	Update TensorRT-LLM (#2849)	Mar 4, 2025
eagle		eagle	Update TensorRT-LLM (#2849)	Mar 4, 2025
enc_dec		enc_dec	doc: use alert formatting (#3153)	Mar 30, 2025
exaone		exaone	Add EXAONE-Deep (#3054)	Mar 26, 2025
gemma		gemma	Update (#2978)	Mar 23, 2025
glm-4-9b		glm-4-9b	chore: clean some ci of qa test (#3083)	Mar 31, 2025
gpt		gpt	Support prequantized fp8 ckpt for nemotron-mini-4b-instruct (#3046)	Apr 1, 2025
granite		granite	Update TensorRT-LLM (#2755)	Feb 11, 2025
infinitebench		infinitebench	Update TensorRT-LLM (#1725)	Jun 4, 2024
internlm2		internlm2	Update TensorRT-LLM (#2755)	Feb 11, 2025
language_adapter		language_adapter	Update TensorRT-LLM (#2873)	Mar 11, 2025
llama		llama	fix: fix for cp > kvHeadNum (#3002)	Mar 26, 2025
llm-api		llm-api	add slurm script examples for llm-api (#3135)	Apr 1, 2025
llm-eval/lm-eval-harness		llm-eval/lm-eval-harness	Update (#2978)	Mar 23, 2025
lookahead		lookahead	Update TensorRT-LLM (#2849)	Mar 4, 2025
mamba		mamba	Update TensorRT-LLM (#2849)	Mar 4, 2025
medusa		medusa	Update TensorRT-LLM (#2849)	Mar 4, 2025
mixtral		mixtral	Update TensorRT-LLM (#2849)	Mar 4, 2025
mllama		mllama	Update TensorRT-LLM (#2582)	Dec 17, 2024
models/contrib		models/contrib	chore: clean some ci of qa test (#3083)	Mar 31, 2025
multimodal		multimodal	test: add random image test for llama-3.2-11b-vision (#3055)	Mar 26, 2025
nemotron		nemotron	Update TensorRT-LLM (#2849)	Mar 4, 2025
nemotron_nas		nemotron_nas	Update TensorRT-LLM (#2562)	Dec 11, 2024
openai_triton		openai_triton	Update TensorRT-LLM (#2792)	Feb 18, 2025
phi		phi	Update TensorRT-LLM (#2849)	Mar 4, 2025
prompt_lookup		prompt_lookup	Update TensorRT-LLM (#2873)	Mar 11, 2025
python_plugin		python_plugin	Update TensorRT-LLM (#2755)	Feb 11, 2025
pytorch		pytorch	Add initial EAGLE-3 implementation (#3035)	Mar 29, 2025
quantization		quantization	Update README.md (#2862)	Mar 24, 2025
qwen		qwen	fix: fix for cp > kvHeadNum (#3002)	Mar 26, 2025
qwen2audio		qwen2audio	chore: Handle qwen2audio inputs ids expansion during processing (#3080)	Mar 26, 2025
qwenvl		qwenvl	Update TensorRT-LLM (#2849)	Mar 4, 2025
recurrentgemma		recurrentgemma	Fix .gitmodules (#2852)	Mar 4, 2025
redrafter		redrafter	Update TensorRT-LLM (#2849)	Mar 4, 2025
sample_weight_stripping		sample_weight_stripping	Update (#2978)	Mar 23, 2025
scaffolding		scaffolding	feat: refactor scaffolding worker and support openai api worker (#3166)	Apr 1, 2025
vit		vit	Update (#2978)	Mar 23, 2025
whisper		whisper	Update TensorRT-LLM (#2849)	Mar 4, 2025
constraints.txt		constraints.txt	chore: bump version to 0.19.0.dev2025040100 (#3152)	Mar 31, 2025
eval_long_context.py		eval_long_context.py	test: Accuracy test improvement (Part 2): Incorporate mmlu to accurac…	Mar 24, 2025
generate_checkpoint_config.py		generate_checkpoint_config.py	Update TensorRT-LLM (#2562)	Dec 11, 2024
generate_xgrammar_tokenizer_info.py		generate_xgrammar_tokenizer_info.py	Update TensorRT-LLM (#2783)	Feb 13, 2025
gpqa_llmapi.py		gpqa_llmapi.py	test: Add gpqa tests for DeepSeek models (#3063)	Mar 27, 2025
hf_lora_convert.py		hf_lora_convert.py	Update TensorRT-LLM (#2755)	Feb 11, 2025
mmlu.py		mmlu.py	test: Accuracy test improvement (Part 2): Incorporate mmlu to accurac…	Mar 24, 2025
mmlu_llmapi.py		mmlu_llmapi.py	test: Accuracy test improvement (Part 2): Incorporate mmlu to accurac…	Mar 24, 2025
run.py		run.py	Update TensorRT-LLM (#2849)	Mar 4, 2025
summarize.py		summarize.py	test: Accuracy test improvement (Part 3.1): Extend accuracy test suit…	Apr 1, 2025
utils.py		utils.py	Update TensorRT-LLM (#2849)	Mar 4, 2025
View all files