Files

.github
3rdparty
benchmarks
cpp
docker
docs
examples
- apps
- arctic
- baichuan
- bert
- bindings/executor
- blip2
- bloom
- chatglm
- cogvlm
- commandr
- cpp/executor
- cpp_library
- dbrx
- deepseek_v1
- dit
- draft_target_model
- eagle
- enc_dec
- exaone
- falcon
- gemma
- gpt
- gptj
- gptneox
- grok
- infinitebench
- internlm
- internlm2
- jais
- llama
- llm-api
- mamba
- medusa
- mixtral
- model_api
- mpt
- multimodal
- nemotron
- nemotron_nas
- openai_triton
- opt
- phi
- quantization
- qwen
- qwenvl
- recurrentgemma
- redrafter
- sample_weight_stripping
- skywork
- smaug
- whisper
- eval_long_context.py
- generate_checkpoint_config.py
- hf_lora_convert.py
- mmlu.py
- run.py
- summarize.py
- utils.py
scripts
tensorrt_llm
tests
windows
.clang-format
.dockerignore
.gitattributes
.gitignore
.gitmodules
.pre-commit-config.yaml
LICENSE
README.md
requirements-dev-windows.txt
requirements-dev.txt
requirements-windows.txt
requirements.txt
setup.cfg
setup.py

examples

Update TensorRT-LLM (NVIDIA#2333 )

Oct 15, 2024

75057cd · Oct 15, 2024

History

This branch is 516 commits behind NVIDIA/TensorRT-LLM:main.

Name	Name	Last commit message	Last commit date
parent directory ..
apps	apps	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
arctic	arctic	Update TensorRT-LLM (NVIDIA#1793 )	Jun 18, 2024
baichuan	baichuan	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
bert	bert	Update TensorRT-LLM (NVIDIA#2008 )	Jul 23, 2024
bindings/executor	bindings/executor	open source 4dbf696ae9b74a26829d120b67ab8443d70c8e58 (NVIDIA#2297 )	Oct 8, 2024
blip2	blip2	Update TensorRT-LLM (NVIDIA#1168 )	Feb 27, 2024
bloom	bloom	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
chatglm	chatglm	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
cogvlm	cogvlm	Update TensorRT-LLM (NVIDIA#2184 )	Sep 3, 2024
commandr	commandr	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
cpp/executor	cpp/executor	Update TensorRT-LLM (NVIDIA#2215 )	Sep 10, 2024
cpp_library	cpp_library	Update TensorRT-LLM (NVIDIA#1274 )	Mar 12, 2024
dbrx	dbrx	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
deepseek_v1	deepseek_v1	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
dit	dit	Update TensorRT-LLM (NVIDIA#2215 )	Sep 10, 2024
draft_target_model	draft_target_model	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
eagle	eagle	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
enc_dec	enc_dec	Update TensorRT-LLM (NVIDIA#2156 )	Aug 27, 2024
exaone	exaone	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
falcon	falcon	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
gemma	gemma	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
gpt	gpt	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
gptj	gptj	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
gptneox	gptneox	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
grok	grok	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
infinitebench	infinitebench	Update TensorRT-LLM (NVIDIA#1725 )	Jun 4, 2024
internlm	internlm	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
internlm2	internlm2	Update TensorRT-LLM (NVIDIA#1725 )	Jun 4, 2024
jais	jais	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
llama	llama	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
llm-api	llm-api	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
mamba	mamba	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
medusa	medusa	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
mixtral	mixtral	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
model_api	model_api	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
mpt	mpt	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
multimodal	multimodal	open source 7f370deb0090d885d7518c2b146399ba3933c004 (NVIDIA#2273 )	Sep 30, 2024
nemotron	nemotron	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
nemotron_nas	nemotron_nas	open source 7f370deb0090d885d7518c2b146399ba3933c004 (NVIDIA#2273 )	Sep 30, 2024
openai_triton	openai_triton	open source 7f370deb0090d885d7518c2b146399ba3933c004 (NVIDIA#2273 )	Sep 30, 2024
opt	opt	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
phi	phi	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
quantization	quantization	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
qwen	qwen	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
qwenvl	qwenvl	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
recurrentgemma	recurrentgemma	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
redrafter	redrafter	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
sample_weight_stripping	sample_weight_stripping	Update TensorRT-LLM (NVIDIA#2008 )	Jul 23, 2024
skywork	skywork	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
smaug	smaug	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
whisper	whisper	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
eval_long_context.py	eval_long_context.py	Update TensorRT-LLM (NVIDIA#2008 )	Jul 23, 2024
generate_checkpoint_config.py	generate_checkpoint_config.py	Update TensorRT-LLM (NVIDIA#1358 )	Mar 26, 2024
hf_lora_convert.py	hf_lora_convert.py	open source 7f370deb0090d885d7518c2b146399ba3933c004 (NVIDIA#2273 )	Sep 30, 2024
mmlu.py	mmlu.py	Update TensorRT-LLM (NVIDIA#2008 )	Jul 23, 2024
run.py	run.py	open source 4dbf696ae9b74a26829d120b67ab8443d70c8e58 (NVIDIA#2297 )	Oct 8, 2024
summarize.py	summarize.py	open source 4dbf696ae9b74a26829d120b67ab8443d70c8e58 (NVIDIA#2297 )	Oct 8, 2024
utils.py	utils.py	open source 4dbf696ae9b74a26829d120b67ab8443d70c8e58 (NVIDIA#2297 )	Oct 8, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Files

examples

examples

Files

examples

Directory actions

More options

Directory actions

More options

Latest commit

History

examples

Folders and files

parent directory