Files

 master

/

examples

/

Copy path

Directory actions

More options

Directory actions

More options

Latest commit

EricLBuehler

Implement Phi-4 Multimodal! (#1163)

Mar 2, 2025

b31f455 · Mar 2, 2025

History

History

/

examples

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
anymoe		anymoe	Add some Rust examples for AnyMoE (#788)	Sep 22, 2024
anymoe_lora		anymoe_lora	Add some Rust examples for AnyMoE (#788)	Sep 22, 2024
async		async	Support send + sync in loader (#991)	Dec 13, 2024
batching		batching	Improved Rust-side API (#785)	Sep 22, 2024
custom_logits_processor		custom_logits_processor	Improved Rust-side API (#785)	Sep 22, 2024
deepseekr1		deepseekr1	Implement the DeepSeekV3 model (support full DeepSeek R1) (#1077)	Jan 22, 2025
deepseekv2		deepseekv2	Implement DeepSeekV2 (#1010)	Jan 5, 2025
flux		flux	Our first Diffusion model: FLUX (#758)	Sep 24, 2024
gemma2		gemma2	Improved Rust-side API (#785)	Sep 22, 2024
gguf		gguf	Add some Rust examples for AnyMoE (#788)	Sep 22, 2024
gguf_locally		gguf_locally	Fix example gguf_locally (#966)	Dec 3, 2024
grammar		grammar	Improved Rust-side API (#785)	Sep 22, 2024
idefics2		idefics2	Implement the Idefics 3 models (Idefics 3, SmolVLM-Instruct) (#939)	Nov 27, 2024
idefics3		idefics3	Implement the Idefics 3 models (Idefics 3, SmolVLM-Instruct) (#939)	Nov 27, 2024
imatrix		imatrix	Implement Imatrix for ISQ (#949)	Nov 30, 2024
isq		isq	Improved Rust-side API (#785)	Sep 22, 2024
json_schema		json_schema	use llguidance library for constraints (including json schemas) (#899)	Dec 2, 2024
llama_vision		llama_vision	Implement the Idefics 3 models (Idefics 3, SmolVLM-Instruct) (#939)	Nov 27, 2024
llama_vision_multiturn		llama_vision_multiturn	Add the Qwen2-VL model (#894)	Nov 9, 2024
llava		llava	Implement the Idefics 3 models (Idefics 3, SmolVLM-Instruct) (#939)	Nov 27, 2024
llava_next		llava_next	Implement the Idefics 3 models (Idefics 3, SmolVLM-Instruct) (#939)	Nov 27, 2024
llguidance		llguidance	use llguidance library for constraints (including json schemas) (#899)	Dec 2, 2024
lora		lora	Improved Rust-side API (#785)	Sep 22, 2024
lora_activation		lora_activation	Improved Rust-side API (#785)	Sep 22, 2024
lower_level		lower_level	PagedAttention prompt chunking support (#1105)	Jan 27, 2025
minicpmo_2_6		minicpmo_2_6	Implement MiniCpm-O 2.6 (#1074)	Jan 22, 2025
mixture_of_quant_experts		mixture_of_quant_experts	Improved Rust-side API (#785)	Sep 22, 2024
paged_attn		paged_attn	Improved Rust-side API (#785)	Sep 22, 2024
perplexity		perplexity	PagedAttention prompt chunking support (#1105)	Jan 27, 2025
phi3_5_moe		phi3_5_moe	Improved Rust-side API (#785)	Sep 22, 2024
phi3v		phi3v	Implement the Idefics 3 models (Idefics 3, SmolVLM-Instruct) (#939)	Nov 27, 2024
phi4mm		phi4mm	Implement Phi-4 Multimodal! (#1163)	Mar 2, 2025
qwen2vl		qwen2vl	Add the Qwen2-VL model (#894)	Nov 9, 2024
simple		simple	Improved Rust-side API (#785)	Sep 22, 2024
simple_stream		simple_stream	Allow chat streaming to use tools (#1088)	Feb 4, 2025
smolvlm		smolvlm	Add example for smolvlm	Nov 27, 2024
speculative		speculative	Revamp speculative decoding! (#1027)	Feb 15, 2025
text_auto_device_map		text_auto_device_map	Examples for automatic device mapping (#1065)	Jan 16, 2025
tools		tools	Handle assistant messages with 'tool_calls' (#824)	Nov 11, 2024
tools_llama_8b		tools_llama_8b	Improved Rust-side API (#785)	Sep 22, 2024
topology		topology	Improved Rust-side API (#785)	Sep 22, 2024
vision_auto_device_map		vision_auto_device_map	Examples for automatic device mapping (#1065)	Jan 16, 2025
xlora		xlora	Improved Rust-side API (#785)	Sep 22, 2024
View all files