Search results

Support for transformers>=4.50.0?

Status: Open.

#216 In lyogavin/airllm;

· deep1401 opened on Mar 26, 2025

QvQ-72B support?

Status: Open.

#215 In lyogavin/airllm;

· carlos-havier opened on Mar 21, 2025

Hardcoded model shard filenames cause file not found error

Status: Open.

#214 In lyogavin/airllm;

· autonomous1 opened on Mar 9, 2025

Does AirLLM Support Running Quantized Models (e.g., unsloth/Qwen2-72B-bnb-4bit)?

Status: Open.

#213 In lyogavin/airllm;

· NEWbie0709 opened on Feb 24, 2025

Deepseek?

Status: Open.

#211 In lyogavin/airllm;

· Mirko185 opened on Jan 29, 2025

How to use CPU inference?

Status: Open.

#210 In lyogavin/airllm;

· tanbw opened on Jan 25, 2025

should move ‘lm_head’ when splitting Qwen2.5-3B-Instruct

Status: Open.

#209 In lyogavin/airllm;

· DemonDamon opened on Nov 27, 2024

AttributeError: 'list' object has no attribute 'quant_type'

Status: Open.

#208 In lyogavin/airllm;

· fallbernana123456 opened on Nov 22, 2024

low vram usage

Status: Open.

#207 In lyogavin/airllm;

· simonegiuliani opened on Nov 20, 2024

Is AirLLM faster than llama.cpp?

Status: Open.

#206 In lyogavin/airllm;

· Lizonghang opened on Nov 18, 2024

docker based or BareMetal serving

Status: Open.

#205 In lyogavin/airllm;

· dhandhalyabhavik opened on Nov 10, 2024

Quantization Not Working as Expected

Status: Open.

#204 In lyogavin/airllm;

· sdt03 opened on Nov 9, 2024