Search results

Integrating this into other projects

Status: Open.

#29 In Infini-AI-Lab/UMbreLLa;

· Kenzogithubs opened on Apr 3, 2025

[request] add 4060 ti 16 gb support

Status: Open.

#23 In Infini-AI-Lab/UMbreLLa;

· cerulliber opened on Feb 13, 2025

GLM-4-9B series

Status: Open.

#19 In Infini-AI-Lab/UMbreLLa;

· dreaming-panda opened on Feb 10, 2025

ibm-granite/granite-3.2-8b-instruct-preview

Status: Open.

#18 In Infini-AI-Lab/UMbreLLa;

· dreaming-panda opened on Feb 10, 2025

Mistral Small 24b

Status: Open.

#16 In Infini-AI-Lab/UMbreLLa;

· phly95 opened on Feb 1, 2025

baichuan-inc/Baichuan-M1-14B-Instruct

Status: Open.

#13 In Infini-AI-Lab/UMbreLLa;

· dreaming-panda opened on Jan 24, 2025

KV offloading

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#8 In Infini-AI-Lab/UMbreLLa;

· dreaming-panda opened on Jan 15, 2025

API/Gradio Appending

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#6 In Infini-AI-Lab/UMbreLLa;

· dreaming-panda opened on Jan 14, 2025

Multi GPU Support

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#5 In Infini-AI-Lab/UMbreLLa;

· dreaming-panda opened on Jan 14, 2025

Long context support

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#4 In Infini-AI-Lab/UMbreLLa;

· dreaming-panda opened on Jan 14, 2025

Quantization support

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#3 In Infini-AI-Lab/UMbreLLa;

· dreaming-panda opened on Jan 14, 2025

Model Support

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#2 In Infini-AI-Lab/UMbreLLa;

· dreaming-panda opened on Jan 14, 2025