Search results

在zhilight0.4.7镜像环境下，使用 4张4090 GPU QwQ_72B_GPTQ prompt为4k 1并发 没有复现TTFT为1000左右的情况

Status: Open.

#59 In zhihu/ZhiLight;

· DreamTeamWangbowen opened on Jun 10, 2025

question about the multi_query_attention_rag_buffer()

Status: Open.

#47 In zhihu/ZhiLight;

· bianshuai001 opened on Mar 26, 2025

多模态模型支持

Status: Open.

#16 In zhihu/ZhiLight;

· yhl41001 opened on Dec 26, 2024

您好！我想问问这个报错是为啥呢？

Status: Open.

#15 In zhihu/ZhiLight;

· Ringssss opened on Dec 17, 2024

Feature 'cvt with .e4m3x2/.e5m2x2' requires .target sm_90 or higher

Status: Open.

#12 In zhihu/ZhiLight;

· divedb opened on Dec 13, 2024