Search results

thread '&lt;unnamed&gt;' panicked at 'called <code>Option::unwrap()</code> on a <code>None</code> value'

Status: Open.

#31 In FasterDecoding/REST;

· homehappily opened on Apr 28, 2025

question about token generation

Status: Open.

#30 In FasterDecoding/REST;

· YouthLiuYS opened on Apr 27, 2025

Problem with draftretriever.search function behavior

Status: Open.

#29 In FasterDecoding/REST;

· qingyiaaaaa opened on Feb 20, 2025

Lama2 70B-chat is not supported?

Status: Open.

#22 In FasterDecoding/REST;

· Chlience opened on Oct 17, 2024

Tensor parallelism

Status: Open.

#21 In FasterDecoding/REST;

· lethean1 opened on Oct 11, 2024

about retrieve sequence length

Status: Open.

#20 In FasterDecoding/REST;

· Siegfried-qgf opened on Sep 27, 2024

OSError: failed to fill whole buffer

Status: Open.

#19 In FasterDecoding/REST;

· Siegfried-qgf opened on Sep 25, 2024

How to adjust the maximum token lengths when drafting?

Status: Open.

#18 In FasterDecoding/REST;

· zomss opened on Sep 7, 2024

If I want to change REST code to support multi-batch inference, what needs to be changed?

Status: Open.

#16 In FasterDecoding/REST;

· yangbohust opened on May 20, 2024

How to support the <code>repetition_penalty</code> parameter?

Status: Open.

#15 In FasterDecoding/REST;

· yangbohust opened on May 20, 2024

Segmentation Fault when calling libsais_int

Status: Open.

#14 In FasterDecoding/REST;

· julianmukaj opened on May 16, 2024

ValueError: draft_choices was not cut enough / draft_len should not exceed 65

Status: Open.

#13 In FasterDecoding/REST;

· yangbohust opened on May 8, 2024