Search results

⚠️ Notice: sunsetting the public demo of LLM Engine ⚠️

Status: Open.

#619 In scaleapi/llm-engine;

· yixu34 opened on Sep 23, 2024

Fine-Tuning LLM using Local GPU and Infra

Status: Open.

#477 In scaleapi/llm-engine;

· Sree-abcprocure opened on Mar 28, 2024

self host on runnpod

Status: Open.

#285 In scaleapi/llm-engine;

· Stealthwriter opened on Sep 21, 2023

Control frequency - completion

Status: Open.

#277 In scaleapi/llm-engine;

· Stealthwriter opened on Sep 14, 2023

max token length for finetune and completion endpoints on Lllama-2?

Status: Open.

#208 In scaleapi/llm-engine;

· urimerhav opened on Aug 12, 2023

[Feature Request] support InternLM

Status: Open.

#206 In scaleapi/llm-engine;

· JimmyMa99 opened on Aug 9, 2023

[Tokenizer] Allow for custom tokens/tokenizer

Status: Open.

#164 In scaleapi/llm-engine;

· sam-scale opened on Jul 24, 2023

[Checkpointing] Allow users to save/use multiple checkpoints

Status: Open.

#162 In scaleapi/llm-engine;

· sam-scale opened on Jul 24, 2023

Create guide for how to deploy an existing Hugging Face model on self-hosted LLM Engine

documentationImprovements or additions to documentationImprovements or additions to documentation

enhancementNew feature or requestNew feature or request

Status: Open.

#141 In scaleapi/llm-engine;

· rkaplan opened on Jul 19, 2023

Discuss: Chat API with a "session" with the client caching messages to make usage more ergonomic

Status: Open.

#139 In scaleapi/llm-engine;

· acmatscale opened on Jul 19, 2023

Comparison benchmarks?

Status: Open.

#138 In scaleapi/llm-engine;

· tripathiarpan20 opened on Jul 19, 2023

Preparing dataset for LLaMa-13b-chat

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#136 In scaleapi/llm-engine;

· FarziBuilder opened on Jul 19, 2023