Repository navigation
R34
Pre-releaseFixed the model selection loading the incorrect model since column sorting was added.
Fixed cancelling Hugging Face download would throw an error and not delete the incomplete file.
Fixed the "Hugging Face" tab name.
Fixes and enhancements to the Curl code, network proxy etc. and additional translations by @beautifulcn
NEW! Setting overrides for each model!
NEW!!! API server!
The API server currently supports single generation only using the loaded model, requests via API will block UI text generation and vice versa, the supported requests are:
GET /v1/models
GET /v1/model
POST /v1/chat/completions
POST /v1/chat/reset
The file API.Example.bat is a simple usage example using curl.
Use the CUDA backend plugin from the R32 release if required, place the files in the LM Stud folder.
Hopefully i didnt overlook anything this time...