Skip to content

R34

Pre-release
Pre-release

Choose a tag to compare

@CommanderLake CommanderLake released this 12 Aug 21:49
· 203 commits to master since this release

Fixed the model selection loading the incorrect model since column sorting was added.
Fixed cancelling Hugging Face download would throw an error and not delete the incomplete file.
Fixed the "Hugging Face" tab name.
Fixes and enhancements to the Curl code, network proxy etc. and additional translations by @beautifulcn

NEW! Setting overrides for each model!
NEW!!! API server!

The API server currently supports single generation only using the loaded model, requests via API will block UI text generation and vice versa, the supported requests are:
GET /v1/models
GET /v1/model
POST /v1/chat/completions
POST /v1/chat/reset

The file API.Example.bat is a simple usage example using curl.

Use the CUDA backend plugin from the R32 release if required, place the files in the LM Stud folder.

Hopefully i didnt overlook anything this time...