API

Gremory API

Overview

Gremory provides a single POST endpoint.

Endpoint

POST /v1/chat/completions

This endpoint allows you to generate OpenAI-compatible chat completions (messages) and legacy text completions (prompt).

Request Parameters

Parameter	Type	Required	Default	Description
prompt	string	No	None	The input prompt for the chat completion.
do_sample	boolean	No	True	Whether to use sampling in the generation process.
samplers	array of Sampler objects	No	None	List of sampler configurations to use.
add_generation_prompt	boolean	No	True	Whether to add a generation prompt to the input.

Sampler Object

The structure of a Sampler object is not provided in the given information. You may want to add details about the Sampler object if available.

Example Request

{
  "prompt": "Tell me a joke about programming.",
  "do_sample": true,
  "samplers": [
    {
      // Sampler configuration
    }
  ]
}