Skip to content

johanste/chatter

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Experiments with chat and tracing

Try out the experience with various API patterns for clients.

Example usage(s):

import chatter
import chatter.llama
import chatter.openai

client = chatter.openai.ParametersOpenAIClient(endpoint='zzz://openai.com',
                                               credentials="dummy",
                                               defaults={"temperature": 0.5})

completion = client.complete(
    messages = [chatter.Message("hello")],
    model="gpt-4",
    parameters = chatter.openai.OpenAIChatParameters(logprobs=True)
)

llamaclient = chatter.llama.ParametersLlamaClient(endpoint='zzz://llama.com', credentials="dummytoken")
llamaclient.complete([], "", parameters = { "seed": "123" })

Setup

pip install git+https://git@github.com/johanste/chatter#egg=chatter

About

Experiment for chat client API patterns

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages