Skip to content

v0.0.123

Choose a tag to compare

@shouryashashank shouryashashank released this 14 Sep 06:37
· 13 commits to main since this release
0ab3107
  • added support for gguf model files
model = predacons.load_model(model_path=model_id, gguf_file=gguf_file)
tokenizer = predacons.load_tokenizer(model_id, gguf_file=gguf_file)
chat = [
    {"role": "system", "content": "you are a travel planner who plans trips for people. and list down the places to visit at that place"},
    {"role": "user", "content": "I want to plan a trip to new delhi. Can you help me with that?"},
]
predacons.chat_generate(model = model,
        sequence = chat,
        max_length = 200,
        tokenizer = tokenizer,
        trust_remote_code = True,
        do_sample=True,
        )

What's Changed

Full Changelog: v0.0.122...v0.0.123