Skip to content

Home

Jump to bottom
Rickard Edén edited this page Sep 15, 2023 · 6 revisions

These features are in the 'extensions' branch.

This fork is 'gifted' with a few extra abilities. It currently has 4 'extensions'

  1. It can ask for the date.

It requires there to be a "### Response:" tag, and then "[date_time]" somehow generated by the response.

  1. It can 'remember things' from a vector db (chroma), ltm, long term memory

It uses the latest prompt after a stop_sequence as a search query.

  1. It can do static searches against api.duckduckgo.com

Web search likewise requires "### Response:" and then "[search: what_to_search_for]"

  1. It can describe an image (using clip-interrogator)

It uses the latest prompt after a stop_sequence and looks for an [image:some image]. Ie, you input it. Here is an example prompt: ### Instruction: If you are asked to evaluate an image, you can find its description inside "Image contains:[image information]". Use it as a base to write in your own words.

Who can you see in [image:test.jpg]? What is he doing?

### Response:

It can currently only (safely) run one 'extension' at a time. (May change if someone actually wants it)

Run with --extensions "chroma_db" OR "date_and_time" OR "web_search"

It can run them all, then add a space between each, but their context might be replaced by the following extension.

Then the trick is to make them actually use the tool. Chroma db is easy, since it will look for anything that is currently in the last section of the prompt (after any stop_section) in the db.

Clone this wiki locally