Skip to content

KenGen, plus mathematical ability & internet access, based on Llama 2.

Notifications You must be signed in to change notification settings

kendasi/kengen3

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

KenGen-3

KenGen, plus mathematical ability & internet access, based on Llama 2.

Concept

Many Large Language Models face issues with solving mathematical problems, often attempting to solve it, but often getting a couple digits wrong. KenGen-3 uses a wrapper using technology Kendasi invented to allow it to solve math problems. What's more, it has access to the internet, but unlike existing models, it doesn't use it when it's completely unnecessary - only when it's actually needed. What's more, it can be up to 14,000% faster than GPT-4 and larger models.

To do

A few things need to be done still:

  • Move onto new servers [DONE]
  • Switch to LlaMA-2 Chat 7B model [DONE]
  • Set up API
  • Incorporate the internet and math ability into the new web servers with Llama-2

The "how?"

KenGen uses the smallest Llama-2 Chat-finetuned model, with 7 billion parameters. While it's small, with the added functionality added above, it still can produce very high quality results, even with a small model, allowing for cheaper and faster computation. The added functionality uses a custom wrapper developer by Kendasi. At the moment, it's still using OpenAI's API for the base model, but that will be switched out for Llama once the servers have been set up, as it costs money to run.

Regarding the internet, KenGen uses the Brave API to access the internet and collect data from the internet. KenGen has been finetuned to understand special tags such as and , used like XML tags, which is then simply formatted to be the answer calculated (kgmath) or found on the internet (kgweb) from the query that the model entered within the tags.

Setup

KenGen will be installed onto our VPS servers, after the hosting provider fixes some bugs. A REST API will be then published, which seperate docs will be written for. Users will be able to purchase credits through the KenGen API website..

About

KenGen, plus mathematical ability & internet access, based on Llama 2.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages