Skip to content

lamini-ai/lamini-sdk

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

45 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Latest Release GitHub License

Lamini SDK

In this SDK, we include tutorials for achieving high-quality results with Language Models (LLMs) using Lamini.
With Lamini, you own the LLM you create -- you can deploy it or release it open source.
This SDK teaches effective tools for building LLMs.
We strongly encourage following the SDK in order as the concepts build on each other and are sorted by difficulty.

  1. Playground - learn how to create a chat app that calls an LLM. We include examples using slack, python, and react.
  2. Prompt Engineering - crafting and refining input queries or instructions to achieve desired responses from language models.
  3. Retrieval Augmented Generation (RAG) - combining information retrieval with text generation to improve language models.
  4. Instruction Fine Tuning (IFT) - train your LLM using data in a question and answer format.
  5. JSON - extract structured output from an LLM, following a guaranteed JSON schema.
  6. Evaluation - evaluate the quality of your LLM.
  7. Classify - classify data using an LLM, e.g. to filter out low quality training data
  8. Domain Adaptation - continue training your LLM using a large amount of new data. COMING SOON.
  9. Pretraining - Train an LLM from scratch. Make sure you have 1,000s of GPUs allocated. COMING SOON.

Notes

The goal of this SDK is to teach and provide examples of important tools for building LLMs.
The examples emphasize simplicitly and readibility, not heavy optimization.
Once you have mastered a module from this SDK, consider forking it and adapting it to your own application.
All of the code in this repository is licensed Apache 2. You are free to use it for any purpose including commercial applications.

Installation Instructions

Before you start, please get your Lamini API key and install the python library.

First, get <YOUR-LAMINI-API-KEY> at https://app.lamini.ai/account. Add the key as an environment variable.

export LAMINI_API_KEY="<YOUR-LAMINI-API-KEY>"

Next, install the Python library.

pip install --upgrade lamini

GitHub Repository


The source code for SDK can be found on GitHub at lamini-ai/lamini-sdk. Feel free to explore and contribute!

About Lamini


Lamini is the LLM platform for developers to specialize LLMs on their own data and infrastructure: easier, faster, and better than any LLM for their use case.
Our mission is to build customizable superintelligence that anyone can build and own.


GitHub forks   © Lamini   GitHub stars