Skip to content

Commit

Permalink
[no ci] minor edit
Browse files Browse the repository at this point in the history
  • Loading branch information
amaiya committed Sep 6, 2023
1 parent c2bf38c commit af11d1c
Showing 1 changed file with 5 additions and 2 deletions.
7 changes: 5 additions & 2 deletions examples/text/generative_ai_example.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -16,12 +16,15 @@
"source": [
"## Generative AI with *ktrain*\n",
"\n",
"*ktrain* includes support for Generative AI via the `generative_ai` module, which is now powered by our [OnPrem.LLM](https://github.com/amaiya/onprem) package. Think of it as a lightweight version of ChatGPT that can be run locally on your own machine. Since it does not communicate with external APIs like OpenAI, it can be used with non-public data and within air-gapped networks (e.g., behind corporate firewalls). For lighter-weight deployments, you can also install and use **OnPrem.LLM** separately without the rest of **ktrain**, if you'd like:\n",
"As of v0.38.x, the `generative_ai` module in **ktrain** is now powered by our [OnPrem.LLM](https://github.com/amaiya/onprem) package. The `generative_ai.LLM` class replaces the older `generative_ai.GenerativeAI` class. \n",
"\n",
"Think of the `generative_ai` module in **ktrain** as a lightweight version of ChatGPT that can be run locally on your own machine. Since it does not communicate with external APIs like OpenAI, it can be used with non-public data and within air-gapped networks (e.g., behind corporate firewalls). For lighter-weight deployments, you can also install and use **OnPrem.LLM** separately without the rest of **ktrain**, if you'd like:\n",
"\n",
"\n",
"```python\n",
"!pip install onprem\n",
"from onprem import LLM\n",
"\n",
"```\n",
"\n",
"\n",
Expand Down Expand Up @@ -55,7 +58,7 @@
}
],
"source": [
"from ktrain.text.generative_ai import LLM\n",
"from ktrain.text.generative_ai import LLM # or use \"from onprem import LLM\" instead\n",
"llm = LLM(n_gpu_layers=35)"
]
},
Expand Down

0 comments on commit af11d1c

Please sign in to comment.