Skip to content
This repository has been archived by the owner on Mar 29, 2024. It is now read-only.

Commit

Permalink
blog only && make network mode as blog post (#81)
Browse files Browse the repository at this point in the history
* blog only && make network mode as blog post

* remove reference to docs
  • Loading branch information
tiero committed Dec 6, 2023
1 parent d428a3b commit 4a112ec
Show file tree
Hide file tree
Showing 12 changed files with 103 additions and 3,001 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -422,4 +422,4 @@ docker run --gpus all -p 8000:8000 blog-post/chat-falcon-7b-instruct-gpu:latest

### Conclusion

In this tutorial, we have demonstrated how to serve the Falcon 7B Instruction model using FastAPI and Docker. This is a crucial first step in serving a model for production use cases. [Learn more](/docs/category/service-packaging/) about packaging your model and exposing it to the Prem Ecosystem to quickly get up and running with your AI initiatives.
In this tutorial, we have demonstrated how to serve the Falcon 7B Instruction model using FastAPI and Docker. This is a crucial first step in serving a model for production use cases.
Binary file added blog/2023-12-04-prem-app-network-mode/image.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
56 changes: 56 additions & 0 deletions blog/2023-12-04-prem-app-network-mode/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,56 @@
---
slug: prem-app-network-mode
title: "Contribute GPU to the Prem Network"
authors: [tiero]
tags: [llm, ai, self-hosted, prem, on-premise, open-source, peer-to-peer, gpu, prem-network]
description: "Contribute GPU to the Prem Network and help us to build the largest computer in the world to run AI inference with consumer devices."
image: "./image.png"
---

# Network Mode

If you have installed Prem App on your Mac with Apple Silicon, you can contribute to the Prem Network by running a Prem node on your machine. In order to do that, you can follow the instructions below.

<!--truncate-->

## 1. Install Prem on your Mac

You must have Prem App installed on your MacOS with Apple Silicon [here](https://install-app.prem.ninja/latest-release) in order to provide inference capacity to the Prem Network.

## 2. Join the Network

1. Click on `Settings` in the to and scroll down to `Prem Network` section.

![Network Init](./network-init.png)

- Select the Model you wanna contribute to.
- Select the number of blocks you want to contribute to.
- Click on `Start` button.

As soon as you Click on the `Start` button, the Prem App will start downloading the blocks from the network and will start contributing to the network. The process requires a coouple of minutes to complete. In the meantime, you will see the following message:

![Network Install](./network-install.png)

When the process is completed, a pop-up will appear with the following message:

![Network Done](./network-done.png)

## 3. Check your contribution

You can now go to https://network.premai.io to check your contribution to the network.

## 4. Stop contributing

You can always stop to contribute, clicking on the `Stop` button.

![Network Stop](./network-stop.png)

## 5. Delete the dependencies

If you want to delete the environment and start fresh, you can click on the `Delete` icon and the udnerlying dependencies will be deleted.

![Network Delete](./network-delete.png)

## 5. Make open-source AI a reality

You can now contribute to the Prem Network and help us to build the largest computer in the world to run AI inference with consumer devices.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
67 changes: 4 additions & 63 deletions docusaurus.config.js
Original file line number Diff line number Diff line change
Expand Up @@ -36,14 +36,9 @@ const config = {
'classic',
/** @type {import('@docusaurus/preset-classic').Options} */
({
docs: {
sidebarPath: require.resolve('./sidebars.js'),
// Remove this to remove the "edit this page" links.
editUrl: 'https://github.com/premAI-io/dev-portal/blob/main/',
docLayoutComponent: "@theme/DocPage",
docItemComponent: "@theme/ApiItem" // Derived from docusaurus-theme-openapi-docs
},
docs: false,
blog: {
routeBasePath: '/blog',
showReadingTime: true,
// Remove this to remove the "edit this page" links.
editUrl: 'https://github.com/premAI-io/dev-portal/blob/main/',
Expand All @@ -55,47 +50,8 @@ const config = {
],
],

plugins: [
[
'docusaurus-plugin-openapi-docs',
{
id: "apiDocs",
docsPluginId: "classic",
config: {
daemon: {
specPath: "https://daemon.prem.ninja/openapi.json",
outputDir: "docs/prem-daemon/api",
},
chat: {
specPath: "swagger/chat.json",
outputDir: "docs/prem-app/usage/chat/api",
},
embeddings: {
specPath: "swagger/embeddings.json",
outputDir: "docs/prem-app/usage/embeddings/api",
},
diffuser: {
specPath: "swagger/diffuser.json",
outputDir: "docs/prem-app/usage/diffuser/api",
},
upscaler: {
specPath: "swagger/upscaler.json",
outputDir: "docs/prem-app/usage/upscaler/api",
},
audioToText: {
specPath: "swagger/audio-to-text.json",
outputDir: "docs/prem-app/usage/audio-to-text/api",
},
textToAudio: {
specPath: "swagger/text-to-audio.json",
outputDir: "docs/prem-app/usage/text-to-audio/api",
},
}
},
],
require.resolve("@cmfcmf/docusaurus-search-local"),
],
themes: ["docusaurus-theme-openapi-docs"],
plugins: [],
themes: [],

themeConfig:
/** @type {import('@docusaurus/preset-classic').ThemeConfig} */
Expand All @@ -112,12 +68,6 @@ const config = {
src: 'img/logo.svg',
},
items: [
{
type: 'docSidebar',
sidebarId: 'tutorialSidebar',
position: 'left',
label: 'Docs',
},
{to: '/blog', label: 'Blog', position: 'left'},
{
href: 'https://github.com/premAI-io/prem-app',
Expand All @@ -129,15 +79,6 @@ const config = {
footer: {
style: 'dark',
links: [
{
title: 'Docs',
items: [
{
label: 'Docs',
to: '/docs/intro',
},
],
},
{
title: 'Community',
items: [
Expand Down
2 changes: 0 additions & 2 deletions package.json
Original file line number Diff line number Diff line change
Expand Up @@ -20,8 +20,6 @@
"@docusaurus/preset-classic": "2.4.1",
"@mdx-js/react": "^1.6.22",
"clsx": "^1.2.1",
"docusaurus-plugin-openapi-docs": "v2.0.0-beta.3",
"docusaurus-theme-openapi-docs": "v2.0.0-beta.3",
"prism-react-renderer": "^1.3.5",
"react": "^18.2.0",
"react-dom": "^18.2.0"
Expand Down
5 changes: 0 additions & 5 deletions src/pages/index.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -13,11 +13,6 @@ function HomepageHeader() {
<h1 className="hero__title">{siteConfig.title}</h1>
<p className="hero__subtitle">{siteConfig.tagline}</p>
<div className={styles.buttons}>
<Link
className="button button__primary button--lg"
to="/docs/intro">
Docs
</Link>
<Link
className="button button__outline button--lg"
to="/blog">
Expand Down
Loading

0 comments on commit 4a112ec

Please sign in to comment.