Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
37 changes: 37 additions & 0 deletions docs/getting-started/using-instructlab-with-podman-desktop.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@

---
title: Start InstructLab as a container
description: Covers the procedure to start an InstructLab container using the Podman Desktop UI
logo: images/ilab_dog.png
---


# Using InstructLab with Podman Desktop

With InstructLab-Podman Desktop integration, you can easily use the Podman Desktop UI to create an InstructLab container to work with. Podman Desktop provides the Podman AI Lab extension to work with Large Language Models (LLMs) in a local development environment. The extension also provides an option to start InstructLab as a container.

With a running InstructLab container, you can initialize an InstructLab session and train models with specialized knowledge and skill tuning. In the container's terminal, configure the InstructLab CLI to run relevant commands to download, serve, and chat with the model.

#### Prerequisites
Make sure you have:

- [Installed Podman Desktop](https://podman-desktop.io/docs/installation)
- [A running Podman machine](https://podman-desktop.io/docs/podman/creating-a-podman-machine).
- Installed the [AI Lab extension](https://podman-desktop.io/tutorial/running-an-ai-application#installing-the-extension).

#### Procedure

1. Click **AI Lab** in the left navigation pane.
1. In the TUNING section, click **Try InstructLab**.
1. Click the **Start InstructLab Container** button on the opened page. This step might take some time to start the container.
1. Click the **Open InstructLab container** button to access the container's terminal.

1. Run the `ilab config init` command to configure the InstructLab CLI.
![configure the InstructLab CLI](../images/initializing-ilab.png)

#### Verification

1. View the InstructLab container running on the Containers page.
![updated context details](../images/instructlab-container-running.png)
1. Click the name of the container to view its logs.
1. Click the **Terminal** tab to run `ilab` commands, such as `ilab model download`, `ilab model serve`, and `ilab model chat`.
Binary file added docs/images/initializing-ilab.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/images/instructlab-container-running.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1 change: 1 addition & 0 deletions mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ nav:
- Install on Mac Metal: getting-started/mac_metal.md
- Install on Linux NVIDIA: getting-started/linux_nvidia.md
- Install on Linux AMD: getting-started/linux_amd.md
- Start InstructLab as a container: getting-started/using-instructlab-with-podman-desktop.md
- Initialize InstructLab: getting-started/initilize_ilab.md
- Download models: getting-started/download_models.md
- Intro to serve and chat: getting-started/serve_and_chat.md
Expand Down