From 1c4944d4b317215e0f08eaf7c1bc6396aa3e2c5e Mon Sep 17 00:00:00 2001 From: Pavel Tisnovsky Date: Sun, 3 Aug 2025 10:16:29 +0200 Subject: [PATCH 1/3] Both services in a container diagram --- docs/both_services_in_container.svg | 192 ++++++++++++++++++++++++++++ 1 file changed, 192 insertions(+) create mode 100644 docs/both_services_in_container.svg diff --git a/docs/both_services_in_container.svg b/docs/both_services_in_container.svg new file mode 100644 index 00000000..8f20cce8 --- /dev/null +++ b/docs/both_services_in_container.svg @@ -0,0 +1,192 @@ + + + + + + + + + + + + + + + + + + + + + +
+
+
Container
+
+
+ + + + + + + + + + + + + + + +
+
+
Prometheus
+
+
+ + + + + + + + + + + + + + + +
+
+
REST API
+
+
+ + + + + + + + + + + + + + + +
+
+
Metrics
+
+
+ + + + + + + + + + + + + + + + +
+
+
+
port
+
8321
+
+
+
+ + + + + + + + + + + + + + +
+
+
Lightspeed
core
+
+
+ + + + + + + + + + + + + + + + + + + + + +
+
+
+
llama-stack as separate server
+
+
+
+ + + + + + + + + + + + + + + + + + + + +
+
+
Configuration
+
+
+ + + + + + + + + + From 13913e2dfed82d4b2aa02c7fb3a6b4e62cb785a8 Mon Sep 17 00:00:00 2001 From: Pavel Tisnovsky Date: Sun, 3 Aug 2025 10:16:38 +0200 Subject: [PATCH 2/3] LCS in a container diagram --- docs/lcs_in_container.svg | 192 ++++++++++++++++++++++++++++++++++++++ 1 file changed, 192 insertions(+) create mode 100644 docs/lcs_in_container.svg diff --git a/docs/lcs_in_container.svg b/docs/lcs_in_container.svg new file mode 100644 index 00000000..6232cf44 --- /dev/null +++ b/docs/lcs_in_container.svg @@ -0,0 +1,192 @@ + + + + + + + + + + + + + + + + + + + + + +
+
+
Container
+
+
+ + + + + + + + + + + + + + + +
+
+
Prometheus
+
+
+ + + + + + + + + + + + + + + +
+
+
REST API
+
+
+ + + + + + + + + + + + + + + +
+
+
Metrics
+
+
+ + + + + + + + + + + + + + + + +
+
+
+
port
+
8321
+
+
+
+ + + + + + + + + + + + + + +
+
+
Lightspeed
core
+
+
+ + + + + + + + + + + + + + + + + + + + + +
+
+
+
llama-stack as separate server
+
+
+
+ + + + + + + + + + + + + + + + + + + + +
+
+
Configuration
+
+
+ + + + + + + + + + From 59c18e1eaee1770a809dc4fca8116087f9c5781a Mon Sep 17 00:00:00 2001 From: Pavel Tisnovsky Date: Sun, 3 Aug 2025 10:16:45 +0200 Subject: [PATCH 3/3] Link to images --- docs/getting_started.md | 9 ++++++--- 1 file changed, 6 insertions(+), 3 deletions(-) diff --git a/docs/getting_started.md b/docs/getting_started.md index b32d71c7..b6bb997f 100644 --- a/docs/getting_started.md +++ b/docs/getting_started.md @@ -1046,11 +1046,12 @@ a4982f43195537b9eb1cec510fe6655f245d6d4b7236a4759808115d5d719972 *Lightspeed Core Stack* image can run LCS service that connects to Llama Stack running in a separate process. This means that there will at least be two running processes involved: 1. Llama Stack framework with open port 8321 (can be easily changed if needed) -1. Image with LCS with open port 8080 mapped to local port 8080 (can be easily changed if needed) +1. Image with LCS (running in a container) with open port 8080 mapped to local port 8080 (can be easily changed if needed) + +![LCS in a container](./lcs_in_container.svg) > [!NOTE] > Please note that LCS service will be run in a container. Llama Stack itself can be run in a container, in separate local process, or on external machine. It is just needed to know the URL (including TCP port) to connect to Llama Stack. - > [!INFO] > If Llama Stack is started from a container or is running on separate machine, you can skip next parts - it is expected that everything is setup accordingly. @@ -1535,7 +1536,9 @@ podman run -it --network host -v lightspeed-stack.yaml:/app-root/lightspeed-stac ### Llama Stack used as a library -Llama Stack can be used as a library that is already part of OLS image. It means that no other processed needs to be started, but more configuration is required. +Llama Stack can be used as a library that is already part of OLS image. It means that no other processed needs to be started, but more configuration is required. Everything will be started from within the one container: + +![Both services in a container](./both_services_in_container.svg)