Skip to content
This repository has been archived by the owner on May 28, 2024. It is now read-only.

Update deploy-on-eks.md #135

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Update deploy-on-eks.md #135

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
6 changes: 3 additions & 3 deletions docs/kuberay/deploy-on-eks.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -262,8 +262,8 @@ It's important to note that the `model` argument refers to the path of the LLM m
```sh
# Step 2.1: Port forward the Kubernetes Serve service.
# Note that the service will be created only when all Serve applications are ready.
kubectl get svc # Check if `aviary-serve-svc` is created.
kubectl port-forward service/aviary-serve-svc 8000:8000
kubectl get svc # Check if `rayllm-serve-svc` is created.
kubectl port-forward service/rayllm-serve-svc 8000:8000

# Step 2.2: Check that the models have started running using `serve status`
serve status
Expand Down Expand Up @@ -339,4 +339,4 @@ kubectl delete -f ray-service.rayllm-eks.yaml
helm uninstall kuberay-operator

# Delete the Amazon EKS cluster via AWS Web UI
```
```