Skip to content

Fixes for the ONNX Learning Path and associated demo #2105

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jul 7, 2025
Merged

Fixes for the ONNX Learning Path and associated demo #2105

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 0 additions & 4 deletions content/learning-paths/servers-and-cloud-computing/onnx/_demo.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,10 +24,6 @@ terms_and_conditions: demo-terms-and-conditions.txt

prismjs: true # enable prismjs rendering of code snippets

example_user_prompts:
- Prompt 1?
- Prompt 2?


rag_data_cutoff_date: 2025/01/17

Expand Down
1 change: 1 addition & 0 deletions content/learning-paths/servers-and-cloud-computing/onnx/setup.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,7 @@ Clone and build the `onnxruntime-genai` repository:
cd ~
cp ./onnxruntime/build/Linux/Release/install/include/onnxruntime/onnxruntime_float16.h ./onnxruntime/build/Linux/Release/install/include/onnxruntime_float16.h
cp ./onnxruntime/build/Linux/Release/install/include/onnxruntime/onnxruntime_c_api.h ./onnxruntime/build/Linux/Release/install/include/onnxruntime_c_api.h
cp ./onnxruntime/build/Linux/Release/install/include/onnxruntime/onnxruntime_ep_c_api.h ./onnxruntime/build/Linux/Release/install/include/onnxruntime_ep_c_api.h
git clone https://github.com/microsoft/onnxruntime-genai.git
cd onnxruntime-genai
python3 build.py --config Release --update --ort_home ../onnxruntime/build/Linux/Release/install
Expand Down
6 changes: 3 additions & 3 deletions ...stem-hugo-theme/layouts/partials/demo-components/llm-chatbot/javascript--llm-chatbot.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -678,17 +678,17 @@

// Update ping & popup status
if (data.cluster_utilization == 'normal') {
showPopupPostConnection('Connected to Arm Neoverse V2 based LLM! Start chatting now.',"success");
showPopupPostConnection('Connected to Arm Neoverse based LLM! Start chatting now.',"success");
//ping_txt.textContent = `Ping: ${ping}`
traffic_txt.textContent = 'Server traffic: Low'
}
else if (data.cluster_utilization == 'high') {
showPopupPostConnection('Connected to Arm Neoverse V2 based LLM! Traffic is high, delays may occur. Start chatting now.',"success");
showPopupPostConnection('Connected to Arm Neoverse based LLM! Traffic is high, delays may occur. Start chatting now.',"success");
//ping_txt.textContent = `Ping: ${ping}`
traffic_txt.textContent = `Server traffic: High`
}
else if (data.cluster_utilization == 'at-limit') {
showPopupPostConnection('Connected to Arm Neoverse V2 based LLM! Traffic is high, delays may occur. Start chatting now.',"warning");
showPopupPostConnection('Connected to Arm Neoverse based LLM! Traffic is high, delays may occur. Start chatting now.',"warning");
//ping_txt.textContent = `Ping: ${ping}`
traffic_txt.textContent = `Server traffic: High`
}
Expand Down