Recommended specs

[Savatar1001]

What are the least, middle ground and perfect fit pc/phone requirements?

[CoolJohn-lab]

It can run on pretty much any old potato. Minimum spec to do something useful, I think would be 16GB RAM and an RTX2060 or better with 8GB VRAM or better. You can't run this on a phone. You can access it from a phone, but it runs on a PC.

Middle ground would be 2x 16GB GPUs to give a total of 32GB VRAM, 64GB of DDR5 and a fast, modern CPU with 16+ CPU cores.

Ideal spec is either a dedicated server running 8x 32GB RTX5090 cards in a Supermicro server case, plus 256GB+ of very fast RAM. Or, something like a 512GB Mac Studio with an M3 Ultra chip. Or maybe a stack of 4x Nvidia DGX Sparks.

[Savatar1001]

It can run on pretty much any old potato lolsies... :

OS Name Microsoft Windows 11 Pro
Version 10.0.26200 Build 26200
Other OS Description Not Available
OS Manufacturer Microsoft Corporation
System Name
System Manufacturer ASUSTeK COMPUTER INC.
System Model GL702VT
System Type x64-based PC
System SKU ASUS-NotebookSKU
Processor Intel(R) Core(TM) i7-6700HQ CPU @ 2.60GHz, 2592 Mhz, 4 Core(s), 8 Logical Processor(s)
BIOS Version/Date American Megatrends Inc. GL702VT.300, 9/30/2016
SMBIOS Version 3.0
Embedded Controller Version 255.255
BIOS Mode UEFI
BaseBoard Manufacturer ASUSTeK COMPUTER INC.
BaseBoard Product GL702VT
BaseBoard Version 1.0
Platform Role Mobile
Secure Boot State Off
PCR7 Configuration Elevation Required to View
Windows Directory C:\WINDOWS
System Directory C:\WINDOWS\system32
Boot Device \Device\HarddiskVolume1
Locale United States
Hardware Abstraction Layer Version = "10.0.26100.1"
User Name
Time Zone South Africa Standard Time
Installed Physical Memory (RAM) 16.0 GB
Total Physical Memory 15.9 GB
Available Physical Memory 2.60 GB
Total Virtual Memory 31.9 GB
Available Virtual Memory 8.25 GB
Page File Space 15.9 GB
Page File C:\pagefile.sys
Kernel DMA Protection Off
Virtualization-based security Running
Virtualization-based security Required Security Properties
Virtualization-based security Available Security Properties Base Virtualization Support
Virtualization-based security Services Configured
Virtualization-based security Services Running
App Control for Business policy Enforced
App Control for Business user mode policy Off
Automatic Device Encryption Support Elevation Required to View
A hypervisor has been detected. Features required for Hyper-V will not be displayed.

Thats a hard no...

[jorgeporragas]

I don't have a particularly powerful setup, a pretty normal gaming PC:

• Ryzen 5 5600X
• 32GB DDR4 RAM
• Radeon RX 9600 XT 16GB
• Fedora 44

This a Linux partition I'm running it on. It has nothing in it other than Odysseus and everything else needed to run the models. I keep my gaming partition separate.

Odysseus works marginally well depending on the model. The main issue has been the LLM's context window limit rather than performance, and the LLM mostly being hit or miss when it comes to figuring out how to use the functions built in Odysseus. I've had better results when I changed the default context window size with Ollama.

Ideally look at the models in the cookbook and look them up (they all have pros and cons) being aware of the size since the entire model ideally needs to fit your VRAM and ideally have a few gigabytes to spare for context.

I'm a developer but new to hosting AI and using LLMs on my machine so this is all alien to me, maybe I'm doing something wrong. I've mostly figured stuff out with trial and error (and asking questions to AI, ironically).

[Savatar1001]

Aaaah open sourced magic is beautiful.
Ridiculously expensive hardware is depressing.

[jorgeporragas]

I've had some success after some tests. The main improvement came from increasing the model's context window using Ollama. I've been using Qwen3-14B with a 32K context window and it definitely makes everything work much better.