What hardware do I need to run PatentForgeLocal? #2
Unanswered
scottconverse
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Minimum:
Recommended:
The default model (Gemma 4 26B) needs about 18 GB for weights. With 32 GB RAM it fits but it is tight -- you will get better performance with 48-64 GB.
GPU acceleration makes a huge difference. With a properly configured AMD Radeon 780M iGPU, expect ~8-15 tokens/second. Without GPU, CPU-only inference runs at ~3-8 tokens/second -- still usable but noticeably slower.
NVIDIA GPUs work automatically with Ollama. AMD iGPUs may need ROCm configuration on Linux (Ollama handles this automatically on Windows via DirectML). PatentForgeLocal v0.1.0 includes hardware detection scripts that configure this automatically.
Beta Was this translation helpful? Give feedback.
All reactions