Repository navigation
[Results] gpu-unlock on 3x RTX 3090: 30+ real model setups before and after (image, video, LLM, embeddings, speech) #301
Patrity
started this conversation in
Show and tell
Replies: 1 comment
|
Appreciate you calling out that the fourth card was unlocked but outside the benchmark. It makes the three-card results easier to interpret. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I own four RTX 3090s and they do everything around here: images, video, embeddings, search, coding agents. The matrix benchmarks for gpu-unlock already looked great, so I wanted to know what it does to the stuff I actually run. (I also wanted to catch myself being wrong, because a 60% number deserves suspicion.)
So I ran more than 30 model and format setups, stock and unlocked, on one rig. The short version: the category barely predicts the gain, and the math path predicts almost all of it.
The Rig
10de:2204). A fourth 3090 is unlocked too, but I didn't benchmark it on its own.7eb51bc, targeted by PCI addressHow I Tried to Fool Myself
I also threw out my 4-card Z-Image throughput test. That one's on me: a metric bug let the slowest card set the score, and I overwrote the stock logs before I caught it.
GEMM
8192³ at 350 W, TFLOPS:
Real Workloads
One card each, 350 W. LLM rows are at an 8K prompt.
Decode gained about 4 to 5% on vLLM at 8K and stayed flat on llama.cpp. Exactly what your table says it should do.
Where I Land Against the README Table
Most of it lines up. These are the spots worth a second look, offered as data points since I only have my one rig:
Power
nvidia-smi. That's my best read on why it isn't a full 2x.Strix at 390 W added another 4 to 7% on compute bound work and under 1% on decode.
The Parts I Can't Explain
If your card disagrees with me, I want to hear about it. Thanks for building this. I'd feel worse about those half-rate years if I weren't rendering images 57% faster out of spite.
All reactions