Benchmarking 15 “E-Waste” GPUs with Modern Workloads

7/13/2026 at 6:27:28 PM

No mention of the venerable Tesla P4. 75W peak, 8GB VRAM, about $80 (£60).

I have 6x P4s, a Xeon E5 2696v3 (36 threads, 3.8ghz peak but all core turbo unlocked, so 6 cores at 3.8Ghz - about 8 cores at 3.5ghz, or all cores at 3.1ghz), 48GB DDR4, all fit into a micro atx case running on a 650W MSI psu. This gives me a virtual 48GB GPU (llama.cpp ftw) to backup that 48GB of RAM.

I typically see scores of at least 7-12t/s on 20-30B Q4KM size dense models, on a 32K/48K/64K context, adequate for modern inference.

The pain point is the prompt loading, it is far far slower, minutes not seconds, than modern tensor core 8GB 5060s (my other machine's 2x GPUs) but is quite similar in regular inference speed once it has loaded.

by SillyUsername

7/13/2026 at 11:28:24 PM

That’s cool but 7 - 12 tps is frustrating for anything interactive.

by roger_

7/13/2026 at 6:31:02 PM

Yes! P4 and the other small cards are fantastic. I've been more focused on developing a cooling system around the 2 slot sized cards so I don't have any of these lying around. Are you using P4 for anything outside of LLM work? I'm interested in seeing their image processing capabilities.

by eso_logic

7/13/2026 at 8:36:54 PM

> about $80 (£60)

Man, I wish I lived where you guys lived.

by joe_mamba

7/13/2026 at 9:06:55 PM

Same, and hope I can afford that w/$ $/t, 650w is wild to run here24/7 , would cost me 32% of my salary

by 0x20Fearless

7/13/2026 at 11:30:43 PM

(650/1000)(24*30)=468 kWh.

That would cost me about $70/month ($0.15/kWh) or someone in California about $234/month ($0.50/kWh).

Do you pay $1/kWh and make ~$1500/month or something? I can’t make the math work for your case.

by quickthrowman

7/14/2026 at 10:57:22 AM

Yeah, that number doesn't align with the eBay listings I'm seeing. Perhaps the mere publication of this article has caused them all to sell out.

by pjc50

7/13/2026 at 6:51:52 PM

How the hell did you fit 6 P4s in a mATX case?

by chromadon

7/13/2026 at 7:22:15 PM

When I wanted to tinker with self-hosted models, I bought a couple of Radeon Pro V620 GPUs, because they're 32GB, still supported by current ROCm releases, and a few years newer than the similar-priced 32GB Nvidia cards (which are all EOL). They're a little faster than the old Tesla stuff, as well. 64GB is enough to run Gemma 4 31b 4-bit QAT with pretty big context at a respectable interactive speed (30+ tokens per second sustained).

That said, even the old Radeon Pro stuff has gotten more expensive on eBay, so I'm not necessarily recommending cheap old server cards that need custom-printed fan shrouds to operate in a consumer PC. Probably better to buy the Radeon AI Pro R9700 for $1400, which will be faster, supported for many years, and has a fan already. Or, maybe even the Intel ARC B70 for $1000.

by SwellJoe

7/13/2026 at 9:41:39 PM

The B70 is woeful with respect to software performance today, unfortunately, and your stuck using Intels forks of things and it still doesn’t get the full expected throughput. Such a shame to be honest.

by girvo

7/13/2026 at 9:59:51 PM

Yeah, I'd recommend spending a little more for the AMD. As I understand, it's 40%+ faster. And, while ROCm is less mature than CUDA, it is miles more mature than the Intel stack.

by SwellJoe

7/13/2026 at 4:38:08 PM

Darn, I was hoping to see bc-250's (aka PS5 chips) in there. They've recently become popular for inference and they are only about $200 on ebay. They hold a special place in my heart because I deployed 20k of them and I'm glad to see they are finding a purpose now and not just e-waste.

by latchkey

7/13/2026 at 4:56:36 PM

Interesting! I had only heard of them as cheap gaming boxes. Didn't know they were being used for cheap inference, too, but it makes sense.

> They hold a special place in my heart because I deployed 20k

Sounds like something I'd love to hear more about if you can share

by Aurornis

7/13/2026 at 5:12:09 PM

ethereum mining, long shut down...

by latchkey

7/13/2026 at 9:17:52 PM

This needs a blog post & HN submission

by Scoundreller

7/13/2026 at 6:39:03 PM

Cool stuff. Just read: https://github.com/akandr/bc250

by riedel

7/13/2026 at 6:41:42 PM

Yea, I'm bummed I didn't know about the 40-CU unlock, although it probably wouldn't have had much impact on mining performance. It still would have been neat to test. I did build a whole automated solution for auto-tuning each individual board. It would start at the "best" settings and then downgrade every time there was a crash. If it wasn't crashing, then those were the new "best" settings for that individual chip.

by latchkey

7/13/2026 at 4:39:30 PM

Wow holy crap this is news to me! I will have to consider picking some of these up for testing, what is it like working with them?

by eso_logic

7/13/2026 at 5:12:50 PM

there is a discord server for fans of bc-250... lots of information there.

by latchkey

7/13/2026 at 4:15:48 PM

Great read. I'd love to know more about how power consumption changes as cards get newer too!

by kn100

7/13/2026 at 4:42:32 PM

Thanks! Yeah this is a major consideration. I have looked at power consumption throughout runs in the past (https://esologic.com/gpu-server-benchmark/#gpu-box-benchmark) and found that for many of these enterprise class cards, they're happy to slam right into the max TDP. So, for doing actual work, you'll be living up closer to the rated TDP of the cards. Recording power consumption is easy on nvidia and I'll likely add this to future versions of the benchmarking tool.

by eso_logic

7/13/2026 at 8:04:02 PM

for some of these gpus you can set a very reduced power limit for modest reduction in performance, tdp is not the full story

by Palomides

7/13/2026 at 9:41:18 PM

[dead]

by TxFkdZ

7/13/2026 at 11:34:19 PM

Getting (further) into this myself so good timing. Running Qwen 3.6 27B at decent speed on some old cards but going to branch out.

I bough an Octominer for ~$150 which has power and PCIe slots and a basic Celeron and should let me expand to as many GPUs as I want.

I considered the P100s but I think the V100 16GBs are a better deal at $250. The 32GBs are way too much though.

by roger_

7/13/2026 at 7:51:39 PM

Depends on the use case, as for hardware h265 codecs a rtx 5070 Ti works just as well as the rtx 6000 gpu. Legacy GPU don't support modern codecs, but modern Intel chips have h265 HDR hardware support. Lower <16GB VRAM GPU are not really useful for "AI" model labs, so are often far more economical for rendering media.

https://www.pugetsystems.com/pugetbench/creators/davinci-res...

https://www.pugetsystems.com/pugetbench/creators/premiere-pr...

In some cases it is better to have lower passmark scores:

https://www.videocardbenchmark.net/gpu.php?gpu=RTX+PRO+6000+...

Blender is heavily bottle-necked by ray-tracing and de-noising operations:

https://opendata.blender.org/benchmarks/query/?compute_type=...

One metric that isn't considered is VRAM, as some rendering pipelines still rely on composited baked-scenes to reduce each areas memory requirements.

In general, the $/performance unit will depend on what you are doing, but there is 1 more thing to consider... Old GPU use mystery binary BLOB drivers no longer maintained on modern kernels. You might get the software to work with a legacy Windows GPU driver, but the key takeaway concept here is "might". =3

by Joel_Mckay

7/13/2026 at 5:26:54 PM

Have you tried 27B class models like qwen3.6?

by russianGuy83829

7/13/2026 at 5:35:14 PM

This initial round of benchmarking was to understand if there was any usecase here at all and I think there is. In a follow up, I'll be trying to answer questions like this. How big of a model can you fit on 4x M60, 4x P100, 4x V100? What are the tok/second when varying context length?

Do you have a set of models you'd like me to look at?

by eso_logic

7/13/2026 at 5:47:04 PM

That's great. Personally, I'd interested in Qwen3.6-27B and deepseek V4 flash (or pro), with contexts above 60k. They seem to be popular and have good coding performance. I'd appreciate numbers on a single or two GPUs where a quantized version fits reasonably into the VRAM (Qwen in 16 or 24GB). 4 older GPUs approach a used 3090 in price, and the 3090 has better support for speedups like MTP. So cheaper but slower looks like a reasonable target to me.

by russianGuy83829

7/13/2026 at 5:55:48 PM

No problem. Varying context size is a common request I've been getting as well. Personally I'm looking forward to seeing how much we can cram into the ancient K80's 24GB of VRAM :0

by eso_logic

7/14/2026 at 9:49:10 PM

Thank you, looking forward to it.

I just saw this simple patch to enable MTP (potentially 2x performance) on older GPUs (Kepler etc), so maybe it will work for you

https://github.com/ggml-org/llama.cpp/pull/25680

Also, for Qwen, the 4 bit _XL quantization seems to have a good balance of performance to size.

by russianGuy83829

7/13/2026 at 6:14:26 PM

Similar interest here, possibly including if qwen 3.6, Gemma4 or DiffusionGemma (with the largest quants that will fit in a single card) will offer, say, 50 tokens-per-second (fast enough for interactive human-in-the-loop code research, print-f iterations on code to debug things, etc; or let the LLM churn on a problem for a minute while I step out to handle something else), context of up to 200k preferred.

Also if nothing else the below project lets you use an NVidia graphics card as low-latency swap, which has been nice as a buffer as RAM prices remain high and leaves me eyeing that 24GB card you mentioned as an alternative...

https://github.com/c0deJedi/nbd-vram

by NortySpock

7/14/2026 at 4:59:59 AM

Have a look at Donato Capitella's video: https://m.youtube.com/watch?v=zp8j4vO-wz0 He provides also toolboxes and benchmark tables as text (in the video description)

by mkesper

7/13/2026 at 8:01:05 PM

I get 14-16 t/s on Qwen 3.6 - 27B Q4 MTP with a combination of P4000 + P5000.

by tronjr

7/13/2026 at 6:51:27 PM

This site does not like being on the front page of HN. ~7MB for pictures of graphs that probably should have html or svg.

This is an interesting article though. Bookmarking since my dual e5-v4 system is unplugged until summer is over.

by nbf_1995

7/13/2026 at 7:43:46 PM

I'm trying bruh fuck!

by eso_logic

7/13/2026 at 7:58:25 PM

For an easier change than HTML or SVG, try running them though pngcrush to make the graph images much smaller. Won't give you the lossless vector quality, but you should be able to keep these image files visually indistinguishable at much lower size.

by wlesieutre

7/13/2026 at 8:14:26 PM

Lesson learned for real, and TIL matplotlib is happy to export SVG. Good to know for next time. I upgraded my lightsail instance size in the meantime.

by eso_logic

7/13/2026 at 6:09:48 PM

Would it possible to stack up to 16x32GB VRAM, and test the performance of a MOE model such as Deepseek-v4-flash?

by rrhjm53270

7/13/2026 at 6:12:56 PM

16 GPUs would require one or more 220V breaker panels, more akin to an EV charger than a computer. You would also quickly run out of PCIe lanes. My goal with this benchmarking is to think about what is the most cost effective way to fill 4U.

by eso_logic

7/14/2026 at 1:34:55 AM

Specifically, 16GPUs is extreme, but for what the GPUs are being used for, do they need all of the PCIe lanes since they are not pushing pixel data? I ask as someone I know was into extreme mods. He built a rig that he'd plug into his dryer's 220v outlet to run. He also had PCIe break out cables to plug in multiple GPUs per PCIe slot on the mobo. Since the GPUs were only doing math for 3D rendering, he did not worry about the PCIe lanes. This was a really long time ago and I do not remember the actual speeds, but faster than CPU only renders.

by dylan604

7/13/2026 at 8:22:50 PM

Intriguing. I should benchmark my dust-gathering-stack of Titan V's, unless someone already has?

by dgacmu

7/13/2026 at 9:23:31 PM

I’m obviously not the intended audience for this, and I understand this hardware is not useful for it, but I can’t help but feel an extra twinge of disappointment that there’s no mention of PC gaming anywhere in a post about GPUs in the comments here on HN. It says a lot.

by namuol

7/14/2026 at 1:36:45 AM

Maybe you'd be interesting in r/gaming or something similar. Around these parts, it's all about taking something and using for something it was never intended to be used. Using a GPU to run a game sounds exactly the opposite and a very lame use of that GPU.

by dylan604

7/14/2026 at 6:03:57 AM

> Around these parts, it's all about taking something and using for something it was never intended to be used

Is this satire? I literally was hoping the article would be about how decommissioned _data center_ GPUs were repurposed for home PC gaming, the exact thing hacker news is ostensibly supposed to be about? It opens making a point about how the only cheap GPUs with lots of ram are e.g. K80s, which are hardly meant for gaming.

by namuol

7/14/2026 at 2:51:49 PM

Wait a few years, and we're all gaming on decomissioned data center GPUs ;-)

by archi42

7/14/2026 at 8:54:37 PM

Old datacenter GPUs could game, but new ones can only do OpenCL/CUDA/ROCm etc. and have no display out. Im using an MI50 right now and I would wish newer datacenter cards could also be used for everything like them.

by Azantys

7/13/2026 at 7:48:26 PM

A few years ago we got rid of a bunch of K80s at work, they were not only obsolete but had gotten glitchy as hell. I suspect this is from the many heat/cool cycles they went through. When they were running flat out the exhaust air felt like a hair dryer.

by SoftTalker

7/13/2026 at 7:57:06 PM

Do you have any #s on how old they were at decomm time? There's some suspicion that part of the AI bubble is companies playing games with depreciation, eg assuming that H100/H200s will survive for 5 years.

by Octoth0rpe

7/13/2026 at 8:01:01 PM

They were probably about 8 years old. They were well past reasonable EOL, but they were used for teaching, so performance was not a primary concern, as long as they worked. They had reached the point of not working often enough that we finally scrapped them.

by SoftTalker

7/13/2026 at 8:17:18 PM

This is a great datapoint. Someone else brought up that I should be memory checking the GPUs to understand if things are breaking down.

by eso_logic

7/14/2026 at 3:42:52 AM

[flagged]

by Capitanai

7/13/2026 at 6:06:19 PM

[flagged]

by jkonline

7/13/2026 at 6:28:21 PM

"Don't post generated text" - https://news.ycombinator.com/newsguidelines.html

by loeg

7/13/2026 at 6:47:07 PM

The rules for comments are now so lengthy that probably 90% of comments would violate one. It's like how police can pull you over for any reason and justify it by picking a law you've unwittingly violated

by 0xbadcafebee

7/13/2026 at 8:05:51 PM

Most of them are just restatements of each other, with the occasional pet peeve thrown in.

by BigTTYGothGF

7/13/2026 at 8:22:40 PM

Trying to follow all the rules is fun for its own sake.

by axus

7/14/2026 at 12:13:56 AM

Easy; take your comment before you post it and have the LLM evaluate it against the rules.

by kQq9oHeAz6wLLS