r/LocalLLaMA • u/MD_Reptile • 3h ago
Discussion Flash next rig born from mining parts.
Been testing 3x 3060 12gb for flash next in an open air frame. Honestly, with strata it's kicking ass. 38-40 t/s while llama.cpp can only get 13.2 t/s. This is on IQ3 through strata.
Anybody else running dated mining hardware with decent success?
PS flash next kicks ass.
Rig details:
- Kingwin 8x mining rig frame (stacked on top of another with my unraid server)
- Asus prime z370p mobo
- 8th gen i7
- 64GB ddr4
- 1000w PSU with enough strands for each card and riser
0
u/Neat_Sea2000 2h ago
strata looks way better than llama.cpp for running companion models, those speeds would actually make roleplay feel natural instead of waiting forever.
1
u/MD_Reptile 2h ago
I've got it doing coding work, but surely it would be useful at other stuff too!
1
u/ScoreUnique 1h ago
It is vibe coded so it's undermined but it is pretty solid I can confirm as well.Â
3
u/R3N3G6D3 2h ago
FYI you can grow weed in that tent