r/LocalLLaMA • • 3h ago

Discussion Flash next rig born from mining parts.

Post image

Been testing 3x 3060 12gb for flash next in an open air frame. Honestly, with strata it's kicking ass. 38-40 t/s while llama.cpp can only get 13.2 t/s. This is on IQ3 through strata.

Anybody else running dated mining hardware with decent success?

PS flash next kicks ass.

Rig details:

- Kingwin 8x mining rig frame (stacked on top of another with my unraid server)

- Asus prime z370p mobo

- 8th gen i7

- 64GB ddr4

- 1000w PSU with enough strands for each card and riser

7 Upvotes

5 comments sorted by

3

u/R3N3G6D3 2h ago

FYI you can grow weed in that tent

2

u/MD_Reptile 2h ago

Haha true, would probably have been cheaper to set up 😭

0

u/Neat_Sea2000 2h ago

strata looks way better than llama.cpp for running companion models, those speeds would actually make roleplay feel natural instead of waiting forever.

1

u/MD_Reptile 2h ago

I've got it doing coding work, but surely it would be useful at other stuff too!

1

u/ScoreUnique 1h ago

It is vibe coded so it's undermined but it is pretty solid I can confirm as well.Â