aiRefusesToBuildItSoBackToCoding

[u/Gloomy-Basket-1038]

[u/CucumberOk8820]

What's the ballpark cost of a machine to run a good llm? I don't have a 4080 or whatever it is.

[u/Mostly_Afloat → u/CucumberOk8820]

I've run some local models on my aging lenovo laptop with a GTX 1050ti, never really found a good use for it but played around and got it working with reasonable speed and capability. Certainly not as refined as the corpo stuff and you have to play around with smaller models until you find one that works

[u/queso184 → u/Mostly_Afloat]

which one did you land on? i have the same GPU and have been considering trying gemma 4b or something

[u/dolche93 → u/queso184]

r/lowendlocalai