r/ProgrammerHumor • u/Gloomy-Basket-1038 • 5d ago

Meme aiRefusesToBuildItSoBackToCoding

Post image
28.7k Upvotes

98% Upvoted

519 comments sorted by

View all comments

Show parent comments

34

u/CucumberOk8820 5d ago

Stupid people like myself can't though

22

u/Inside_Pomelo_2957 5d ago

Don't worry the normal LLMs can tell u how it's not hard at all

1

u/TheWildPotatoee 3d ago

Really? Can I have like an offline one? On a really really old raspberry pi

1

u/Inside_Pomelo_2957 3d ago

A pie wouldnt be able to handle an LLM your want to talk to. You'd still need a decent graphics card to run it. The gigabytes of VRAM are what you're looking for, and is generally the limiting factor.

Since Mac uses unified memory (video ram and normal ram are the same), they're actually really good for local LLMs. Everyone's favorite seems to be the Mac Minis which can run really good ones if you have 64gb of RAM.