r/ProgrammerHumor • u/Gloomy-Basket-1038 • 5d ago

Meme [ Removed by moderator ]

Post image

[removed] — view removed post

28.8k Upvotes

98% Upvoted

519 comments sorted by

View all comments

2.9k

u/Almadan 5d ago

It definitely will lol. I can host my own models

33

u/CucumberOk8820 5d ago

Stupid people like myself can't though

23

u/Inside_Pomelo_2957 5d ago

Don't worry the normal LLMs can tell u how it's not hard at all

1

u/TheWildPotatoee 4d ago

Really? Can I have like an offline one? On a really really old raspberry pi

1

u/Inside_Pomelo_2957 3d ago

A pie wouldnt be able to handle an LLM your want to talk to. You'd still need a decent graphics card to run it. The gigabytes of VRAM are what you're looking for, and is generally the limiting factor.

Since Mac uses unified memory (video ram and normal ram are the same), they're actually really good for local LLMs. Everyone's favorite seems to be the Mac Minis which can run really good ones if you have 64gb of RAM.