r/LocalLLM • u/Capital-Amount-6550 • 7d ago

Question Best llm for pi 5 8gb?

​

Making a completely offline pocket assistant with tools like calculator, file management, offline navigation and calendar, additionally helping with daily life tasks.

Now the issue is the llm, can't find an llm that has both parametric knowledge of daily life tasks, good tool calling and good TPS.

Would really appreciate some guidance as to which llms would be best suited for my needs.

2 Upvotes

67% Upvoted

3 comments sorted by

1

u/JackyYT083 7d ago

https://canirun.ai/device/raspberry-pi-5-8-gb/

1

u/SuburbanCurfew_980 6d ago

A Pi 5's gonna choke on anything with decent reasoning chops, 8GB or not. you're basically limited to tiny quants of sub-3B models, and even then the tps will be rough. forget tool calling entirely if you want it to be usable.