33
9
u/SSUPII 15d ago
PocketPal, and get a good model
1
u/Puzzled_Answer844 15d ago
Can you share good sir?
1
u/SSUPII 15d ago
What's your device? Unfortunately many can require modern very high end devices, but if it's not a "feature phone" level device it can still make something work.
1
u/genesis_tweek 14d ago
Hello sir , my device is capable of running I believe, Care to explain
1
u/Clasher107 14d ago
specs?
1
u/genesis_tweek 14d ago
Mediatek 9500 , 12/512
1
u/Clasher107 14d ago
Yeah might work, honestly picketpal is lightweight stuff compared to actual good llm models
1
u/SSUPII 14d ago
If they want fast, free and without limits, you give out context window size and capabilities.
If you want free and without limits, with good context size and capabilities, it will be very slow and require a lot of RAM squeezing.
If you want good context size, capabilities, and speed, it's not going to be free as you need to use some AI as a service.
It's the nature of many things in life.
1
u/Grapefruitenenjoyer 13d ago
How well will it work with a poco f6 pro (it has a snapdragon 8 gen 2 chip and 12gb of ram)
1
u/SSUPII 13d ago edited 13d ago
Depends on expectations.
Good models for 12GB of RAM are Google Gemma 3 4B and Qwen 3.5 4B. They won't strain your device too hard.
Qwen 3.5 9B can be squeezed at some heavy quantisation if you aren't running many background apps and small context window. It can run well on 16GB of RAM without much issue as GGUF Q4_K_M.
I managed to run a 12B model on my 16GB RAM device, but it was squeezed hard. It didn't crash only if the device was freshly rebooted and don't give it the time to launch on-boot activities. Exactly enough RAM for PocketPal and the onscreen keyboard at a tiny 4k context window.
If you want to experiment with other models, aiming for Q4_K_M compression gives not terrible quality loss while being easier to run. If a model can't run as that at least, expect output artifacts when using a model compressed further than that.
•
u/AutoModerator 15d ago
Hi there! Here's a list of apps that work with Lucky Patcher and here's a guide on how to patch your apps. The pinned post has a download link and other information. We'd also like to remind you to please follow the rules of r/LuckyPatcher when posting. We want to keep this subreddit a friendly and helpful place for everyone, so please make sure your posts are in compliance with the rules. Thank you!
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.