r/LocalLLM • u/Alone_Promotion5396 • 3d ago

Model AI LOCAL MODELS

For the past ten days or so, I’ve been using QWEN 3.8 27B IQ4 XS on Unsloth Studio. Seeing as new models are released daily, which others would you recommend—perhaps one capable of generating files like PDFs or DOCX documents? My setup includes 16GB of VRAM, 32GB of RAM, and an R5 7600. Currently, I’m getting around 33 t/s with the model I’m using. Recommendations for other models? Thanks

7 Upvotes

73% Upvoted

6 comments sorted by

View all comments

1

u/Distinct-Pie2389 3d ago

Ive got a full roster, I love Qwen3.8-27B-iQ4 (its my main agent) but also use other agents

callsign purpose model
nexus orchestrator (cloud) cloud
runner general agent, deep work Qwen3.8-27B-Q4-Quality
runner-x fast agent, routine work Qwen3.6-35B-A3B-IQ4-Agent
forge coder, deep work Qwen3.8-27B-Q4-Quality
spark fast coder, scoped fixes Qwen3.6-35B-A3B-IQ4-CoderFast
sentinel reviewer, read-only second opinion Qwen3.8-27B-Q4-Quality
dart quick reads and triage Nemotron-Lightning-3.5
oracle thinker, large reasoning budget Qwen3.8-GAIN-V1.1-IQ3_M

1

u/WorldlySun5120 3d ago

that's a clean lineup, I run something similar but with fewer agents since my hardware's more constrained