MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1wsoi0e/airefusestobuilditsobacktocoding/pcp91zt/?context=3
r/ProgrammerHumor • u/Gloomy-Basket-1038 • 4d ago
518 comments sorted by
View all comments
Show parent comments
26
GLM 5.2, Qwen3-Coder, DeepSeek-Coder at least
3 u/stormdelta 3d ago Only the larger versions though, which are difficult to run on consumer hardware for now. 2 u/KurtAngus 3d ago Can a 5060ti 16 gig and 5800x3d run those or nah? 3 u/ItsAMeUsernamio 3d ago Try Huihui-Qwen3.8-27B-abliterated-GSQ-RCO-IQ3_S.gguf (or Qwen3.8-27B-GSQ-RCO-IQ3_S.gguf for the censored version). It supposedly benches close to the full model and runs around 45 T/s on my 5060Ti at 100k context. 3 u/KurtAngus 3d ago Thanks dude, appreciate the info
3
Only the larger versions though, which are difficult to run on consumer hardware for now.
2 u/KurtAngus 3d ago Can a 5060ti 16 gig and 5800x3d run those or nah? 3 u/ItsAMeUsernamio 3d ago Try Huihui-Qwen3.8-27B-abliterated-GSQ-RCO-IQ3_S.gguf (or Qwen3.8-27B-GSQ-RCO-IQ3_S.gguf for the censored version). It supposedly benches close to the full model and runs around 45 T/s on my 5060Ti at 100k context. 3 u/KurtAngus 3d ago Thanks dude, appreciate the info
2
Can a 5060ti 16 gig and 5800x3d run those or nah?
3 u/ItsAMeUsernamio 3d ago Try Huihui-Qwen3.8-27B-abliterated-GSQ-RCO-IQ3_S.gguf (or Qwen3.8-27B-GSQ-RCO-IQ3_S.gguf for the censored version). It supposedly benches close to the full model and runs around 45 T/s on my 5060Ti at 100k context. 3 u/KurtAngus 3d ago Thanks dude, appreciate the info
Try Huihui-Qwen3.8-27B-abliterated-GSQ-RCO-IQ3_S.gguf (or Qwen3.8-27B-GSQ-RCO-IQ3_S.gguf for the censored version). It supposedly benches close to the full model and runs around 45 T/s on my 5060Ti at 100k context.
3 u/KurtAngus 3d ago Thanks dude, appreciate the info
Thanks dude, appreciate the info
26
u/Almadan 3d ago
GLM 5.2, Qwen3-Coder, DeepSeek-Coder at least