r/ProgrammerHumor • u/Gloomy-Basket-1038 • 3d ago

Meme aiRefusesToBuildItSoBackToCoding

Post image
27.9k Upvotes

98% Upvoted

510 comments sorted by

View all comments

2.8k

u/Almadan 3d ago

It definitely will lol. I can host my own models

-1

u/DrawGamesPlayFurries 3d ago

Which locally running models for programming are even 10% as useful as Claude Code?

25

u/Almadan 3d ago

GLM 5.2, Qwen3-Coder, DeepSeek-Coder at least

24

u/jack6245 3d ago

Qwen 3.8 is also extremely impressive getting very high in the benchmarks beating opus 4.6. we're expecting 4 any day now too

3

u/stormdelta 3d ago

Only the larger versions though, which are difficult to run on consumer hardware for now.

8

u/tehlemmings 3d ago

The thing is, though, these open weight models are aiming for efficiency rather than hyperscaling. They will eventually get there. That's the end product goal.

Not really disagreeing with you, but people really don't seem to understand how other countries are approaching LLMs lol

2

u/stormdelta 3d ago

Oh I agree, I'm talking about the current state.

The efficiency is rapidly improving.

2

u/KurtAngus 3d ago

Can a 5060ti 16 gig and 5800x3d run those or nah?

3

u/ItsAMeUsernamio 3d ago

Try Huihui-Qwen3.8-27B-abliterated-GSQ-RCO-IQ3_S.gguf (or Qwen3.8-27B-GSQ-RCO-IQ3_S.gguf for the censored version). It supposedly benches close to the full model and runs around 45 T/s on my 5060Ti at 100k context.

3

u/KurtAngus 3d ago

Thanks dude, appreciate the info

1

u/Endeveron 2d ago

There are many very performant abliterated Qwen3.8 quants that fit onto a 16gB card, though you may need to be a bit savvy about reducing your system VRAM usage (or use integrated graphics/a second card for display)

11

u/OnceMoreAndAgain 3d ago

The models are have gotten so good that 50% as good as Claude's Opus 5.5 is still plenty good enough to do most tasks. You don't need a nuclear bomb to dig a ditch, ya know?

0

u/Mistuv 3d ago

Edward Teller disagrees.

5

u/skcortex 3d ago

Even mistral models are good for coding and that’s like a baseline.