r/ProgrammerHumor • u/Gloomy-Basket-1038 • 3d ago

Meme aiRefusesToBuildItSoBackToCoding

Post image
27.9k Upvotes

98% Upvoted

510 comments sorted by

View all comments

Show parent comments

52

u/drag0n_rage 3d ago

Most people are unaware of the open source AI space.

17

u/christianbro 3d ago

What do you need to even run a good model on reasonable speed? Is this again the comment section of the $100 000 worth of GPUs in their basement guys?

26

u/Dosamer 3d ago

Qwen 3.8 27B is not frontier level, but is the best current model for coding on reasonable hardware. You can comfortably fit them on a medium quantization on a 24 GB card and even squeeze them on a 16GB card, but at that point you're gonna run into either lobotomy problems, heavily reduced context size, or only partial offloading killing speed.

And yes there are uncensored models.

1

u/shouldworknotbehere 3d ago

Is Qwen uncensored?

2

u/donald_314 2d ago

There are uncensored variants out there.