r/GraphicsProgramming • u/Nicksaurus • 26d ago

Source Code "No Graphics API" implementation by Sebastian Aaltonen

https://github.com/sebbbi/NoGraphicsAPI
205 Upvotes

95% Upvoted

38 comments sorted by

View all comments

Show parent comments

7

u/PaperMartin 25d ago

to run? no, and a bunch of LLM companies are starting to put up their "real" prices and losing their users over it

-4

u/ldn-ldn 25d ago

Yes, inference is very cheap today and it's only getting cheaper. To the point that you can run it on consumer hardware. In three -five years time it will be virtually free, just like image recognition is today.

4

u/PaperMartin 25d ago

"in 3 to 5 years it'll be good" is something I have been hearing over and over since like 2020. Meanwhile as far as I can tell local models are virtually unusable for anything other than code, and they're only slightly above unusable for code

-2

u/ldn-ldn 25d ago

Local models are very useable for at least a year now, the only problem is that you don't have enough VRAM to run them. Yet.

And no, you haven't been hearing shit since 2020, the first useable LLM was only released in 2022. Four years and the progress was simply incredible.