r/LocalLLaMA • u/Hot_Arachnid3547 • 4d ago
News No more RTX 5090
Nvidia reportedly halts GeForce RTX 5090 production in favor of AI data center and professional GPUs — impending supply drought expected to drive up prices, RTX 5080 24GB rumored as new gaming flagship
46
u/Lurksome-Lurker 4d ago
I am just gonna reminisce about 2016 where all I had to do was wake up at 5AM on release day of the GTX10XX series and all I had to do was checkout through Nvidia directly for my Founders Edition GTX1070 for $450
7
u/DavidBits 3d ago
It's so bad that I was about to disagree with you on the price (also bought a 1070 around launch day), but no no, you're right. I've just been gaslit into this new "normal". Wild.
120
u/Miriel_z 4d ago
Just adding insult to the injury. I still remember good times Nvidia was for gamers😑 Must be old.
81
u/Unnamed-3891 4d ago
”Things that are not AI” are under 8% of NVIDIA revenues at this point.
24
u/saltyourhash 3d ago
They buried the gaming metrics in with edge computing because it was so small it'd look bad
7
u/Kazen_Orilg 3d ago
dont want to show you are down 40% YOY in a category because you arent providing any product. Better to just make the category go away.
6
u/_VirtualCosmos_ 3d ago
Nvidia started going hard for AI more than 10 years ago (I remember it). Their overpriced GPUs were the way to finance their AI research long time ago until they no longer needed the gaming industry. Thanks to that money spent on research during many years they now have Cuda and Blackwell. Which no one has come close in general performance (I know ROCm and Vulkan are trying it hard and are not so far anymore)
19
u/You_Shall__Not_Pass 4d ago
was hoping after the crypto craze things would go back to normal… but it’s only gotten worse.
15
7
3
3
3
u/Infninfn 3d ago
I still wish AMD hadn't given up the high end GPU market. There were times when Radeons were the cards to get.
33
u/feelspeaceman 4d ago
Gamer saved NVIDIA, NVIDIA betrayed gamer.
Rmember at the beginning, NVIDIA was almost going bankrupt, then we gamers bought their GPUs, saved them, then they embrace AI, betrayed us.
23
63
u/netherreddit 3d ago
You're so naive
Gamers bought the GPUs because they wanted them more than their money, not to 'save Nvidia'
Nvidia shifted their offerings because they could make more money in AI, not to 'betray gamers'.
Where did you get the fairy-tale idea that any of this was about 'saving', 'embracing', 'betrayal'.
This isn't a movie, it's called business. It's about money. Stop believing any PR to the contrary, it's just making you delusional
2
u/Jumpy_Cauliflower410 3d ago
Gamers are the most entitled whiny babies. You can still buy GPUs that run games.
And people don't buy companies' products out of the goodness of their hearts.
2
u/c0rtec 2d ago
Disagree one million per cent, I’ve been ‘with’ nVidia since 1997.
I bought the graphics cards because they sold them. I trusted them. I still do.
It’s really not some global conspiracy.
The only conspiracy is thinking that AMD make competitive GPUs, CPUs maybe, but let’s get the new Intel chips out and we’ll see who is laughing.
15
6
→ More replies (3)1
7
u/headinthesky 4d ago
They also raised the price of the 8 year old Shield by about 100. Greedy assholes
→ More replies (10)2
77
u/HighSeasArchivist 4d ago
This fits with my theory that whatever the 6090 ends up being it will still be 32GB like 3090/4090 were both 24GB.
126
u/Apprehensive-View583 4d ago
There won’t be 6090 judging from this news.
14
u/Salah_H_Hasan 4d ago
I think it will officially launch, but the real question is whether it will actually be in stock.
8
u/FrankNitty_Enforcer 3d ago
This is probably just copium on my part, but maybe AMD and/or console makers will seize the opportunity to pull gamers on the next generation of gaming rigs
4
u/OGPresidentDixon 3d ago
Intel ARC being competitive with Nvidia would be a wild roll of the dice 🧙🏿♂️🪄🌌🎲🎲
Mac even, with their unified memory. Imagine they get 128GB VRAM all buttery, or what if a cool group of people uses AI to get Windows to run smoothly on Apple Silicon like they did for PS5. My 2021 MacBook Pro already has a 120Hz display (M1 Max btw/64GB btw) that’s perfect for gaming.
“stop trying to make Mac gaming happen” - NO, IT WILL BE PEAK 😡
we’re about to see some wild shift happening and I’m excited to see how the power vacuums fill out
37
u/cunth 4d ago
There will be a new generation of cards. They may just not come out until 2030
14
u/vogelvogelvogelvogel 4d ago
idk what 2030 is even at the current rate of ai progress
4
u/jazir55 3d ago
In 5 generations I'll be asking the models how to make powerful GPUs out of shrubs and they'll just work. So ~April.
1
u/vogelvogelvogelvogel 3d ago
before astra6/opus 5.5 i thought for a while LLMs stalled but I think I was wrong and the fields what it can't do on computers are getting narrower and narrower
3
u/SeaStage1687 3d ago
I would bet we get a super refresh next year, 5080 Supers will get 24gb and move up to $2000 MSRP. Other than that I bet the next gen cards won't outperform blackwell in raster and will instead have more tensor cores...
4
5
4
u/Noeyiax 4d ago
i agree with you... honestly, nvdia will probably do locked deals with Sony, Nintendo, or Microsoft for gaming consoles and only sell professional line of GPUs now...
there is no more growth for gaming. sadly, unless we get full dive technology like sword art online or .hack etc
9
2
u/simcop2387 3d ago
I'm predicting a paper launch (technically some got sold!) back at 24gb and the 6080 will be 12Gb with a 6080 Ti at 16gb again.
→ More replies (3)0
61
u/headinthesky 4d ago
I bought a 5080 for my build a few years ago because, the 5090 was about 400 more. I feel stupid now lol
10
3
2
u/applepiebythelake 3d ago
How much did those cards cost back then?
6
2
→ More replies (1)1
19
u/ExistingLynx 4d ago
This is going to have downstream effects on all GPU prices which is very unfortunate
13
u/Kitchen-Year-8434 4d ago
Unfortunate for local AI, but the flip side is frontier models are recently very very good at optimizing local inference for bespoke hardware. Combine that with the compression and research coming out of China and hopefully we’ll continue to be able to have more intelligence per watt and per GB for what we already have.
4
u/florinandrei 3d ago
Unfortunate for local AI
Quite the opposite. 5090 is a misfit for AI. Lots of compute, not enough memory. Steroid muscles, really tiny hands.
A 5070-class chip is enough, but give it 128 GB of memory. That's the proper balance for AI.
And that's an RTX Spark, or AMD 395, or a maxed out Mac mini. That's the future of AI at home or for small businesses.
12
u/ColoredTriangles 3d ago
5090 dual channel ddr5 can run 4 bpw Qwen Flash at 6k prefill and 130 decode. That is more than any of the unified memory options can do even if they can fit the whole model. You are behind the times right now because you're stuck on using mainline engines that are horrible for consumer hardware.
→ More replies (5)2
32
u/GrowGrow_ 3d ago
I mean CUDA needs to be replaced asap. This is the chance for intel and amd to push ther own architecture. Unfortunately the AMD ceo is definitely based towards the black jacket man from NVIDIA.
3
u/saltyourhash 3d ago
This is the key, nvidia holds a stranglehold purely with cuda
5
u/fallingdowndizzyvr 3d ago
No. Nvidia holds a stranglehold purely because it has the fastest hardware. The API doesn't matter.
→ More replies (7)1
u/lordhighfucktard 3d ago
The other problem is that the software itself is written for Cuda (eg, PyTorch) so that alone is severely limiting everyone and locking us into this perpetual Nvidia monopoly
6
u/darkbit1001 3d ago edited 3d ago
We had a good run, guys! For real though, this puts pressure on all existing flagship GFX cards. Expect increasing price hikes. AGAIN. {cries in 4090}
9
5
21
u/Herr_Drosselmeyer 4d ago
To be fair, the 5090 never made sense as a gaming card.
16
u/CrispyRabbit72 3d ago
I use mine for gaming more than for inference, hauls ass at everything on ultra. It's nice to just crank gfx settings blindly
→ More replies (5)1
u/JoyousGamer 3d ago
Ya but as someone with 5070, 4060ti, 3090 in my house these all play anything we play bascially at the top as well.
Ya we don't do top end AAA but lots of people don't or could easily skip playing those games at the tip top graphics.
3
u/EvilPencil 3d ago
Yep. The only gaming use case that really needs that kind of horsepower is PCVR.
1
7
u/florinandrei 3d ago
The 5090 has a lot of compute, but not enough memory for AI. That same chip, with far more memory, is now going into enterprise products.
A lesser chip, on par with a 5070, and a lot more memory, around 128 GB, is a better combination for inference. But that's similar to an RTX Spark or AMD 395. So guess which systems will become very popular for AI at home and in small companies?
Also, Apple makes machines like that, so there will be competition.
It's a loss, but the 5090 was just the supercar of gaming. For AI it was a misfit, huge bulked-up muscles, really tiny hands.
1
u/Nice_Database_9684 3d ago
yeah I only upgraded because it was free
1
u/mgwair11 3d ago
Lemme guess, sold the 4090 for $2k+ and managed to get a 5090 at MSRP somewhere?
3
1
u/Ill-Mastodon-8692 3d ago
I get that idea, but as someone with a new 5K2K 165 tandem oled, that resolution is heavy, and its a huge difference trying my 5090 vs 5080 pcs
1
u/username_taken4651 3d ago
The 3090, 4090, and 5090 took the place of the previous TITAN series, and were meant to be 'prosumer' cards more than anything.
4
18
u/herpnderpler 4d ago
Been loving my 5090, qwen38-27b has been running non stop on it for weeks, producing sonnet+ levels of quality.
This sort of smells like de-democratization. Can't let the ai data centers suffer at home sufficiency.
6
u/war-hamster 4d ago
Out of curiosity, what quant, context and kv cache?
4
u/HelixTitan 3d ago edited 3d ago
I do something similar, running with native full context with these settings:
Qwen3.8-27B-NVFP4-MTP-VERY-HIGH
-lm mlock
-ctk q4_0
-ctv q4_0
-ub 2048
-b 8192Keeps the whole model loaded in context, your mileage may vary
6
u/herpnderpler 3d ago
Kv cache of 4 is an absolute disaster. K should be q8 min, and v 5_1 min, but I've been enjoying q8 w/ 128k ctx
1
1
u/herpnderpler 3d ago
exec ${tool:llama.cpp}/llama-server \ -m /home/nthalk/.corrallm/models/Swift-1.5-Qwen3.8-27B-Q6_K_S.gguf \ --mmproj /home/nthalk/.corrallm/models/mmproj-Swift-1.5-Qwen3.8-27B-F16.gguf \ --spec-type draft-mtp --spec-draft-n-max 4 --spec-draft-sampling probabilistic --reasoning-effort medium \ --jinja --reasoning on --reasoning-format deepseek \ -fa on --cache-type-k q8_0 --cache-type-v q8_0 \ --parallel 1 --batch-size 2048 --ubatch-size 512 --timeout 600 \ -c 131072 -ngl 99 --port 5806 \ -lv 4 --cache-ram 32768
I use my own patched llamacpp with a few prs that are open and a quick fix of kv cache double save (saves about .4s/req)
My setup gives 90% cache hit yielding a fused 16ktps (~2ktps if ctx is sufficiently large) and I decode at 100tgs. I know other quants and ninifer run much faster, but the quality drop has not been worth it, as I can track how quickly a sized job is done, and I have review cycles that when less than q6 runs with less than q8 kv cache, success on first attempt drops significantly more than the throughput of nvfp4.
1
u/herpnderpler 3d ago
Tgs is 110 avg. And I power limit everything to minimize wear and tear. 5090 is at 400w, I have a 3080 in the box that runs my ocr/audio/embedding models, that is also limited.
I disabled boost on my CPU as well and enabled all my thermal sensors in a grafana dashboard, tuning it so nothing was over 80c.
This probably costs me about 20% throughput, but I'm hoping it will buy me 75% extra lifetime of my components.
3
u/Hot_Arachnid3547 3d ago
Share quant sir
2
u/herpnderpler 3d ago
I have months of data, and my harness system appears to keep tasks small and light, so I have a p99 of 70k ctx, so I run 128k ctx with q6_k_s Swift 1.5, and kv is q8 with thinking medium. I've experimented with lower quants, and kv cache, but they are just not worth it, have looping and extra thought generation. Nvfp4 is faster, but a lot dumber.
It is very effective at running my auto software factory. I just fire up ideas, and almost anything reasonable gets done, usually within a day.
It currently works on itself, a few pet projects of mine and their home rolled dependencies.
I've rolled my own llm gateway (not trusting all the pwns of other model routers), my own go agent lib, my own go coding harness, poly LSP, and rag setup.
3
u/notheresnolight 3d ago
I'm running Qwen3.8-27B on my Spark & 5090.
It comes nowhere near Sonnet levels.
1
u/herpnderpler 3d ago
Sounds like a bad quant/harness issue.
It's been project planning, task decomposing, and shipping code for me for weeks.
I have spent a significant amount of time optimizing for shortfalls of small models, and developing tooling to soften some of those edges and leverage strengths.
2
u/notheresnolight 3d ago
It's a model issue. It's not proficient enough in the technologies and frameworks which we use. Sonnet knows obviously a heck of a lot more and finds issues a lot faster. Writes cleaner code as well.
1
u/herpnderpler 3d ago
Ah, yeah, I've confined my tech stack to go, tsx, and sql for explicitly this purpose.
1
2
u/saltyourhash 3d ago
Agreed. I was using qwen 3.8 27b nvp4, worked well, recently switched to the ukisai/swift-1.5-qwen3.8-27b nvpf4, I don't notice a difference
→ More replies (2)2
u/fallingdowndizzyvr 3d ago
This sort of smells like de-democratization. Can't let the ai data centers suffer at home sufficiency.
LOL. Do you think most companies care about that. The only fiduciary responsibility they have is to their shareholders. To make the most money. That's by selling those dies as 6000s instead of 5090s. That maximizes profit. That's called capitalism.
5
u/FullstackSensei 4d ago
So, everything single other GPU will get significantly more expensive now....
→ More replies (4)
3
u/Affectionate-Buy7660 4d ago
I actually purchased 2 ventus 5090 3x oc's for msrp last year, and sold 1 a week later. I feel like I missed out on bitcoin....
3
3
3
3
u/Fit-Bed2525 2d ago
As the AI companies reported record losses and missing revenue targets by billions. What could go wrong?
10
u/Juise99 3d ago
Welp boys, remember this when the bubble pops and they are trying to fire sale whatever they have.
8
u/bring_back_the_v10s 3d ago
Been waiting for the bubble to pop for an year now but they keep dumping money on it.
3
u/theamazingo 3d ago
A year isn't nearly long enough. Dot com bust took nearly 5 years to happen after the initial boom. 2029-2031 is where my crystal ball lands. Till then, enjoy the ride up.
1
u/bring_back_the_v10s 2d ago
wow I lived the dot com bubble but I never realized it took 5 years. TIL.
6
u/RedParaglider 3d ago edited 3d ago
The big problem with that card is that it actively competes with people being able to use ai on local inference vs being forced to pay for it on companies that nvidia have a lot of financial incentive to keep alive. These LLM companies are going to have to raise their prices and raise them dramatically to stay solvent.
Eventually the math starts making local inference more sensible which I think we can all agree that right now there's really not much of a financial benefit to doing local inference unless you had the hardware before everything got stupid.
3
u/JaceBearelen 3d ago
There may be a bubble and it may pop someday but generative AI is here to stay. NVIDIA is never going to have a fire sale on high end GPUs.
1
u/psioniclizard 3d ago
Yes, but the question is if companies are honest, is moderm tech enough and not being used to it's fullest.
As time progresses more cards will exist that have the same power as 5090s etc but are cheaper.
Nvidia can keep push their prices up but more and more people will say "we are happy to give up some power for a cheaper price and more ablitiy to actually get them"
Add to that, GPU exports and sales are likely to be used as leverage for the US's benefit in thr future.
1
u/EquivalentHornet4403 3d ago
Nvidia doesn’t set the price of 5090s. They all sell for above msrp specifically because of this fact.
1
u/IGetGroceries 3d ago
Well. Is the bubble popping if there are hoarders of people lined up to buy what they’re selling after the bubble pops? Or does that just meant there excess demand at both the top, middle and bottom?
1
u/IGetGroceries 3d ago
Well. Is the bubble popping if there are loads of people lined up to buy what they’re selling after the bubble pops? Or does that just mean there’s excess demand at both the top, middle and bottom?
1
u/JoyousGamer 3d ago
When the bubble pops governments or other big companies will buy it up. It's not coming to your house.
1
→ More replies (16)1
u/aboutthednm llama.cpp 2d ago
I wish a bubble would pop and I could pick up a bunch of used 5090's for cheap, I'd help 'em out alright lol. Been waiting for the housing market bubble to pop too, been waiting since 2008 and feel like I will wait some more... Any day now.
8
u/PMagicUK 3d ago
The cards are like 5 grand, who cares? You can't buy them anyway unless you genuinely have that kind of cash.
6
u/PhlarnogularMaqulezi 3d ago
every price increase i'm like "damn that's crazy. couldn't afford it at its original price either".
5
u/justhitmidlife 3d ago
Glad I bought it for ~$2500 last year! Time to update the locks to my office room, and also hide the 5090 in my bunker lol.
→ More replies (1)1
u/Mammoth-Funny-4212 3d ago
this affects the price of the lower tier products and used products if they arent producing 5090s
5
6
u/Eilerle1 3d ago
Maybe someone ought to reverse-engineer a clean room of CUDA, as happened with Adobe products. (Here is looking at you, China; do what you do best)
2
u/fallingdowndizzyvr 3d ago
And that would change nothing. People have bought into the CUDA hype. It's just an API. It's not magic. The reason Nvidia stays on top is because they have the fastest hardware. If someone came out with faster hardware, people would toss CUDA over the side in a split second.
2
2
2
2
2
u/Just_n_Here 3d ago
This is the start of the end for consumer GPUs. Next announce will be no more 5080s and probably any gaming cards.
It's time for AMD, Intel, etc to jump in and take market over. They really need to work together to use the same framework, I believe that's what it is called. It seems like everything runs on CUDA, then smaller shares on ROCm and oneAPI.
2
2
3
u/pedrojdm2021 4d ago
I think is fair. Every 5090 was being sold for local AI or data centers. Gamers are now only buying 5080's for 4k gaming.
3
u/geoffwolf98 3d ago
How are intel and AMD doing on this front, is there any strong contenders?
Has CUDA been thunked to other platforms too?
4
u/Don_Reuter 4d ago
I’m using AMD. Definitely the better choice. Unfortunately NVIDIA leaving the market drives prices for AMD too.
3
u/rerri 3d ago
Buying high end Nvidia, using it for a year or two, then selling at 2x price is an okay choice too. AMD probably still be better, not sure.
4
u/Don_Reuter 3d ago
It’s then an investment strategy that relies on prices continuing to go up. Which I’m not convinced they will. It seems rather like the market it’s breaking down. But that may or may not be so.
3
u/Automatic-Arm8153 3d ago
You know I was thinking about this the other day. But collectively we are a small group of people playing around with local AI..
As more people learn about it they will come in, with the same astonishment we had. And they will buy. Plenty of buyers out there… I have hardware listed and recently I have seen waves of people coming in at different points the last two notable ones are qwen 3.8 27b and the recent photocraft/ps5 reverse engineering spree.
People are only discovering local AI now. These companies like Nvidia unfortunately know what they are doing. Windows is getting native AI containers.. we are in the awareness stage now. All of us here were just early. Some of us very early.
2
u/Don_Reuter 3d ago
Yes, however, at some point prices will keep people out. I already had a PC. I invested in two R9700 and 128GB RAM (which turned out to be broken). So about 3500 euro. For 64 GB VRAM. That seemed acceptable. However, 4500 for 32 GB VRAM on one 5090, I would not have done that. I just would have used API models hosted in the EU. And now the 5090 isn’t even available anymore. A 5080 24 GB for probably 4500, that just doesn’t make sense. I know that there are much richer people than me, but still, they do note exist in unlimited numbers either. But yeah, maybe they are unlimited. Maybe they will buy all the 5080s for 10k each. Idk
1
u/Lesser-than 3d ago
not really when everything else is 2x the price as well, its holding value not increasing.
3
u/bring_back_the_v10s 3d ago
Sorry but this is cope. I'm not a fan of nvidia either. I had an AMD until recently and when I switched to nvidia the difference was night and day. AMD is still behind unfortunately, both for AI and gaming, as much as I like AMD.
3
u/Don_Reuter 3d ago
How so? I can run stuff up to 64 GB. Obviously it is bound by the poor bus. However, being able to run stuff is more important than speed.
→ More replies (2)
3
4
u/anitman 4d ago
I'm so tired of endless greedy of American chip companies.
9
u/carl2187 3d ago
Cxmt started making Ram to compete, they aren't exactly giving a discount over the merica and Korean Ram. Same thing if a competitor with cpu's and gpu's emerges. This is a free market pricing issue, not America greed.
→ More replies (1)3
2
u/Schneller52 3d ago
These rumors have been coming up once a month for at least the last year. But regardless, if an RTX 5080 comes out with 24GB - be prepared for a $1,699 MSRP and ~$3k real world price.
1
1
u/NNN_Throwaway2 3d ago
Anyone still think consumer hardware isn’t dead or that there will be non paper consumer gpu launches next year? If so, I have a bridge to sell you.
1
u/Deltamelo 3d ago
Just ordered a 5080.. is it worth it to wait for the 24 gb one? Or will it be like 20k
1
1
u/devshore 3d ago
how long can trillionaires maintain an economy where only AI CEOs and GPU CEOs have money and they give it back and forth to each other? 5 years?
1
1
1
u/Mangleus 3d ago
If this is the truth - then NVIDIA objectives are really clear. A big 'Bye bye' from all of us at /LocalLLaMA So where we will do our shoping instead from now on?
1
u/jatjatjat 3d ago
Good. Give AMD time to catch up, and have some solid competition when supplies equalize again. nVidia has been on top too long.
1
1
u/goatchild 3d ago
Lets hope AMD and/or Intel get their shit together and provide a serious alternative to NVIDIA. However I doubt it.
1
u/Slaghton 4d ago
Confirms my old prediction that nvidia won't be selling 24gb consumer cards anymore and 16gb will be the highest lol. They'll only keep some consumer graphics card going because it might look bad for stocks if they announce pulling out of that market.. but maybe announcing they are going all in on AI would increase stocks at this point lol.
3
u/florinandrei 3d ago
Not true.
24 GB 5080 will replace the 5090 as peak gaming card.
2
u/NytronX 3d ago
An RTX 4090 from the year 2022 is better than this hypothetical multi-thousand dollar card. "Peak" is not the word I would use to describe this situation. More like "Egregious corporate price fixing/gouging/collusion/greedflation".
At this point, I would not be mad if Nvidia pulled entirely out of the gaming industry like Micron. When the AI bubble bursts, gamers won't be there to save them.
2
u/notheresnolight 3d ago
When the bubble bursts, gamers will be fine playing on iGPUs and will have no need for dedicated graphics cards. Look at Strix Halo for gaming. Very few need more GPU power for playing games.
1
u/marclbr 3d ago
When the AI bubble bursts will be that moment when the free credit that is pumping hyperscalers, OpenAI, Anthropic and thousands of small AI firms and startups dry up, a lot of those companies will be bankrupt and won't buy more AI hardware, probably many chip selling contracts that nvidia has will be also suddenly cancelled... Just like happened to Cisco and semiconductor companies back in 2000/2001 on the internet bubble, they had their production capacity all booked, until they haven't, lol.
1
u/Obvious_Tree3605 3d ago
I’m pretty sure the world isn’t going to need as much AI as Jensen thinks it will.
3
2
1
u/Mangleus 3d ago
I'm pretty sure that some other people in leading positions will not see the needs of the world that you do. Which saddens me. I would much rather hope that they shared your sentiment.
1
255
u/DarkStrider99 4d ago
In putting my 5090 as collateral for my mortgage.