RegularJoe@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoNvidia delivers first Vera Rubin AI GPU samples to customers — 88-core Vera CPU paired with Rubin GPUs with 288 GB of HBM4 memory apiecewww.tomshardware.comexternal-linkmessage-square14fedilinkarrow-up171arrow-down113
arrow-up158arrow-down1external-linkNvidia delivers first Vera Rubin AI GPU samples to customers — 88-core Vera CPU paired with Rubin GPUs with 288 GB of HBM4 memory apiecewww.tomshardware.comRegularJoe@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square14fedilink
minus-squarepanda_abyss@lemmy.calinkfedilinkEnglisharrow-up1·2 days agoYeah they’re going to cost as much as a house. I think we’ll see much larger active portions of larger MOEs, and larger context windows, which would be useful. The non LLM models I run would benefit a lot from this, but I don’t know of I’ll ever be able to justify the cost of how much they’ll be.
Yeah they’re going to cost as much as a house.
I think we’ll see much larger active portions of larger MOEs, and larger context windows, which would be useful.
The non LLM models I run would benefit a lot from this, but I don’t know of I’ll ever be able to justify the cost of how much they’ll be.