Local LLMs are the way to go on AI, they can’t suddenly change the model up on you. And also, I guess Anthropic just wants their models to be more useless ahead of going public? Because I presume people that want to use AI, who don’t care where they send their data to, but don’t want to nagged about how they can’t do benign programming and analysis tasks, will just choose another model provider.
Uhm yeah good luck with running anything locally after hardware prices double again and again. Big tech needs to be stopped. There is no wiggling out of this just by being a smart customer.
The price did grow several times in size, but even in the 4 to 5 digit price range, you or smaller companies can have a pretty competitive performing open source model as the frontier models from earlier this year and they are keeping pace.
Obviously I’d like the speculation bubble to end and the DRAM and GPU cartels broken up, as it’s late-stage capitalism where the existing regulations being unenforced on big tech because the regulators are in on it that’s the problem, not so much the AI tech itself. (Don’t get me wrong, the tech has bad sides to it too like stealing artwork, data centre environmental impact and whatnot, but just speaking to the cause of the component greedflation).
Yes it’s disgustingly expensive. I spent a whole lot of money on an old used GPU and it felt bad, but it didn’t feel dirty like paying for Claude would. And then a couple of weeks later the used prices for this GPU had risen by about 15%.
(I only use Claude at work when someone else is paying. And they’re about to make me redundant because Claude is cheaper than me.)
Local LLMs are the way to go on AI, they can’t suddenly change the model up on you. And also, I guess Anthropic just wants their models to be more useless ahead of going public? Because I presume people that want to use AI, who don’t care where they send their data to, but don’t want to nagged about how they can’t do benign programming and analysis tasks, will just choose another model provider.
Uhm yeah good luck with running anything locally after hardware prices double again and again. Big tech needs to be stopped. There is no wiggling out of this just by being a smart customer.
Thing is, I already am…
The price did grow several times in size, but even in the 4 to 5 digit price range, you or smaller companies can have a pretty competitive performing open source model as the frontier models from earlier this year and they are keeping pace.
Obviously I’d like the speculation bubble to end and the DRAM and GPU cartels broken up, as it’s late-stage capitalism where the existing regulations being unenforced on big tech because the regulators are in on it that’s the problem, not so much the AI tech itself. (Don’t get me wrong, the tech has bad sides to it too like stealing artwork, data centre environmental impact and whatnot, but just speaking to the cause of the component greedflation).
Yes it’s disgustingly expensive. I spent a whole lot of money on an old used GPU and it felt bad, but it didn’t feel dirty like paying for Claude would. And then a couple of weeks later the used prices for this GPU had risen by about 15%.
(I only use Claude at work when someone else is paying. And they’re about to make me redundant because Claude is cheaper than me.)
They suck far too much at the moment.