(I know they’re not that much better but they’re so much more well supported in Linux it’s absurd. NVIDIA only started getting more support that was focused on AI, which is cool and all, local AI is all right, but no very useful in everyday context.)
*laughs in AMD
(I know they’re not that much better but they’re so much more well supported in Linux it’s absurd. NVIDIA only started getting more support that was focused on AI, which is cool and all, local AI is all right, but no very useful in everyday context.)
How’s the local LLM support on Linux with AMD?
(Yes I could google, but I think people here would give more realistic answers at a more reasonable tech skill level)
llama.cpp (and by extension Ollama) has a Vulkan backend now, which works fine for my usecases on AMD
I switched from Nvidia and Intel to Amd Amd for my newer PC. Couldn’t be happier. No issues. Better prices too.
AMD has software for both its processors and gpus. So nothing to trade off as far as I can tell.