Locally run AI should be the standard. All you have to do is download a .gguf file from hugging face (around 8 gig) and load it into Koboldcpp’s GUI… Or AnythingLLM if Kobolcpp is too technical for you.
Some models run faster, others run slower (depending on hardware, model size, and structure). Models like LFM2.5 for instance runs pretty fast because it’s more like 3 small models cowriting responses.
But chatgpt actually sucks though, its one of the worse ones.
If you invest today it will be better in the future. It will be so good that we will be Star Trek soon. Invest today.
Hmm, I don’t know. Maybe I’d be more convinced if the machine god will be evil unless you get 10 trillion dollars.
When deepseek came out I never looked back.
Open source should be the standard for supposedly world ending technology.
Locally run AI should be the standard. All you have to do is download a .gguf file from hugging face (around 8 gig) and load it into Koboldcpp’s GUI… Or AnythingLLM if Kobolcpp is too technical for you.
Some models run faster, others run slower (depending on hardware, model size, and structure). Models like LFM2.5 for instance runs pretty fast because it’s more like 3 small models cowriting responses.