vegeta@lemmy.world to Technology@lemmy.worldEnglish · 5 months agoDeepSeek's AI breakthrough bypasses industry-standard CUDA, uses assembly-like PTX programming insteadwww.tomshardware.comexternal-linkmessage-square9fedilinkarrow-up1195arrow-down15
arrow-up1190arrow-down1external-linkDeepSeek's AI breakthrough bypasses industry-standard CUDA, uses assembly-like PTX programming insteadwww.tomshardware.comvegeta@lemmy.world to Technology@lemmy.worldEnglish · 5 months agomessage-square9fedilink
minus-squarefilister@lemmy.worldlinkfedilinkEnglisharrow-up32arrow-down2·5 months agoWhat is amazing in this case is that they achieved spending a fraction of the inference cost that OpenAI is paying. Plus they are a lot cheaper too. But I am pretty sure that the American government will ban them in no time, citing national security concerns, etc. Nevertheless, I think we need more open source models. Not to mention that NVIDIA also needs to be brought to earth.
What is amazing in this case is that they achieved spending a fraction of the inference cost that OpenAI is paying.
Plus they are a lot cheaper too. But I am pretty sure that the American government will ban them in no time, citing national security concerns, etc.
Nevertheless, I think we need more open source models.
Not to mention that NVIDIA also needs to be brought to earth.