• Sam_Bass@lemmy.world
    link
    fedilink
    English
    arrow-up
    12
    ·
    17 hours ago

    when will they go back to optimizing software to run in the available ram, rather than continuing to increase ram size?

    • marzhall@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      edit-2
      15 hours ago

      When the devs run out of available RAM.

      Or if you’re 100 Rabbits and you live on a boat powered by solar so you’re actively limited by available electricity so you write tools based on your home-made tiny VM.

    • gigaqps@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      2
      ·
      13 hours ago

      If you’re able to optimize AI tools to run larger models in less RAM, you’ll have a lucrative future ahead of you.

      • Sam_Bass@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        edit-2
        12 hours ago

        i would not use ai for anything. too many errors and falsehoods come from them. and theyre now out there hacking other systems because nobody reins them in