• it_depends_man@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    21 hours ago

    If LLMs can’t be made more power efficient, then the technology isn’t ready yet for general use.

    Hm, I don’t see the harm in powering local models with solar.

    • floofloof@lemmy.ca
      link
      fedilink
      English
      arrow-up
      1
      ·
      16 hours ago

      Well that is an alternative. But I bet each query to a local 27b model takes less energy anyway than the same query to Claude Opus or Fable in some data centre. So it is also a case of improving energy efficiency by running smaller models.