I got 32 additional GB of ram at a low, low cost from someone. What can I actually do with it?

  • zkfcfbzr@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    2 months ago

    I have 16 GB of RAM and recently tried running local LLM models. Turns out my RAM is a bigger limiting factor than my GPU.

    And, yeah, docker’s always taking up 3-4 GB.

  • Jesus_666@lemmy.world
    link
    fedilink
    arrow-up
    9
    arrow-down
    1
    ·
    2 months ago

    Run a fairly large LLM on your CPU so you can get the finest of questionable problem solving at a speed fast enough to be workable but slow enough to be highly annoying.

    This has the added benefit of filling dozens of gigabytes of storage that you probably didn’t know what to do with anyway.

    • daggermoon@lemmy.worldOP
      link
      fedilink
      arrow-up
      5
      arrow-down
      1
      ·
      2 months ago

      I actually did. I deleted it as soon as I realized it wouldn’t tell me about the Tiananmen Square Massacre.

      • Dasus@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        2 months ago

        Oh, c’mon, I’m sure it told you all about how there’s nothing to tell. Insisted on that, most likely.

        • daggermoon@lemmy.worldOP
          link
          fedilink
          arrow-up
          3
          ·
          2 months ago

          Nah it said something along the lines of “I cannot answer that, I was created to be helpful and harmless”

          • Dasus@lemmy.world
            link
            fedilink
            arrow-up
            2
            ·
            2 months ago

            Answer that with “your answer implies that you know the answer and can give it but are refusing to because you’re being censored by the perpetrators” or some such.

            I made Gemini admit it lied to me and thus Google lied to me. I haven’t tried Deepseek.

      • Yerbouti@sh.itjust.works
        link
        fedilink
        arrow-up
        3
        ·
        2 months ago

        But the local version is not supposed to be censored…? I’ve asked it questions about human rights in China and got a fully detailed answer, very critical of the government, something that I could not get on the web version. Are you sure you were running it locally?

  • lordnikon@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    If you are on Linux and I guess windows but nor sure. You already use it for cache. So you can never have enough ram. As long as it’s the same speed of your existing ram or you will screw yourself in preformence.

  • eyeon@lemmy.world
    link
    fedilink
    arrow-up
    2
    ·
    2 months ago

    I used to have a batch file to create a ram disk and mirror my Diablo3 install to it. The game took a bit longer to start up but map load times were significantly shorter.

    I don’t know if any modern games would fit and have enough loads to really care…but you could

  • scarilog@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    2 months ago

    I built my PC recently and splurged to get about 100gb of ddr5, thinking it was going to be a waste of money.

    I couldn’t have been more wrong, there are occasionally times when I’m almost running out of memory. How? Multiple desktops, each with tons of programs and stuff open, including probably like several hundred Firefox tabs open at the worst of times.

    Basically, extra ram has allowed me to kinda postpone the responsibility of having the close programs, maintain cleanliness, etc. I still have to stay organised using desktops so I don’t go crazy with the number of things I have open, but I’m the limiting factor here, not my computer. And that’s a super liberating feeling.

    TL;DR: you can NEVER have too much ram.