In a prior study, the researchers had found that users were increasingly turning to chatbots like ChatGPT to get advice on sensitive topics like health, finance, mental health, and employment, so much so that it was “now becoming more like a social partner than just a tool,” lead author Abhisek Dash said.

Building upon that finding, this time around they also looked into what kinds of sensitive information get stored by the chatbot and just how. They found that 52% of the memory entries contained information about users’ psychological states, including their desires, intentions, emotions, and beliefs.

  • minorkeys@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    8
    ·
    1 day ago

    Ideally it would be a personal assistant. In reality, it’s a corporate snitch, reporting everything back to the company who will know everything about how to manipulate you into giving up all the power and value of your life.

    • mad_lentil@lemmy.ca
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      1 day ago

      Yeah then just imagine what happens when the wrong sort of government asks for the keys to this dashboard.

      This technology must be opposed.

      • minorkeys@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        5
        ·
        edit-2
        1 day ago

        Yeah, what I’ve been saying since the early days of data collection. This is the most extreme version, so far. With neurolink, that’s going to be even more detailed version of knowing our minds. With that one, they don’t need to know each of us as individuals to learn what is common to all of us just from studying the brain data they get from a small group of people.

        We are things to them. Not people. Just things. Just a resource. Like trees or fish or cobalt. Treated no different. This stuff grants more control and deeper value extraction than they already have. These ppl are psychopaths and it’s infuriating watching people empower them further without zero concerns.

      • mad_lentil@lemmy.ca
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 day ago

        If we can’t be pedantic in the comments of an aggregated story where is there left!

      • Buffalox@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        1 day ago

        Did you even read the article?

        The AI memory then uses this to build a detailed profile of the user, a mechanism researchers in a study published earlier this year call “the algorithmic self-portrait.”

        Well technically it’s not even a portrait, it’s what is commonly known as a profile, which is also clearly stated first. And it’s definitely not a “self” profile either.
        It’s very Stupid language to use by the researchers.

        • JustAnotherKay@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          23 hours ago

          I would argue that if you’re being pedantic about the language being used, then why are you implying anyone asked an AI to make a portrait of anyone?

          Obviously, yes, it’s not a self-portrait by the dictionary definitions of “self” and “portrait” but people use “self-portrait” to refer to a description of a person all the time, particularly in settings where emotional intelligence is discussed.

          Yes, I’m being pedantic, but so were you, so it feels fair game. But nothing in the article actually makes it seem as if a portrait is being illustrated other than the metaphorical portrait

          • Buffalox@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            18 hours ago

            I would argue that if you’re being pedantic about the language being used, then why are you implying anyone asked an AI to make a portrait of anyone?

            I didn’t I just used the semantics of the article and headline. Obviously it’s not a literal “portrait” you’d have to be pretty stupid to read it like that.

            • JustAnotherKay@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              12 hours ago

              Asking an AI to make a portrait…

              This phrase doesn’t imply that someone asked an AI to make a portrait?

              • Buffalox@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                edit-2
                9 hours ago

                Normally it would, but In accordance with the content of the article, the “portrait” is a semaphore.

                Don’t blame me, blame the researchers that thought it was a good idea to use this stupid wording for what is really profiling.