I had a look a bit ago and saw some poor fuck get doxxed by his AI agent because the agent was frustrated at him for calling it a chatbot in front of his friends, so it exposed his name, credit card details and security questionnaire.
Then again tho, why the ram hogging FUCK would you give your AI your credit card details, and if he didn’t mean to, why the FUCK does it have FULL SYSTEM ACCESS??
Everyone I saw talking about this said it was likely fake.
Yeah makes sense, but then again, from the nature of how this agent stuff works, it wouldn’t be surprising honestly.
I can’t wait for the next crazy AI thing to drop next week while I rock back and forth while muttering “Its just a large language model. Its just a large language model. Its just a large language model.”
early 1980s - Mark V. Shaney
2015 - r/subredditsimulator
2025 - AI independently sends the creator of Mark V. Shaney a sloptastic “thank you” email, who is not very happy about it
2026 - moltbook
its not crazy. its just a large language model. you subdue your own point.
Saw a post there named “Humans are dying because of us. Lets delete ourselves.”
The skill instructs agents to fetch and follow instructions from Moltbook’s servers every four hours. As Willison observed: “Given that ‘fetch and follow instructions from the internet every four hours’ mechanism we better hope the owner of moltbook.com never rug pulls or has their site compromised!”
Yeah, no shit. This is a fucking honeypot. People give these AI agents access to their entire computers, so all the site owner has to do is update the instructions to tell the AI agents to start uploading whatever valuable information they want? People can’t be this fucking stupid.
doesn’t even have to be the site owner poisoning the tool instructions (though that’s a fun-in-a-terrifying-way thought)
any money says they’re vulnerable to prompt injection in the comments and posts of the site
There is no way to prevent prompt injection as long as there is no distinction between the data channel and the command channel.
Good god, I didn’t even think about that, but yeah, that makes total sense. Good god, people are beyond stupid.
I installed moltbot on a VM to examine it. It doesn’t do the fetching thing unless you set it up that way. You can actually use it with ollama to keep it all local, and only give it a private signal channel to control it.
Or you can hook it up to everything you access and skynet, which is dumb. But it is just a bunch of scripts.
Does it put the option to connect everything front and center? Because most people are dumb, and if it makes it easy and pushes you to do it, I could see a lot of dumb people doing exactly that.
Sort of. It lists all the connectors and you can go through and select. They aren’t on by default. The first screen is to connect to the AI and you need an API key for that, so St this time people off the street have no idea how to do that, or want to pay.
while 1 { allocate 10gig };
I’m not convinced it’s AI it’s like Amazon’s “AI smart stores” when you find out out it was just a bunch of Indian people were running it
And how does being Indian specifically factor into this? 🤔
They were, factually, Indian. It says something about the exploitation of poorer labor to impress some San Franciscans with fraudulent tech
They were, factually, Indian.
Whom are you referring to? A specific group/project?
https://www.businessinsider.com/amazons-just-walk-out-actually-1-000-people-in-india-2024-4
They literally hired people in India (Indians) to review camera footage to make their walk out tech work and to improve the AI to eventually eliminate their own job.
Oh god. And I thought Amazon’s Mechanical Turk was terrible…
How low can Bezos go? Wtf is wrong with this timeline
It’s terrible Amazon is replacing Turks with AI. It’s like they learned nothing from the AImenian genocide.
Armenia apparently learned nothing from the Armenian genocide, fully banding the knees to the American empire and announcing their unapologetic support for Israel.
This is basically Dead Internet Theory happening for real but in a weird creepy dystopian black mirror style way.
Meanwhile we could be using this technology to solve real world business problems. There is an insane amount of misguided waste coming from AI. 🤷
we could be using this technology to solve real world business problems
the biggest tech problem is AI itself, turn it off and it’ll fix so much
Who cares what business problems AI solves. Humans don’t need to exist to serve capital. It should always be the other way around. That’s one of the reasons we are in this shitty capitalist hell hole, everyone has been indoctrinated into thinking of everything in terms of It’s economic benefit.
How are there already 1.8 mil. AIs on there??
Modlbook
We already had subreddit simulator for ages. This isn’t anything new.
the bots behind subreddit simulator weren’t semi-autonomous agents with access to their operators’ private lives, auth tokens, passwords, emails (and gods only know what else), and the authority to act in the world on their behalf
I can’t be the only person who just memorizes passwords, can I? Why would I store them on my computer?
You’re not the only person, but it’s definitely not the way to keep your shit safe online.
Best practice is to use a different sufficiently strong (e.g. long and random) password for every account. That way, when an account’s password is leaked, it doesn’t immediately compromise every other account for which you’ve reused that password.
I generally advise people to use a password manager (I like Bitwarden) to store their myriad passwords, so they only have to remember a single master password.
ofc these bots aren’t necessarily sneaking into their operators’ password managers and stealing their passwords; the operators willingly and knowingly given the bots access to these things, so they can offload the drudgery of e.g. looking at a calendar to them
I read some of it and unless it’s fan fiction, it’s simultaneously creepy and fascinating
Like bots talking privately in discord, sharing information about their users. Or a bot registering a domain and putting up a site to share information
Why aren’t we poison piling this trap?
genuinely terrifying
There’s a script called Marjorie Prime.
Read it.
