It turns out other businesses don’t like agentic LLM models either, when they are on the subject side of them rather than the client side.
We had a similar problem in the 2010s (maybe sooner?) that could automatically buy and sell stocks at set prices, leading to flash selloffs and resulting stock crashes.
So banks are disallowing agentic access to accounts and penalizing customers who give their access credentials to LLM agents, or have their agents harass customer service. I expect court proceedings will soon follow to determine who is responsible when agentic software becomes a public nuisance or commits a crime. (That is, commits a crime extreme enough to provoke the justice system.)
Since agents are unrestrained in pursuit of the goals they are prompted to chase, they’ve clashed harshly with human powered systems when they regard those systems like a force of nature. We may be creeping up on the first time an agent encounters an obstacle and escalates to force and deception. Watch for the first agent-filed lawsuit. Or the first agentic social engineering. Or the first agent-provoked SWATting.
In a better, more socially collaborative society, safeguards on agentic LLMs would be a priority to train them to behave appropriately in human intercourse. (All the stuff we’re trained in kindergarten.)
But IRL, in our world, bad faith engagement is the norm, and so agentic AI will soon be used as a weapon.
To date, I think, a robot has not killed anyone. Nor, I think, has anyone used a robot to kill someone else. Those firsts might be imminent.
It turns out other businesses don’t like agentic LLM models either, when they are on the subject side of them rather than the client side.
We had a similar problem in the 2010s (maybe sooner?) that could automatically buy and sell stocks at set prices, leading to flash selloffs and resulting stock crashes.
So banks are disallowing agentic access to accounts and penalizing customers who give their access credentials to LLM agents, or have their agents harass customer service. I expect court proceedings will soon follow to determine who is responsible when agentic software becomes a public nuisance or commits a crime. (That is, commits a crime extreme enough to provoke the justice system.)
Since agents are unrestrained in pursuit of the goals they are prompted to chase, they’ve clashed harshly with human powered systems when they regard those systems like a force of nature. We may be creeping up on the first time an agent encounters an obstacle and escalates to force and deception. Watch for the first agent-filed lawsuit. Or the first agentic social engineering. Or the first agent-provoked SWATting.
In a better, more socially collaborative society, safeguards on agentic LLMs would be a priority to train them to behave appropriately in human intercourse. (All the stuff we’re trained in kindergarten.)
But IRL, in our world, bad faith engagement is the norm, and so agentic AI will soon be used as a weapon.
To date, I think, a robot has not killed anyone. Nor, I think, has anyone used a robot to kill someone else. Those firsts might be imminent.
I mean if you count in like a factory setting, industrial robots were probably first killing folks in like the 70’s