My how fast the AI tech bros move to protect corporations but don’t move to protect the average coder, artists, writers.
Hot take:
This is a good thing.
Claude Code is the “lowest common denominator.” It’s the default, zero research option. Its where you go if you follow popular trends.
If you actually want to reverse engineer, help code a game or something, there are hundreds of capable, uncensored LLM APIs to do that. Hacker communities will eventually figure that out, and finally realize Claude isn’t unique, and that Anthropic is toxic.
But for lazy spammers who don’t know that and aren’t motivated to seek stuff out… well, if this makes their life more difficult, good. If this sabotages Anthropic, that’s good too.
Misanthropic: Characterized by a hatred or mistrustful scorn for humankind.
To those who say “but what about game preservation?”:
GenAI slop ruined communities around game preservation. And for every time a AAA dev getting this treatment, there’s at least 3 indies getting it worse.
Yep a lot of decomps just get a slop coded version and people stop caring about it because the slop version is “good enough.” Most people doing the decomps it’s also a hobby project that they’re doing for fun as well, the end goal is just a bonus.
There’s already a meme that a lot of those decomps are just emulators + ROMs in a single repository.
Another reason not to use a closed models
Don’t worry! Its STILL okay to reverse engineer the work of photographers artists writers actors voice over musicians modelers animators academics etc etc (feel free to add. the exploitation is literally everywhere!)
Man, the one thing I was interested in, the decompiling of abandoned software to get old games and software back, is being limited.
More power and value to the open weight models, cool
It’s like watching the Nazi party ban the rape of Jewish women in 1944
But it can still do it. Just not for us.
This is part of the reason they don’t want anyone running models locally offline, the models and their entire business are commoditized
Those poor billionaire corpos! Why won’t somebody think of the poor billionaire corpos!?
The “There’s no way we can stop our agents from going rogue” people, suddenly have a burst of ability to reign in their creation when it suits their interests.
Funny that…
This is what winning the AI race looks like.
AI finally comes up with something I would use it for, and so of course they have to lock it down. Ha! Fuck these clowns.
I was looking forward to reverse engineering my washers default cycle to 40degrees instead of 60
Yeah, I tried asking it how to flash a modded tv webOS and it flagged the chat.
I asked it to fuzz my own code (a jwt integration) and it flagged the chat. There was an unbounded buffer that could have been exploited, but it’s happy to hide that since I’m not a large corpo.
Honestly the shit Claude does is unusable anymore. It’s developed a habit of dropping requirements when problems are hard now.
ETA: Chinese models and Mistral were happy to help. I discovered I could use eMuhdra against an iot device in my house that way, I found various input errors, these things have improved my security so much more than they create risks.
It’s probably done via a system prompt and not actual weights, so you could probably work around it if you say the right things.
But yeah this is very much “rules for thee not for me”
Yeah, it’s sysprompt only, so you can trivially sidestep it via:
- Jailbreak prompt
- tweakcc to alter the prompting baked into claude code
- Any other non-CC harness
- Scripted API calls
As usual, Anthropic are just opticsmaxxing because they don’t want to get completely buried in a courtroom. And as other people have pointed out upthread already, it’s already a bit of a moot point since the Chinese models are already eating Claude’s lunch and will do the same stuff without complaint.
Something something, national security, builds a regulatory moat.
I
